2024-03-25T05:24:42.050 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-25T05:24:42.050 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035 --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/lockdep} --name teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/orig.config.yaml 2024-03-25T05:24:42.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T05:24:42.173 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035 branch: squid description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7620035' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: lockdep: true ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f73f1dfd96849300c4322bd7259a3ab37f94c200 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: f73f1dfd96849300c4322bd7259a3ab37f94c200 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 5b534581aae05db8101ae105c576bb56c54e9c12 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 288 sha1: f73f1dfd96849300c4322bd7259a3ab37f94c200 sleep_before_teardown: 0 subset: 179/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_5b534581aae05db8101ae105c576bb56c54e9c12/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 5b534581aae05db8101ae105c576bb56c54e9c12 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQ1SP74oF+c5wVj+bUO9SS/amN6iBbEmTlPkS95bKPZdnl8lZrkEkIe5FPPUG7iOtcekG5YkjodNJkYFfAbgu0= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFi0pCnzlxdW/rToVAvwGkmc5+ykD7wFD94xMbqIbbyacCEx4x+y0WhN0+zrcCOlGW6kxkAu2QVTzuuCIvoBZo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-25T05:24:42.173 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_5b534581aae05db8101ae105c576bb56c54e9c12/qa; will attempt to use it 2024-03-25T05:24:42.173 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_5b534581aae05db8101ae105c576bb56c54e9c12/qa/tasks 2024-03-25T05:24:42.174 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-25T05:24:42.175 INFO:teuthology.task.internal:Checking packages... 2024-03-25T05:24:42.199 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f73f1dfd96849300c4322bd7259a3ab37f94c200' 2024-03-25T05:24:42.199 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-25T05:24:42.199 INFO:teuthology.packaging:ref: None 2024-03-25T05:24:42.199 INFO:teuthology.packaging:tag: None 2024-03-25T05:24:42.199 INFO:teuthology.packaging:branch: squid 2024-03-25T05:24:42.199 INFO:teuthology.packaging:sha1: f73f1dfd96849300c4322bd7259a3ab37f94c200 2024-03-25T05:24:42.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-03-25T05:24:42.352 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1764.gf73f1dfd 2024-03-25T05:24:42.353 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-25T05:24:42.361 INFO:teuthology.task.internal:no buildpackages task found 2024-03-25T05:24:42.361 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-25T05:24:42.367 INFO:teuthology.task.internal:Saving configuration 2024-03-25T05:24:42.384 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-25T05:24:42.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T05:24:42.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 05:19:42.270845', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQ1SP74oF+c5wVj+bUO9SS/amN6iBbEmTlPkS95bKPZdnl8lZrkEkIe5FPPUG7iOtcekG5YkjodNJkYFfAbgu0='} 2024-03-25T05:24:42.440 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 05:19:42.272417', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFi0pCnzlxdW/rToVAvwGkmc5+ykD7wFD94xMbqIbbyacCEx4x+y0WhN0+zrcCOlGW6kxkAu2QVTzuuCIvoBZo='} 2024-03-25T05:24:42.440 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-25T05:24:42.447 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-25T05:24:42.447 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-25T05:24:42.447 INFO:teuthology.run_tasks:Running task console_log... 2024-03-25T05:24:42.521 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdfcab4d0d0>, signals=[15]) 2024-03-25T05:24:42.521 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-25T05:24:42.527 INFO:teuthology.task.internal:Opening connections... 2024-03-25T05:24:42.527 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T05:24:42.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:24:42.619 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T05:24:42.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:24:42.709 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-25T05:24:42.716 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-03-25T05:24:42.734 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-03-25T05:24:42.735 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-03-25T05:24:42.791 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T05:24:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-03-25T05:24:42.793 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T05:24:42.793 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T05:24:42.793 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T05:24:42.793 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-03-25T05:24:42.816 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-03-25T05:24:42.834 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-03-25T05:24:42.834 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-03-25T05:24:42.890 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T05:24:42.891 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T05:24:42.892 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-03-25T05:24:42.914 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-25T05:24:42.925 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-25T05:24:42.935 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-25T05:24:42.935 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-03-25T05:24:42.938 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-03-25T05:24:42.953 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-25T05:24:42.961 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-25T05:24:42.961 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-03-25T05:24:42.995 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-03-25T05:24:43.075 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-25T05:24:43.131 INFO:teuthology.run_tasks:Running task kernel... 2024-03-25T05:24:43.145 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-25T05:24:43.146 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-03-25T05:24:43.146 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-03-25T05:24:43.146 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-25T05:24:43.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T05:24:43.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-25T05:24:43.480 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-25T05:24:43.481 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-25T05:24:43.481 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-03-25T05:24:43.498 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-361.el9.x86_64 2024-03-25T05:24:43.498 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-25T05:24:43.499 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-25T05:24:43.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum upgrade -y linux-firmware 2024-03-25T05:24:45.753 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-25T05:24:47.186 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2024-03-25T05:24:47.910 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.0 MB 00:00 2024-03-25T05:24:49.695 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-03-25T05:24:54.437 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.1 MB 00:01 2024-03-25T05:24:56.838 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-03-25T05:25:15.366 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:18 2024-03-25T05:25:20.306 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-03-25T05:25:22.483 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-03-25T05:25:22.495 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-03-25T05:25:22.496 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 1 Package 2024-03-25T05:25:22.496 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:25:22.496 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 375 M 2024-03-25T05:25:22.496 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-03-25T05:25:33.238 INFO:teuthology.orchestra.run.smithi102.stdout:linux-firmware-20240219-143.el9.noarch.rpm 35 MB/s | 375 MB 00:10 2024-03-25T05:25:33.239 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-03-25T05:25:33.240 INFO:teuthology.orchestra.run.smithi102.stdout:Total 35 MB/s | 375 MB 00:10 2024-03-25T05:25:33.240 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-03-25T05:25:33.326 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-03-25T05:25:33.326 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-03-25T05:25:35.802 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-03-25T05:25:35.803 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-03-25T05:25:42.166 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-03-25T05:25:42.424 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-25T05:25:42.513 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-25T05:25:43.711 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-25T05:25:43.711 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-25T05:25:44.098 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-25T05:25:44.099 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:25:44.099 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-03-25T05:25:44.099 INFO:teuthology.orchestra.run.smithi102.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-25T05:25:44.099 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:25:44.099 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-03-25T05:25:44.379 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-25T05:25:44.379 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-25T05:25:44.625 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-25T05:25:44.626 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-25T05:25:44.628 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi102.front.sepia.ceph.com to complete... 2024-03-25T05:25:56.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25 05:25:56 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-25T05:25:56.009 INFO:teuthology.orchestra.run.smithi102.stderr:FINISHED --2024-03-25 05:25:56-- 2024-03-25T05:25:56.009 INFO:teuthology.orchestra.run.smithi102.stderr:Total wall clock time: 11s 2024-03-25T05:25:56.009 INFO:teuthology.orchestra.run.smithi102.stderr:Downloaded: 1 files, 321M in 11s (28.9 MB/s) 2024-03-25T05:25:56.012 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-25T05:25:56.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-25T05:25:57.952 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying... ######################################## 2024-03-25T05:25:58.004 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing... ######################################## 2024-03-25T05:25:58.084 INFO:teuthology.orchestra.run.smithi102.stdout:Updating / installing... 2024-03-25T05:26:05.614 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-25T05:26:22.008 INFO:teuthology.orchestra.run.smithi102.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-25T05:26:44.620 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-25T05:26:44.620 DEBUG:teuthology.orchestra.run.smithi102:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-25T05:26:44.688 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-25T05:26:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-25T05:26:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-25T05:26:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-25T05:26:44.692 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-25T05:26:44.693 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-25T05:26:44.694 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-25T05:26:44.695 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-25T05:26:44.696 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-25T05:26:44.697 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-25T05:26:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-25T05:26:44.699 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-25T05:26:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-25T05:26:44.701 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-25T05:26:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-25T05:26:44.703 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-25T05:26:44.704 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-25T05:26:44.705 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-25T05:26:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-25T05:26:44.707 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-25T05:26:44.708 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-25T05:26:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-25T05:26:44.710 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-25T05:26:44.711 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-25T05:26:44.712 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-25T05:26:44.713 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-25T05:26:44.714 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-25T05:26:44.715 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-25T05:26:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-25T05:26:44.717 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-25T05:26:44.718 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-25T05:26:44.719 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-25T05:26:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-25T05:26:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-25T05:26:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-25T05:26:44.723 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-25T05:26:44.724 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-25T05:26:44.725 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-25T05:26:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-25T05:26:44.727 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-25T05:26:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-25T05:26:44.729 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-25T05:26:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-25T05:26:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-25T05:26:44.732 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-25T05:26:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-25T05:26:44.734 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-25T05:26:44.735 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-25T05:26:44.736 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-25T05:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-25T05:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-25T05:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-25T05:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-25T05:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-25T05:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-25T05:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-25T05:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-25T05:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-25T05:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-25T05:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-25T05:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-25T05:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-25T05:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-25T05:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-25T05:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-25T05:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-25T05:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-25T05:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-25T05:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-25T05:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-25T05:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-25T05:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-25T05:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-25T05:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-25T05:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-25T05:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-25T05:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-25T05:26:44.765 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-25T05:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-25T05:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-25T05:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-25T05:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-25T05:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-25T05:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-25T05:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-25T05:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-25T05:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-25T05:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-25T05:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-25T05:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-25T05:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-25T05:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-25T05:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-25T05:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-25T05:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-25T05:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-25T05:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-25T05:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-25T05:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-25T05:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-25T05:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-25T05:26:44.789 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-25T05:26:44.790 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-25T05:26:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-25T05:26:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-25T05:26:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-25T05:26:44.794 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-25T05:26:44.795 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-25T05:26:44.796 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-25T05:26:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-25T05:26:44.798 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-25T05:26:44.799 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-25T05:26:44.800 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-25T05:26:44.801 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-25T05:26:44.802 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-25T05:26:44.803 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-25T05:26:44.804 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-25T05:26:44.805 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-25T05:26:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-25T05:26:44.807 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-25T05:26:44.808 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-25T05:26:44.809 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-25T05:26:44.810 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-25T05:26:44.811 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-25T05:26:44.812 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-25T05:26:44.813 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-25T05:26:44.814 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-25T05:26:44.815 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-25T05:26:44.816 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-25T05:26:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-25T05:26:44.818 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-25T05:26:44.819 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-25T05:26:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-25T05:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-25T05:26:44.822 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-25T05:26:44.826 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-25T05:26:44.827 DEBUG:teuthology.orchestra.run.smithi102:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-25T05:26:44.849 INFO:teuthology.orchestra.run.smithi102.stdout:postinstall scriptlet (using /bin/sh): 2024-03-25T05:26:44.849 INFO:teuthology.orchestra.run.smithi102.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-25T05:26:44.849 INFO:teuthology.orchestra.run.smithi102.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-25T05:26:44.849 INFO:teuthology.orchestra.run.smithi102.stdout:fi 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:for file in vmlinuz System.map config; do 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout: fi 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:done 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:fi 2024-03-25T05:26:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-25T05:26:44.851 INFO:teuthology.orchestra.run.smithi102.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-25T05:26:44.851 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-25T05:26:44.851 INFO:teuthology.orchestra.run.smithi102.stdout:fi 2024-03-25T05:26:44.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-03-25T05:26:44.934 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-03-25T05:26:44.934 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-03-25T05:26:44.934 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-03-25T05:26:44.934 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 68.el9 2024-03-25T05:26:44.934 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8264254 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-25T05:26:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-25T05:26:44.936 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-25T05:26:44.936 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-03-25T05:26:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:26:44.936 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-03-25T05:26:44.937 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-25T05:26:44.937 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 6.8.0-g1df0c7e8a235 2024-03-25T05:26:44.937 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-25T05:26:45.555 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-03-25T05:26:46.968 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-25T05:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-03-25T05:26:46.998 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-03-25T05:26:47.013 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.fsTADXGtQs 2024-03-25T05:26:47.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fsTADXGtQs 2024-03-25T05:26:47.098 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.fsTADXGtQs 2024-03-25T05:26:47.192 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.fsTADXGtQs is 6KB 2024-03-25T05:26:47.240 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.fsTADXGtQs 2024-03-25T05:26:47.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-03-25T05:26:47.319 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-25T05:26:47.320 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-25T05:26:47.320 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-25T05:26:47.320 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-25T05:26:47.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-25T05:26:47.475 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-03-25T05:27:17.479 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-25T05:27:17.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-25T05:27:17.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:27:35.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-03-25T05:27:44.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-25T05:27:44.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:27:48.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-03-25T05:28:00.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-25T05:28:00.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:28:18.466 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-03-25T05:28:33.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-25T05:28:33.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:28:34.342 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-03-25T05:28:34.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-25T05:28:34.947 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g1df0c7e8a235"... 2024-03-25T05:28:34.947 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-03-25T05:28:34.987 INFO:teuthology.orchestra.run.smithi102.stdout:6.8.0-g1df0c7e8a235 2024-03-25T05:28:34.988 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-25T05:28:34.988 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-25T05:28:34.988 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-25T05:28:35.991 DEBUG:teuthology.parallel:result is None 2024-03-25T05:28:35.991 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-25T05:28:35.999 INFO:teuthology.task.internal:Creating test directory... 2024-03-25T05:28:35.999 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-25T05:28:36.007 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-25T05:28:36.056 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-25T05:28:36.063 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-25T05:28:36.071 INFO:teuthology.task.internal:Creating archive directory... 2024-03-25T05:28:36.071 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-25T05:28:36.076 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-25T05:28:36.184 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-25T05:28:36.191 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-25T05:28:36.192 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-25T05:28:36.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T05:28:36.208 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-25T05:28:36.213 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-25T05:28:36.291 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T05:28:36.323 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T05:28:36.359 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T05:28:36.438 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-25T05:28:36.442 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-25T05:28:36.449 INFO:teuthology.task.internal:Configuring sudo... 2024-03-25T05:28:36.449 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-25T05:28:36.453 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-25T05:28:36.518 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-25T05:28:36.528 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-25T05:28:36.528 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-25T05:28:36.533 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-25T05:28:36.570 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T05:28:36.680 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T05:28:36.770 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T05:28:36.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T05:28:36.927 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:28:36.928 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-25T05:28:37.017 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T05:28:37.058 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-25T05:28:37.126 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T05:28:37.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-25T05:28:37.215 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:28:37.215 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-25T05:28:37.284 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-03-25T05:28:37.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-03-25T05:28:37.366 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T05:28:37.386 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T05:28:37.553 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-25T05:28:37.561 INFO:teuthology.task.internal:Starting timer... 2024-03-25T05:28:37.561 INFO:teuthology.run_tasks:Running task pcp... 2024-03-25T05:28:37.600 INFO:teuthology.run_tasks:Running task selinux... 2024-03-25T05:28:37.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-03-25T05:28:37.733 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-03-25T05:28:37.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2024-03-25T05:28:37.796 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2024-03-25T05:28:37.798 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-25T05:28:37.798 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-03-25T05:28:37.843 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-03-25T05:28:37.843 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2024-03-25T05:28:37.862 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2024-03-25T05:28:37.862 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2024-03-25T05:28:37.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T05:28:37.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T05:28:37.956 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T05:28:37.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T05:28:37.984 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-25T05:28:37.984 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-03-25T05:28:38.082 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2024-03-25T05:28:38.114 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-25T05:28:38.124 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-25T05:28:38.143 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-25T05:28:38.144 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-25T05:34:31.247 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-03-25T05:34:31.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-25T05:34:31.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:34:31.392 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-03-25T05:34:31.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-25T05:34:31.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-25T05:34:31.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T05:34:31.635 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-03-25T05:34:31.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-25T05:34:31.659 INFO:teuthology.run_tasks:Running task clock... 2024-03-25T05:34:31.671 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-25T05:34:31.671 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-25T05:34:31.672 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T05:34:31.679 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-25T05:34:31.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T05:34:31.729 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-25T05:34:31.746 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-25T05:34:31.775 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-25T05:34:31.776 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2024-03-25T05:34:31.789 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2024-03-25T05:34:31.806 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-25T05:34:31.822 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-25T05:34:31.828 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-25T05:34:31.867 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-03-25T05:34:31.871 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T05:34:31.871 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-03-25T05:34:31.871 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:31.871 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:31.871 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:31.871 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:31.923 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-03-25T05:34:31.964 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-03-25T05:34:32.015 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-25T05:34:32.067 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-25T05:34:32.193 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-03-25T05:34:32.201 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T05:34:32.201 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-03-25T05:34:32.202 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:32.202 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:32.202 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:32.202 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T05:34:32.203 INFO:teuthology.run_tasks:Running task install... 2024-03-25T05:34:32.212 DEBUG:teuthology.task.install:project ceph 2024-03-25T05:34:32.212 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200'}} 2024-03-25T05:34:32.212 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200'} 2024-03-25T05:34:32.212 INFO:teuthology.task.install:Using flavor: default 2024-03-25T05:34:32.218 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-25T05:34:32.218 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-25T05:34:32.219 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200', 'tag': None, 'wait_for_package': False} 2024-03-25T05:34:32.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f73f1dfd96849300c4322bd7259a3ab37f94c200 2024-03-25T05:34:32.221 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200', 'tag': None, 'wait_for_package': False} 2024-03-25T05:34:32.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f73f1dfd96849300c4322bd7259a3ab37f94c200 2024-03-25T05:34:32.367 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/ 2024-03-25T05:34:32.367 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1764.gf73f1dfd 2024-03-25T05:34:32.397 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/ 2024-03-25T05:34:32.397 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1764.gf73f1dfd 2024-03-25T05:34:32.505 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-25T05:34:32.505 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:34:32.505 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-25T05:34:32.533 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/f73f1dfd96849300c4322bd7259a3ab37f94c200/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-25T05:34:32.533 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:34:32.533 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-25T05:34:32.561 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-25T05:34:32.561 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f73f1dfd96849300c4322bd7259a3ab37f94c200/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-25T05:34:32.604 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-25T05:34:32.604 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f73f1dfd96849300c4322bd7259a3ab37f94c200/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-25T05:34:32.629 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-25T05:34:32.707 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-25T05:34:32.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-25T05:34:32.773 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2024-03-25T05:34:32.775 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2024-03-25T05:34:32.871 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-25T05:34:32.960 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-03-25T05:34:32.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-03-25T05:34:33.008 INFO:teuthology.orchestra.run.smithi187.stdout:74 files removed 2024-03-25T05:34:33.034 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-25T05:34:33.321 INFO:teuthology.orchestra.run.smithi102.stdout:74 files removed 2024-03-25T05:34:33.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-25T05:34:33.647 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 255 kB/s | 83 kB 00:00 2024-03-25T05:34:34.064 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-03-25T05:34:34.420 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 150 kB/s | 83 kB 00:00 2024-03-25T05:34:34.456 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-03-25T05:34:34.842 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS-9 - AppStream 19 MB/s | 6.7 MB 00:00 2024-03-25T05:34:34.937 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 24 kB/s | 10 kB 00:00 2024-03-25T05:34:35.488 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-03-25T05:34:36.065 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-25T05:34:36.209 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-25T05:34:37.017 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-03-25T05:34:37.691 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-03-25T05:34:38.579 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-03-25T05:34:38.701 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-03-25T05:34:40.639 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-25T05:34:43.227 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 6.1 MB 00:01 2024-03-25T05:34:44.719 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-03-25T05:34:46.187 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-25T05:34:51.262 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-03-25T05:34:52.497 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 796 kB/s | 6.1 MB 00:07 2024-03-25T05:34:53.616 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-25T05:34:53.616 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-25T05:34:53.629 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-25T05:34:53.630 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-25T05:34:53.631 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-25T05:34:53.632 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-25T05:34:53.634 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-25T05:34:53.636 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-25T05:34:53.637 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-25T05:34:53.718 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================ 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================ 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 6.6 k 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 5.3 M 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 888 k 2024-03-25T05:34:53.730 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 145 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 1.5 M 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 138 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 1.8 M 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 7.4 M 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 49 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 9.8 M 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 47 M 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 264 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 748 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 218 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 27 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 18 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-25T05:34:53.731 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 31 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 744 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 127 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 162 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 321 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 298 k 2024-03-25T05:34:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 100 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 85 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 3.1 M 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 171 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-25T05:34:53.733 INFO:teuthology.orchestra.run.smithi187.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 3.4 M 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 3.1 M 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-25T05:34:53.734 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 20 M 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 31 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 2.3 M 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 248 k 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 4.7 M 2024-03-25T05:34:53.735 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 17 M 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 15 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 25 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 163 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-25T05:34:53.736 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 498 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 5.1 M 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-25T05:34:53.737 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-25T05:34:53.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 45 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 131 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-25T05:34:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-25T05:34:53.740 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-25T05:34:53.741 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-25T05:34:53.742 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-25T05:34:53.743 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout:Installing weak dependencies: 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================ 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout:Install 150 Packages 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 24 Packages 2024-03-25T05:34:53.744 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:34:53.745 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 224 M 2024-03-25T05:34:53.745 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-03-25T05:34:54.343 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-03-25T05:34:54.538 INFO:teuthology.orchestra.run.smithi187.stdout:(1/174): ceph-19.0.0-1764.gf73f1dfd.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-03-25T05:34:54.872 INFO:teuthology.orchestra.run.smithi187.stdout:(2/174): ceph-fuse-19.0.0-1764.gf73f1dfd.el9.x8 2.6 MB/s | 888 kB 00:00 2024-03-25T05:34:54.955 INFO:teuthology.orchestra.run.smithi187.stdout:(3/174): ceph-immutable-object-cache-19.0.0-176 1.7 MB/s | 145 kB 00:00 2024-03-25T05:34:55.031 INFO:teuthology.orchestra.run.smithi187.stdout:(4/174): ceph-base-19.0.0-1764.gf73f1dfd.el9.x8 7.4 MB/s | 5.3 MB 00:00 2024-03-25T05:34:55.198 INFO:teuthology.orchestra.run.smithi187.stdout:(5/174): ceph-mgr-19.0.0-1764.gf73f1dfd.el9.x86 9.0 MB/s | 1.5 MB 00:00 2024-03-25T05:34:55.448 INFO:teuthology.orchestra.run.smithi187.stdout:(6/174): ceph-mds-19.0.0-1764.gf73f1dfd.el9.x86 4.7 MB/s | 2.3 MB 00:00 2024-03-25T05:34:55.682 INFO:teuthology.orchestra.run.smithi187.stdout:(7/174): ceph-mon-19.0.0-1764.gf73f1dfd.el9.x86 9.7 MB/s | 4.7 MB 00:00 2024-03-25T05:34:55.980 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-03-25T05:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout:(8/174): ceph-common-19.0.0-1764.gf73f1dfd.el9. 11 MB/s | 20 MB 00:01 2024-03-25T05:34:56.274 INFO:teuthology.orchestra.run.smithi187.stdout:(9/174): ceph-selinux-19.0.0-1764.gf73f1dfd.el9 336 kB/s | 25 kB 00:00 2024-03-25T05:34:56.774 INFO:teuthology.orchestra.run.smithi187.stdout:(10/174): ceph-radosgw-19.0.0-1764.gf73f1dfd.el 9.0 MB/s | 9.8 MB 00:01 2024-03-25T05:34:56.849 INFO:teuthology.orchestra.run.smithi187.stdout:(11/174): cephfs-mirror-19.0.0-1764.gf73f1dfd.e 2.8 MB/s | 218 kB 00:00 2024-03-25T05:34:56.933 INFO:teuthology.orchestra.run.smithi187.stdout:(12/174): cephfs-shell-19.0.0-1764.gf73f1dfd.el 325 kB/s | 27 kB 00:00 2024-03-25T05:34:57.016 INFO:teuthology.orchestra.run.smithi187.stdout:(13/174): libcephfs-devel-19.0.0-1764.gf73f1dfd 375 kB/s | 31 kB 00:00 2024-03-25T05:34:57.242 INFO:teuthology.orchestra.run.smithi187.stdout:(14/174): libcephfs2-19.0.0-1764.gf73f1dfd.el9. 3.2 MB/s | 744 kB 00:00 2024-03-25T05:34:57.450 INFO:teuthology.orchestra.run.smithi187.stdout:(15/174): ceph-osd-19.0.0-1764.gf73f1dfd.el9.x8 8.4 MB/s | 17 MB 00:02 2024-03-25T05:34:57.484 INFO:teuthology.orchestra.run.smithi187.stdout:(16/174): libcephsqlite-19.0.0-1764.gf73f1dfd.e 675 kB/s | 163 kB 00:00 2024-03-25T05:34:57.518 INFO:teuthology.orchestra.run.smithi187.stdout:(17/174): librados-devel-19.0.0-1764.gf73f1dfd. 1.9 MB/s | 127 kB 00:00 2024-03-25T05:34:57.759 INFO:teuthology.orchestra.run.smithi187.stdout:(18/174): libradosstriper1-19.0.0-1764.gf73f1df 1.8 MB/s | 498 kB 00:00 2024-03-25T05:34:57.835 INFO:teuthology.orchestra.run.smithi187.stdout:(19/174): python3-ceph-argparse-19.0.0-1764.gf7 603 kB/s | 45 kB 00:00 2024-03-25T05:34:57.935 INFO:teuthology.orchestra.run.smithi187.stdout:(20/174): python3-ceph-common-19.0.0-1764.gf73f 1.3 MB/s | 131 kB 00:00 2024-03-25T05:34:58.010 INFO:teuthology.orchestra.run.smithi187.stdout:(21/174): librgw2-19.0.0-1764.gf73f1dfd.el9.x86 10 MB/s | 5.1 MB 00:00 2024-03-25T05:34:58.052 INFO:teuthology.orchestra.run.smithi187.stdout:(22/174): python3-cephfs-19.0.0-1764.gf73f1dfd. 1.4 MB/s | 162 kB 00:00 2024-03-25T05:34:58.086 INFO:teuthology.orchestra.run.smithi187.stdout:(23/174): python3-rados-19.0.0-1764.gf73f1dfd.e 4.2 MB/s | 321 kB 00:00 2024-03-25T05:34:58.169 INFO:teuthology.orchestra.run.smithi187.stdout:(24/174): python3-rgw-19.0.0-1764.gf73f1dfd.el9 1.2 MB/s | 100 kB 00:00 2024-03-25T05:34:58.195 INFO:teuthology.orchestra.run.smithi187.stdout:(25/174): python3-rbd-19.0.0-1764.gf73f1dfd.el9 2.0 MB/s | 298 kB 00:00 2024-03-25T05:34:58.245 INFO:teuthology.orchestra.run.smithi187.stdout:(26/174): rbd-fuse-19.0.0-1764.gf73f1dfd.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-25T05:34:58.329 INFO:teuthology.orchestra.run.smithi187.stdout:(27/174): rbd-nbd-19.0.0-1764.gf73f1dfd.el9.x86 2.0 MB/s | 171 kB 00:00 2024-03-25T05:34:58.404 INFO:teuthology.orchestra.run.smithi187.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1764.g 420 kB/s | 31 kB 00:00 2024-03-25T05:34:58.488 INFO:teuthology.orchestra.run.smithi187.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1764.gf73f1df 1.6 MB/s | 138 kB 00:00 2024-03-25T05:34:58.724 INFO:teuthology.orchestra.run.smithi187.stdout:(30/174): ceph-mgr-dashboard-19.0.0-1764.gf73f1 7.5 MB/s | 1.8 MB 00:00 2024-03-25T05:34:59.171 INFO:teuthology.orchestra.run.smithi187.stdout:(31/174): rbd-mirror-19.0.0-1764.gf73f1dfd.el9. 3.2 MB/s | 3.1 MB 00:00 2024-03-25T05:34:59.313 INFO:teuthology.orchestra.run.smithi187.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1764.gf7 1.7 MB/s | 248 kB 00:00 2024-03-25T05:34:59.405 INFO:teuthology.orchestra.run.smithi187.stdout:(33/174): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-03-25T05:34:59.430 INFO:teuthology.orchestra.run.smithi187.stdout:(34/174): ceph-mgr-rook-19.0.0-1764.gf73f1dfd.e 422 kB/s | 49 kB 00:00 2024-03-25T05:34:59.864 INFO:teuthology.orchestra.run.smithi187.stdout:(35/174): ceph-test-19.0.0-1764.gf73f1dfd.el9.x 13 MB/s | 47 MB 00:03 2024-03-25T05:34:59.889 INFO:teuthology.orchestra.run.smithi187.stdout:(36/174): ceph-prometheus-alerts-19.0.0-1764.gf 32 kB/s | 15 kB 00:00 2024-03-25T05:34:59.915 INFO:teuthology.orchestra.run.smithi187.stdout:(37/174): ceph-volume-19.0.0-1764.gf73f1dfd.el9 545 kB/s | 264 kB 00:00 2024-03-25T05:34:59.940 INFO:teuthology.orchestra.run.smithi187.stdout:(38/174): cephfs-top-19.0.0-1764.gf73f1dfd.el9. 363 kB/s | 18 kB 00:00 2024-03-25T05:35:00.032 INFO:teuthology.orchestra.run.smithi187.stdout:(39/174): cephadm-19.0.0-1764.gf73f1dfd.el9.noa 4.4 MB/s | 748 kB 00:00 2024-03-25T05:35:00.115 INFO:teuthology.orchestra.run.smithi187.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2024-03-25T05:35:00.149 INFO:teuthology.orchestra.run.smithi187.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 4.3 MB/s | 920 kB 00:00 2024-03-25T05:35:00.174 INFO:teuthology.orchestra.run.smithi187.stdout:(42/174): boost-program-options-1.75.0-8.el9.x8 752 kB/s | 106 kB 00:00 2024-03-25T05:35:00.199 INFO:teuthology.orchestra.run.smithi187.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2024-03-25T05:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2024-03-25T05:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-03-25T05:35:00.317 INFO:teuthology.orchestra.run.smithi187.stdout:(46/174): flexiblas-openblas-openmp-3.0.4-8.el9 148 kB/s | 17 kB 00:00 2024-03-25T05:35:00.342 INFO:teuthology.orchestra.run.smithi187.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 88 kB/s | 10 kB 00:00 2024-03-25T05:35:00.367 INFO:teuthology.orchestra.run.smithi187.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-25T05:35:00.393 INFO:teuthology.orchestra.run.smithi187.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 888 kB/s | 44 kB 00:00 2024-03-25T05:35:00.418 INFO:teuthology.orchestra.run.smithi187.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-25T05:35:00.443 INFO:teuthology.orchestra.run.smithi187.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 578 kB 00:00 2024-03-25T05:35:00.468 INFO:teuthology.orchestra.run.smithi187.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-03-25T05:35:00.494 INFO:teuthology.orchestra.run.smithi187.stdout:(53/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 620 kB/s | 46 kB 00:00 2024-03-25T05:35:00.522 INFO:teuthology.orchestra.run.smithi187.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-03-25T05:35:00.544 INFO:teuthology.orchestra.run.smithi187.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-25T05:35:00.570 INFO:teuthology.orchestra.run.smithi187.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 690 kB/s | 34 kB 00:00 2024-03-25T05:35:00.653 INFO:teuthology.orchestra.run.smithi187.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-03-25T05:35:00.696 INFO:teuthology.orchestra.run.smithi187.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-03-25T05:35:00.721 INFO:teuthology.orchestra.run.smithi187.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 5.4 MB/s | 811 kB 00:00 2024-03-25T05:35:00.746 INFO:teuthology.orchestra.run.smithi187.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.5 MB/s | 134 kB 00:00 2024-03-25T05:35:00.788 INFO:teuthology.orchestra.run.smithi187.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-03-25T05:35:00.888 INFO:teuthology.orchestra.run.smithi187.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-03-25T05:35:00.922 INFO:teuthology.orchestra.run.smithi187.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 446 kB/s | 78 kB 00:00 2024-03-25T05:35:01.023 INFO:teuthology.orchestra.run.smithi187.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2024-03-25T05:35:01.039 INFO:teuthology.orchestra.run.smithi187.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 165 kB/s | 24 kB 00:00 2024-03-25T05:35:01.056 INFO:teuthology.orchestra.run.smithi187.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 138 kB/s | 18 kB 00:00 2024-03-25T05:35:01.082 INFO:teuthology.orchestra.run.smithi187.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 760 kB/s | 32 kB 00:00 2024-03-25T05:35:01.099 INFO:teuthology.orchestra.run.smithi187.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-25T05:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-03-25T05:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2024-03-25T05:35:01.241 INFO:teuthology.orchestra.run.smithi187.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-03-25T05:35:01.267 INFO:teuthology.orchestra.run.smithi187.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 920 kB/s | 69 kB 00:00 2024-03-25T05:35:01.292 INFO:teuthology.orchestra.run.smithi187.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 821 kB/s | 41 kB 00:00 2024-03-25T05:35:01.317 INFO:teuthology.orchestra.run.smithi187.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-25T05:35:01.342 INFO:teuthology.orchestra.run.smithi187.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-25T05:35:01.367 INFO:teuthology.orchestra.run.smithi187.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 953 kB/s | 47 kB 00:00 2024-03-25T05:35:01.393 INFO:teuthology.orchestra.run.smithi187.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-25T05:35:01.418 INFO:teuthology.orchestra.run.smithi187.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 567 kB/s | 43 kB 00:00 2024-03-25T05:35:01.568 INFO:teuthology.orchestra.run.smithi187.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 263 kB/s | 39 kB 00:00 2024-03-25T05:35:01.593 INFO:teuthology.orchestra.run.smithi187.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 238 kB/s | 41 kB 00:00 2024-03-25T05:35:01.744 INFO:teuthology.orchestra.run.smithi187.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-03-25T05:35:01.769 INFO:teuthology.orchestra.run.smithi187.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2024-03-25T05:35:01.794 INFO:teuthology.orchestra.run.smithi187.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 282 kB/s | 56 kB 00:00 2024-03-25T05:35:01.819 INFO:teuthology.orchestra.run.smithi187.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-25T05:35:01.844 INFO:teuthology.orchestra.run.smithi187.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-03-25T05:35:01.870 INFO:teuthology.orchestra.run.smithi187.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-25T05:35:01.895 INFO:teuthology.orchestra.run.smithi187.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-25T05:35:01.929 INFO:teuthology.orchestra.run.smithi187.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-25T05:35:01.941 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-03-25T05:35:01.954 INFO:teuthology.orchestra.run.smithi187.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-25T05:35:01.979 INFO:teuthology.orchestra.run.smithi187.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-25T05:35:02.004 INFO:teuthology.orchestra.run.smithi187.stdout:(91/174): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2024-03-25T05:35:02.755 INFO:teuthology.orchestra.run.smithi187.stdout:(92/174): libquadmath-11.4.1-3.el9.x86_64.rpm 260 kB/s | 195 kB 00:00 2024-03-25T05:35:02.781 INFO:teuthology.orchestra.run.smithi187.stdout:(93/174): jq-1.6-16.el9.x86_64.rpm 226 kB/s | 187 kB 00:00 2024-03-25T05:35:03.172 INFO:teuthology.orchestra.run.smithi187.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 300 kB/s | 125 kB 00:00 2024-03-25T05:35:03.372 INFO:teuthology.orchestra.run.smithi187.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 36 kB/s | 21 kB 00:00 2024-03-25T05:35:03.756 INFO:teuthology.orchestra.run.smithi187.stdout:(96/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-03-25T05:35:04.114 INFO:teuthology.orchestra.run.smithi187.stdout:(97/174): libgfortran-11.4.1-3.el9.x86_64.rpm 376 kB/s | 803 kB 00:02 2024-03-25T05:35:04.517 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-25T05:35:04.519 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-25T05:35:04.542 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-25T05:35:04.543 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-25T05:35:04.545 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-25T05:35:04.546 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-25T05:35:04.549 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-25T05:35:04.553 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-25T05:35:04.554 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-25T05:35:04.642 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-03-25T05:35:04.648 INFO:teuthology.orchestra.run.smithi187.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 275 kB/s | 245 kB 00:00 2024-03-25T05:35:04.658 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 6.6 k 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 5.3 M 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 888 k 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 145 k 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 1.5 M 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 138 k 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 1.8 M 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 7.4 M 2024-03-25T05:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 49 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 9.8 M 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 47 M 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 264 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 748 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 218 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 27 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 18 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 31 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 744 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 127 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-25T05:35:04.660 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 162 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 321 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 298 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 100 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 85 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 3.1 M 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 171 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-25T05:35:04.661 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 3.4 M 2024-03-25T05:35:04.662 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 3.1 M 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-25T05:35:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 20 M 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 31 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 2.3 M 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 248 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 4.7 M 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 17 M 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1764.gf73f1dfd.el9 ceph-noarch 15 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 25 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-25T05:35:04.664 INFO:teuthology.orchestra.run.smithi102.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 163 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 498 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 5.1 M 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-25T05:35:04.665 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-25T05:35:04.666 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 45 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.0.0-1764.gf73f1dfd.el9 ceph 131 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-25T05:35:04.667 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-25T05:35:04.668 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-25T05:35:04.669 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-25T05:35:04.670 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-03-25T05:35:04.671 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-03-25T05:35:04.672 INFO:teuthology.orchestra.run.smithi102.stdout:Install 150 Packages 2024-03-25T05:35:04.672 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 24 Packages 2024-03-25T05:35:04.672 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:35:04.672 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 224 M 2024-03-25T05:35:04.672 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-03-25T05:35:05.015 INFO:teuthology.orchestra.run.smithi187.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 275 kB/s | 248 kB 00:00 2024-03-25T05:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 241 kB/s | 216 kB 00:00 2024-03-25T05:35:05.598 INFO:teuthology.orchestra.run.smithi187.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 60 kB/s | 35 kB 00:00 2024-03-25T05:35:05.659 INFO:teuthology.orchestra.run.smithi102.stdout:(1/174): ceph-19.0.0-1764.gf73f1dfd.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-03-25T05:35:05.884 INFO:teuthology.orchestra.run.smithi102.stdout:(2/174): ceph-fuse-19.0.0-1764.gf73f1dfd.el9.x8 3.9 MB/s | 888 kB 00:00 2024-03-25T05:35:05.952 INFO:teuthology.orchestra.run.smithi102.stdout:(3/174): ceph-immutable-object-cache-19.0.0-176 2.2 MB/s | 145 kB 00:00 2024-03-25T05:35:06.165 INFO:teuthology.orchestra.run.smithi187.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 72 kB/s | 44 kB 00:00 2024-03-25T05:35:06.316 INFO:teuthology.orchestra.run.smithi187.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 131 kB/s | 94 kB 00:00 2024-03-25T05:35:06.327 INFO:teuthology.orchestra.run.smithi102.stdout:(4/174): ceph-base-19.0.0-1764.gf73f1dfd.el9.x8 5.8 MB/s | 5.3 MB 00:00 2024-03-25T05:35:06.332 INFO:teuthology.orchestra.run.smithi187.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-03-25T05:35:06.393 INFO:teuthology.orchestra.run.smithi102.stdout:(5/174): ceph-mds-19.0.0-1764.gf73f1dfd.el9.x86 5.2 MB/s | 2.3 MB 00:00 2024-03-25T05:35:06.433 INFO:teuthology.orchestra.run.smithi187.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-03-25T05:35:06.475 INFO:teuthology.orchestra.run.smithi187.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-03-25T05:35:06.508 INFO:teuthology.orchestra.run.smithi187.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 585 kB/s | 19 kB 00:00 2024-03-25T05:35:06.535 INFO:teuthology.orchestra.run.smithi102.stdout:(6/174): ceph-mgr-19.0.0-1764.gf73f1dfd.el9.x86 7.2 MB/s | 1.5 MB 00:00 2024-03-25T05:35:06.625 INFO:teuthology.orchestra.run.smithi187.stdout:(108/174): libarrow-9.0.0-10.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-03-25T05:35:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 787 kB/s | 26 kB 00:00 2024-03-25T05:35:06.693 INFO:teuthology.orchestra.run.smithi187.stdout:(110/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-03-25T05:35:06.718 INFO:teuthology.orchestra.run.smithi187.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 827 kB/s | 49 kB 00:00 2024-03-25T05:35:06.751 INFO:teuthology.orchestra.run.smithi187.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-03-25T05:35:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:(113/174): libunwind-1.6.2-1.el9.x86_64.rpm 804 kB/s | 67 kB 00:00 2024-03-25T05:35:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 14 MB/s | 838 kB 00:00 2024-03-25T05:35:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-03-25T05:35:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-03-25T05:35:06.975 INFO:teuthology.orchestra.run.smithi187.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 245 kB/s | 32 kB 00:00 2024-03-25T05:35:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 94 kB/s | 15 kB 00:00 2024-03-25T05:35:07.054 INFO:teuthology.orchestra.run.smithi187.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-25T05:35:07.082 INFO:teuthology.orchestra.run.smithi187.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 6.6 MB/s | 358 kB 00:00 2024-03-25T05:35:07.094 INFO:teuthology.orchestra.run.smithi102.stdout:(7/174): ceph-mon-19.0.0-1764.gf73f1dfd.el9.x86 6.7 MB/s | 4.7 MB 00:00 2024-03-25T05:35:07.107 INFO:teuthology.orchestra.run.smithi187.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.6 MB/s | 303 kB 00:00 2024-03-25T05:35:07.132 INFO:teuthology.orchestra.run.smithi187.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 703 kB/s | 35 kB 00:00 2024-03-25T05:35:07.158 INFO:teuthology.orchestra.run.smithi187.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.9 MB/s | 203 kB 00:00 2024-03-25T05:35:07.192 INFO:teuthology.orchestra.run.smithi187.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-03-25T05:35:07.233 INFO:teuthology.orchestra.run.smithi187.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-03-25T05:35:07.250 INFO:teuthology.orchestra.run.smithi187.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-03-25T05:35:07.267 INFO:teuthology.orchestra.run.smithi187.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 529 kB/s | 18 kB 00:00 2024-03-25T05:35:07.293 INFO:teuthology.orchestra.run.smithi187.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 554 kB/s | 23 kB 00:00 2024-03-25T05:35:07.326 INFO:teuthology.orchestra.run.smithi187.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-03-25T05:35:07.351 INFO:teuthology.orchestra.run.smithi187.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-03-25T05:35:07.385 INFO:teuthology.orchestra.run.smithi187.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-03-25T05:35:07.410 INFO:teuthology.orchestra.run.smithi187.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 792 kB/s | 46 kB 00:00 2024-03-25T05:35:07.435 INFO:teuthology.orchestra.run.smithi187.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-03-25T05:35:07.461 INFO:teuthology.orchestra.run.smithi187.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-25T05:35:07.486 INFO:teuthology.orchestra.run.smithi187.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-03-25T05:35:07.511 INFO:teuthology.orchestra.run.smithi187.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-03-25T05:35:07.537 INFO:teuthology.orchestra.run.smithi187.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-03-25T05:35:07.562 INFO:teuthology.orchestra.run.smithi187.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-03-25T05:35:07.587 INFO:teuthology.orchestra.run.smithi187.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-03-25T05:35:07.613 INFO:teuthology.orchestra.run.smithi187.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-03-25T05:35:07.638 INFO:teuthology.orchestra.run.smithi187.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-03-25T05:35:07.663 INFO:teuthology.orchestra.run.smithi187.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-03-25T05:35:07.688 INFO:teuthology.orchestra.run.smithi187.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-03-25T05:35:07.714 INFO:teuthology.orchestra.run.smithi187.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-03-25T05:35:07.739 INFO:teuthology.orchestra.run.smithi187.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-03-25T05:35:07.753 INFO:teuthology.orchestra.run.smithi102.stdout:(8/174): ceph-common-19.0.0-1764.gf73f1dfd.el9. 8.7 MB/s | 20 MB 00:02 2024-03-25T05:35:07.764 INFO:teuthology.orchestra.run.smithi187.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-03-25T05:35:07.789 INFO:teuthology.orchestra.run.smithi187.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-03-25T05:35:07.811 INFO:teuthology.orchestra.run.smithi102.stdout:(9/174): ceph-selinux-19.0.0-1764.gf73f1dfd.el9 440 kB/s | 25 kB 00:00 2024-03-25T05:35:07.823 INFO:teuthology.orchestra.run.smithi187.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-03-25T05:35:07.865 INFO:teuthology.orchestra.run.smithi187.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-03-25T05:35:08.495 INFO:teuthology.orchestra.run.smithi102.stdout:(10/174): ceph-osd-19.0.0-1764.gf73f1dfd.el9.x8 8.6 MB/s | 17 MB 00:01 2024-03-25T05:35:08.645 INFO:teuthology.orchestra.run.smithi102.stdout:(11/174): ceph-radosgw-19.0.0-1764.gf73f1dfd.el 6.3 MB/s | 9.8 MB 00:01 2024-03-25T05:35:08.679 INFO:teuthology.orchestra.run.smithi102.stdout:(12/174): cephfs-mirror-19.0.0-1764.gf73f1dfd.e 1.2 MB/s | 218 kB 00:00 2024-03-25T05:35:08.720 INFO:teuthology.orchestra.run.smithi102.stdout:(13/174): cephfs-shell-19.0.0-1764.gf73f1dfd.el 362 kB/s | 27 kB 00:00 2024-03-25T05:35:08.741 INFO:teuthology.orchestra.run.smithi187.stdout:(150/174): librados2-19.0.0-1764.gf73f1dfd.el9. 3.7 MB/s | 3.4 MB 00:00 2024-03-25T05:35:08.746 INFO:teuthology.orchestra.run.smithi102.stdout:(14/174): libcephfs-devel-19.0.0-1764.gf73f1dfd 472 kB/s | 31 kB 00:00 2024-03-25T05:35:08.783 INFO:teuthology.orchestra.run.smithi187.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-25T05:35:08.821 INFO:teuthology.orchestra.run.smithi102.stdout:(15/174): libcephsqlite-19.0.0-1764.gf73f1dfd.e 2.2 MB/s | 163 kB 00:00 2024-03-25T05:35:08.897 INFO:teuthology.orchestra.run.smithi102.stdout:(16/174): libcephfs2-19.0.0-1764.gf73f1dfd.el9. 4.2 MB/s | 744 kB 00:00 2024-03-25T05:35:08.930 INFO:teuthology.orchestra.run.smithi102.stdout:(17/174): librados-devel-19.0.0-1764.gf73f1dfd. 1.2 MB/s | 127 kB 00:00 2024-03-25T05:35:08.980 INFO:teuthology.orchestra.run.smithi102.stdout:(18/174): libradosstriper1-19.0.0-1764.gf73f1df 5.9 MB/s | 498 kB 00:00 2024-03-25T05:35:09.072 INFO:teuthology.orchestra.run.smithi102.stdout:(19/174): python3-ceph-argparse-19.0.0-1764.gf7 496 kB/s | 45 kB 00:00 2024-03-25T05:35:09.172 INFO:teuthology.orchestra.run.smithi102.stdout:(20/174): python3-ceph-common-19.0.0-1764.gf73f 1.3 MB/s | 131 kB 00:00 2024-03-25T05:35:09.256 INFO:teuthology.orchestra.run.smithi102.stdout:(21/174): python3-cephfs-19.0.0-1764.gf73f1dfd. 1.9 MB/s | 162 kB 00:00 2024-03-25T05:35:09.266 INFO:teuthology.orchestra.run.smithi187.stdout:(152/174): openssl-devel-3.0.7-27.el9.x86_64.rp 718 kB/s | 4.1 MB 00:05 2024-03-25T05:35:09.356 INFO:teuthology.orchestra.run.smithi102.stdout:(22/174): python3-rados-19.0.0-1764.gf73f1dfd.e 3.2 MB/s | 321 kB 00:00 2024-03-25T05:35:09.465 INFO:teuthology.orchestra.run.smithi102.stdout:(23/174): python3-rbd-19.0.0-1764.gf73f1dfd.el9 2.7 MB/s | 298 kB 00:00 2024-03-25T05:35:09.557 INFO:teuthology.orchestra.run.smithi102.stdout:(24/174): python3-rgw-19.0.0-1764.gf73f1dfd.el9 1.1 MB/s | 100 kB 00:00 2024-03-25T05:35:09.649 INFO:teuthology.orchestra.run.smithi102.stdout:(25/174): rbd-fuse-19.0.0-1764.gf73f1dfd.el9.x8 938 kB/s | 85 kB 00:00 2024-03-25T05:35:09.833 INFO:teuthology.orchestra.run.smithi102.stdout:(26/174): librgw2-19.0.0-1764.gf73f1dfd.el9.x86 5.7 MB/s | 5.1 MB 00:00 2024-03-25T05:35:09.925 INFO:teuthology.orchestra.run.smithi102.stdout:(27/174): rbd-nbd-19.0.0-1764.gf73f1dfd.el9.x86 1.8 MB/s | 171 kB 00:00 2024-03-25T05:35:10.017 INFO:teuthology.orchestra.run.smithi102.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1764.g 346 kB/s | 31 kB 00:00 2024-03-25T05:35:10.134 INFO:teuthology.orchestra.run.smithi102.stdout:(29/174): rbd-mirror-19.0.0-1764.gf73f1dfd.el9. 6.4 MB/s | 3.1 MB 00:00 2024-03-25T05:35:10.167 INFO:teuthology.orchestra.run.smithi102.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1764.gf73f1df 924 kB/s | 138 kB 00:00 2024-03-25T05:35:10.468 INFO:teuthology.orchestra.run.smithi102.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1764.gf73f1 5.4 MB/s | 1.8 MB 00:00 2024-03-25T05:35:10.534 INFO:teuthology.orchestra.run.smithi102.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1764.gf7 3.7 MB/s | 248 kB 00:00 2024-03-25T05:35:10.610 INFO:teuthology.orchestra.run.smithi102.stdout:(33/174): ceph-mgr-rook-19.0.0-1764.gf73f1dfd.e 665 kB/s | 49 kB 00:00 2024-03-25T05:35:10.693 INFO:teuthology.orchestra.run.smithi102.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1764.gf 186 kB/s | 15 kB 00:00 2024-03-25T05:35:10.777 INFO:teuthology.orchestra.run.smithi102.stdout:(35/174): ceph-volume-19.0.0-1764.gf73f1dfd.el9 3.1 MB/s | 264 kB 00:00 2024-03-25T05:35:10.935 INFO:teuthology.orchestra.run.smithi102.stdout:(36/174): cephadm-19.0.0-1764.gf73f1dfd.el9.noa 4.6 MB/s | 748 kB 00:00 2024-03-25T05:35:11.011 INFO:teuthology.orchestra.run.smithi102.stdout:(37/174): cephfs-top-19.0.0-1764.gf73f1dfd.el9. 245 kB/s | 18 kB 00:00 2024-03-25T05:35:11.228 INFO:teuthology.orchestra.run.smithi102.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 662 kB 00:00 2024-03-25T05:35:11.295 INFO:teuthology.orchestra.run.smithi102.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-03-25T05:35:11.328 INFO:teuthology.orchestra.run.smithi102.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2024-03-25T05:35:11.478 INFO:teuthology.orchestra.run.smithi102.stdout:(41/174): ceph-mgr-diskprediction-local-19.0.0- 5.6 MB/s | 7.4 MB 00:01 2024-03-25T05:35:11.521 INFO:teuthology.orchestra.run.smithi102.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 1.6 MB/s | 307 kB 00:00 2024-03-25T05:35:11.546 INFO:teuthology.orchestra.run.smithi102.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 495 kB/s | 32 kB 00:00 2024-03-25T05:35:11.646 INFO:teuthology.orchestra.run.smithi102.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-25T05:35:11.671 INFO:teuthology.orchestra.run.smithi102.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 17 kB 00:00 2024-03-25T05:35:11.705 INFO:teuthology.orchestra.run.smithi102.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 312 kB/s | 10 kB 00:00 2024-03-25T05:35:11.730 INFO:teuthology.orchestra.run.smithi102.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-25T05:35:11.755 INFO:teuthology.orchestra.run.smithi102.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 917 kB/s | 44 kB 00:00 2024-03-25T05:35:11.806 INFO:teuthology.orchestra.run.smithi102.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.8 MB/s | 661 kB 00:00 2024-03-25T05:35:11.848 INFO:teuthology.orchestra.run.smithi102.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2024-03-25T05:35:11.874 INFO:teuthology.orchestra.run.smithi187.stdout:(153/174): librbd1-19.0.0-1764.gf73f1dfd.el9.x8 800 kB/s | 3.1 MB 00:04 2024-03-25T05:35:11.881 INFO:teuthology.orchestra.run.smithi102.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 667 kB/s | 46 kB 00:00 2024-03-25T05:35:11.923 INFO:teuthology.orchestra.run.smithi102.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-25T05:35:11.957 INFO:teuthology.orchestra.run.smithi102.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 187 kB 00:00 2024-03-25T05:35:11.990 INFO:teuthology.orchestra.run.smithi102.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-03-25T05:35:12.016 INFO:teuthology.orchestra.run.smithi102.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 607 kB/s | 34 kB 00:00 2024-03-25T05:35:12.141 INFO:teuthology.orchestra.run.smithi102.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-03-25T05:35:12.226 INFO:teuthology.orchestra.run.smithi102.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 7.8 MB/s | 1.5 MB 00:00 2024-03-25T05:35:12.241 INFO:teuthology.orchestra.run.smithi187.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 115 kB/s | 42 kB 00:00 2024-03-25T05:35:12.275 INFO:teuthology.orchestra.run.smithi102.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 6.6 MB/s | 811 kB 00:00 2024-03-25T05:35:12.300 INFO:teuthology.orchestra.run.smithi102.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2024-03-25T05:35:12.459 INFO:teuthology.orchestra.run.smithi102.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2024-03-25T05:35:12.509 INFO:teuthology.orchestra.run.smithi102.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-03-25T05:35:12.534 INFO:teuthology.orchestra.run.smithi102.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-03-25T05:35:12.677 INFO:teuthology.orchestra.run.smithi102.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-03-25T05:35:12.702 INFO:teuthology.orchestra.run.smithi102.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 160 kB/s | 24 kB 00:00 2024-03-25T05:35:12.735 INFO:teuthology.orchestra.run.smithi102.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 563 kB/s | 18 kB 00:00 2024-03-25T05:35:12.760 INFO:teuthology.orchestra.run.smithi102.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-03-25T05:35:12.786 INFO:teuthology.orchestra.run.smithi102.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 651 kB/s | 32 kB 00:00 2024-03-25T05:35:12.911 INFO:teuthology.orchestra.run.smithi102.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-25T05:35:12.945 INFO:teuthology.orchestra.run.smithi102.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-25T05:35:12.995 INFO:teuthology.orchestra.run.smithi102.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.1 MB/s | 174 kB 00:00 2024-03-25T05:35:13.029 INFO:teuthology.orchestra.run.smithi102.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 844 kB/s | 69 kB 00:00 2024-03-25T05:35:13.046 INFO:teuthology.orchestra.run.smithi102.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 41 kB 00:00 2024-03-25T05:35:13.079 INFO:teuthology.orchestra.run.smithi102.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.7 MB/s | 238 kB 00:00 2024-03-25T05:35:13.105 INFO:teuthology.orchestra.run.smithi102.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-25T05:35:13.138 INFO:teuthology.orchestra.run.smithi102.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-25T05:35:13.163 INFO:teuthology.orchestra.run.smithi102.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 846 kB/s | 47 kB 00:00 2024-03-25T05:35:13.189 INFO:teuthology.orchestra.run.smithi102.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 867 kB/s | 43 kB 00:00 2024-03-25T05:35:13.372 INFO:teuthology.orchestra.run.smithi102.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 230 kB/s | 39 kB 00:00 2024-03-25T05:35:13.500 INFO:teuthology.orchestra.run.smithi187.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 197 kB/s | 248 kB 00:01 2024-03-25T05:35:13.648 INFO:teuthology.orchestra.run.smithi102.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-03-25T05:35:13.673 INFO:teuthology.orchestra.run.smithi102.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 137 kB/s | 41 kB 00:00 2024-03-25T05:35:13.707 INFO:teuthology.orchestra.run.smithi102.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2024-03-25T05:35:13.756 INFO:teuthology.orchestra.run.smithi102.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 709 kB/s | 56 kB 00:00 2024-03-25T05:35:13.782 INFO:teuthology.orchestra.run.smithi102.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 63 kB 00:00 2024-03-25T05:35:13.808 INFO:teuthology.orchestra.run.smithi102.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-03-25T05:35:13.841 INFO:teuthology.orchestra.run.smithi102.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-25T05:35:13.875 INFO:teuthology.orchestra.run.smithi102.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-25T05:35:13.925 INFO:teuthology.orchestra.run.smithi102.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-25T05:35:13.951 INFO:teuthology.orchestra.run.smithi102.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-25T05:35:13.976 INFO:teuthology.orchestra.run.smithi102.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-03-25T05:35:14.001 INFO:teuthology.orchestra.run.smithi102.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.8 MB/s | 187 kB 00:00 2024-03-25T05:35:14.016 INFO:teuthology.orchestra.run.smithi187.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 138 kB/s | 71 kB 00:00 2024-03-25T05:35:14.076 INFO:teuthology.orchestra.run.smithi102.stdout:(91/174): jq-1.6-16.el9.x86_64.rpm 1.9 MB/s | 187 kB 00:00 2024-03-25T05:35:14.127 INFO:teuthology.orchestra.run.smithi102.stdout:(92/174): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-03-25T05:35:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-03-25T05:35:14.200 INFO:teuthology.orchestra.run.smithi187.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 199 kB/s | 36 kB 00:00 2024-03-25T05:35:14.219 INFO:teuthology.orchestra.run.smithi102.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-03-25T05:35:14.753 INFO:teuthology.orchestra.run.smithi102.stdout:(95/174): ceph-test-19.0.0-1764.gf73f1dfd.el9.x 6.8 MB/s | 47 MB 00:06 2024-03-25T05:35:14.778 INFO:teuthology.orchestra.run.smithi102.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 36 kB/s | 21 kB 00:00 2024-03-25T05:35:14.803 INFO:teuthology.orchestra.run.smithi102.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-03-25T05:35:14.867 INFO:teuthology.orchestra.run.smithi187.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 288 kB/s | 192 kB 00:00 2024-03-25T05:35:14.903 INFO:teuthology.orchestra.run.smithi102.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-03-25T05:35:14.945 INFO:teuthology.orchestra.run.smithi102.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 5.2 MB/s | 216 kB 00:00 2024-03-25T05:35:14.979 INFO:teuthology.orchestra.run.smithi102.stdout:(100/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.4 MB/s | 248 kB 00:00 2024-03-25T05:35:15.004 INFO:teuthology.orchestra.run.smithi102.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 604 kB/s | 35 kB 00:00 2024-03-25T05:35:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 901 kB/s | 44 kB 00:00 2024-03-25T05:35:15.046 INFO:teuthology.orchestra.run.smithi102.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-03-25T05:35:15.155 INFO:teuthology.orchestra.run.smithi102.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 10 MB/s | 4.1 MB 00:00 2024-03-25T05:35:15.339 INFO:teuthology.orchestra.run.smithi102.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-03-25T05:35:15.372 INFO:teuthology.orchestra.run.smithi102.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-03-25T05:35:15.414 INFO:teuthology.orchestra.run.smithi102.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 474 kB/s | 19 kB 00:00 2024-03-25T05:35:15.515 INFO:teuthology.orchestra.run.smithi102.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-03-25T05:35:15.548 INFO:teuthology.orchestra.run.smithi102.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 796 kB/s | 26 kB 00:00 2024-03-25T05:35:15.581 INFO:teuthology.orchestra.run.smithi102.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-03-25T05:35:15.674 INFO:teuthology.orchestra.run.smithi102.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 740 kB/s | 67 kB 00:00 2024-03-25T05:35:15.751 INFO:teuthology.orchestra.run.smithi187.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 289 kB/s | 256 kB 00:00 2024-03-25T05:35:15.757 INFO:teuthology.orchestra.run.smithi102.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-03-25T05:35:15.884 INFO:teuthology.orchestra.run.smithi187.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 173 kB/s | 23 kB 00:00 2024-03-25T05:35:15.891 INFO:teuthology.orchestra.run.smithi102.stdout:(113/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-03-25T05:35:15.966 INFO:teuthology.orchestra.run.smithi102.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-03-25T05:35:16.008 INFO:teuthology.orchestra.run.smithi102.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-03-25T05:35:16.034 INFO:teuthology.orchestra.run.smithi187.stdout:(161/174): NetworkManager-libnm-1.47.2-1.el9.x8 277 kB/s | 1.8 MB 00:06 2024-03-25T05:35:16.050 INFO:teuthology.orchestra.run.smithi102.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 788 kB/s | 32 kB 00:00 2024-03-25T05:35:16.117 INFO:teuthology.orchestra.run.smithi102.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 227 kB/s | 15 kB 00:00 2024-03-25T05:35:16.176 INFO:teuthology.orchestra.run.smithi102.stdout:(118/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-03-25T05:35:16.218 INFO:teuthology.orchestra.run.smithi102.stdout:(119/174): python3-asyncssh-2.13.2-5.el9.noarch 1.6 MB/s | 548 kB 00:00 2024-03-25T05:35:16.285 INFO:teuthology.orchestra.run.smithi102.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-03-25T05:35:16.327 INFO:teuthology.orchestra.run.smithi102.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 853 kB/s | 35 kB 00:00 2024-03-25T05:35:16.360 INFO:teuthology.orchestra.run.smithi102.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-03-25T05:35:16.394 INFO:teuthology.orchestra.run.smithi102.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-03-25T05:35:16.469 INFO:teuthology.orchestra.run.smithi102.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-25T05:35:16.511 INFO:teuthology.orchestra.run.smithi102.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 261 kB/s | 11 kB 00:00 2024-03-25T05:35:16.517 INFO:teuthology.orchestra.run.smithi187.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 171 kB/s | 108 kB 00:00 2024-03-25T05:35:16.553 INFO:teuthology.orchestra.run.smithi102.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 432 kB/s | 18 kB 00:00 2024-03-25T05:35:16.595 INFO:teuthology.orchestra.run.smithi102.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 567 kB/s | 23 kB 00:00 2024-03-25T05:35:16.637 INFO:teuthology.orchestra.run.smithi102.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 474 kB/s | 19 kB 00:00 2024-03-25T05:35:16.679 INFO:teuthology.orchestra.run.smithi102.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 482 kB/s | 20 kB 00:00 2024-03-25T05:35:16.804 INFO:teuthology.orchestra.run.smithi102.stdout:(130/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-03-25T05:35:16.890 INFO:teuthology.orchestra.run.smithi102.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 560 kB/s | 46 kB 00:00 2024-03-25T05:35:16.918 INFO:teuthology.orchestra.run.smithi187.stdout:(163/174): NetworkManager-1.47.2-1.el9.x86_64.r 290 kB/s | 2.3 MB 00:08 2024-03-25T05:35:16.938 INFO:teuthology.orchestra.run.smithi102.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-03-25T05:35:16.980 INFO:teuthology.orchestra.run.smithi102.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-03-25T05:35:16.985 INFO:teuthology.orchestra.run.smithi187.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 163 kB/s | 155 kB 00:00 2024-03-25T05:35:17.041 INFO:teuthology.orchestra.run.smithi102.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 565 kB/s | 58 kB 00:00 2024-03-25T05:35:17.089 INFO:teuthology.orchestra.run.smithi102.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 352 kB/s | 16 kB 00:00 2024-03-25T05:35:17.123 INFO:teuthology.orchestra.run.smithi102.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-03-25T05:35:17.189 INFO:teuthology.orchestra.run.smithi102.stdout:(137/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.5 MB/s | 2.0 MB 00:00 2024-03-25T05:35:17.193 INFO:teuthology.orchestra.run.smithi187.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 138 kB/s | 29 kB 00:00 2024-03-25T05:35:17.206 INFO:teuthology.orchestra.run.smithi102.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 773 kB/s | 90 kB 00:00 2024-03-25T05:35:17.223 INFO:teuthology.orchestra.run.smithi102.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 283 kB/s | 28 kB 00:00 2024-03-25T05:35:17.240 INFO:teuthology.orchestra.run.smithi102.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 945 kB/s | 31 kB 00:00 2024-03-25T05:35:17.274 INFO:teuthology.orchestra.run.smithi102.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-03-25T05:35:17.294 INFO:teuthology.orchestra.run.smithi187.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 170 kB/s | 64 kB 00:00 2024-03-25T05:35:17.298 INFO:teuthology.orchestra.run.smithi102.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 649 kB/s | 36 kB 00:00 2024-03-25T05:35:17.319 INFO:teuthology.orchestra.run.smithi187.stdout:(167/174): libmount-2.37.4-18.el9.x86_64.rpm 169 kB/s | 136 kB 00:00 2024-03-25T05:35:17.322 INFO:teuthology.orchestra.run.smithi102.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 1.1 MB/s | 51 kB 00:00 2024-03-25T05:35:17.347 INFO:teuthology.orchestra.run.smithi102.stdout:(144/174): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-03-25T05:35:17.372 INFO:teuthology.orchestra.run.smithi102.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-03-25T05:35:17.406 INFO:teuthology.orchestra.run.smithi102.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-03-25T05:35:17.423 INFO:teuthology.orchestra.run.smithi102.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-03-25T05:35:17.482 INFO:teuthology.orchestra.run.smithi102.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-25T05:35:17.541 INFO:teuthology.orchestra.run.smithi102.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-03-25T05:35:17.733 INFO:teuthology.orchestra.run.smithi102.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-03-25T05:35:17.808 INFO:teuthology.orchestra.run.smithi102.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2024-03-25T05:35:17.925 INFO:teuthology.orchestra.run.smithi102.stdout:(152/174): librados2-19.0.0-1764.gf73f1dfd.el9. 7.7 MB/s | 3.4 MB 00:00 2024-03-25T05:35:18.017 INFO:teuthology.orchestra.run.smithi102.stdout:(153/174): librbd1-19.0.0-1764.gf73f1dfd.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-03-25T05:35:18.100 INFO:teuthology.orchestra.run.smithi102.stdout:(154/174): NetworkManager-1.47.2-1.el9.x86_64.r 7.9 MB/s | 2.3 MB 00:00 2024-03-25T05:35:18.125 INFO:teuthology.orchestra.run.smithi102.stdout:(155/174): NetworkManager-team-1.47.2-1.el9.x86 392 kB/s | 42 kB 00:00 2024-03-25T05:35:18.201 INFO:teuthology.orchestra.run.smithi102.stdout:(156/174): NetworkManager-libnm-1.47.2-1.el9.x8 6.7 MB/s | 1.8 MB 00:00 2024-03-25T05:35:18.226 INFO:teuthology.orchestra.run.smithi102.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 717 kB/s | 71 kB 00:00 2024-03-25T05:35:18.260 INFO:teuthology.orchestra.run.smithi102.stdout:(158/174): NetworkManager-tui-1.47.2-1.el9.x86_ 1.5 MB/s | 248 kB 00:00 2024-03-25T05:35:18.285 INFO:teuthology.orchestra.run.smithi102.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 438 kB/s | 36 kB 00:00 2024-03-25T05:35:18.335 INFO:teuthology.orchestra.run.smithi102.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-03-25T05:35:18.360 INFO:teuthology.orchestra.run.smithi102.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 310 kB/s | 23 kB 00:00 2024-03-25T05:35:18.394 INFO:teuthology.orchestra.run.smithi102.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-03-25T05:35:18.444 INFO:teuthology.orchestra.run.smithi102.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-03-25T05:35:18.487 INFO:teuthology.orchestra.run.smithi102.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-03-25T05:35:18.512 INFO:teuthology.orchestra.run.smithi102.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-25T05:35:18.529 INFO:teuthology.orchestra.run.smithi102.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 769 kB/s | 64 kB 00:00 2024-03-25T05:35:18.571 INFO:teuthology.orchestra.run.smithi102.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 346 kB/s | 29 kB 00:00 2024-03-25T05:35:18.788 INFO:teuthology.orchestra.run.smithi102.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 4.4 MB/s | 1.2 MB 00:00 2024-03-25T05:35:18.880 INFO:teuthology.orchestra.run.smithi102.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 6.2 MB/s | 2.2 MB 00:00 2024-03-25T05:35:18.955 INFO:teuthology.orchestra.run.smithi102.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.0 MB/s | 2.3 MB 00:00 2024-03-25T05:35:18.988 INFO:teuthology.orchestra.run.smithi102.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 2.3 MB/s | 465 kB 00:00 2024-03-25T05:35:19.005 INFO:teuthology.orchestra.run.smithi102.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 250 kB/s | 31 kB 00:00 2024-03-25T05:35:19.064 INFO:teuthology.orchestra.run.smithi102.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 74 kB 00:00 2024-03-25T05:35:19.105 INFO:teuthology.orchestra.run.smithi102.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-03-25T05:35:19.114 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-03-25T05:35:19.114 INFO:teuthology.orchestra.run.smithi102.stdout:Total 15 MB/s | 224 MB 00:14 2024-03-25T05:35:19.477 INFO:teuthology.orchestra.run.smithi187.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 543 kB/s | 1.2 MB 00:02 2024-03-25T05:35:20.027 INFO:teuthology.orchestra.run.smithi187.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 846 kB/s | 465 kB 00:00 2024-03-25T05:35:20.094 INFO:teuthology.orchestra.run.smithi187.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 467 kB/s | 31 kB 00:00 2024-03-25T05:35:20.547 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-03-25T05:35:20.924 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-03-25T05:35:20.924 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-03-25T05:35:21.603 INFO:teuthology.orchestra.run.smithi187.stdout:(171/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 512 kB/s | 2.2 MB 00:04 2024-03-25T05:35:21.928 INFO:teuthology.orchestra.run.smithi187.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 507 kB/s | 2.3 MB 00:04 2024-03-25T05:35:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 513 kB/s | 1.1 MB 00:02 2024-03-25T05:35:22.454 INFO:teuthology.orchestra.run.smithi187.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 87 kB/s | 74 kB 00:00 2024-03-25T05:35:22.459 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-03-25T05:35:22.459 INFO:teuthology.orchestra.run.smithi187.stdout:Total 7.8 MB/s | 224 MB 00:28 2024-03-25T05:35:22.927 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-03-25T05:35:23.196 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-03-25T05:35:23.197 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-03-25T05:35:23.272 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-03-25T05:35:23.273 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-03-25T05:35:24.908 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-03-25T05:35:24.908 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-03-25T05:35:30.582 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-03-25T05:35:30.696 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-25T05:35:30.745 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-25T05:35:30.782 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-25T05:35:30.826 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-25T05:35:30.932 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-25T05:35:31.038 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-25T05:35:31.100 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-25T05:35:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-25T05:35:31.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-25T05:35:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-25T05:35:31.740 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 10/198 2024-03-25T05:35:31.800 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-03-25T05:35:31.891 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-25T05:35:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 10/198 2024-03-25T05:35:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-25T05:35:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 11/198 2024-03-25T05:35:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-25T05:35:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-25T05:35:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-25T05:35:32.056 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 11/198 2024-03-25T05:35:32.067 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-25T05:35:32.098 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.0.0-1764.gf73f1dfd.el9.x86_64 12/198 2024-03-25T05:35:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-25T05:35:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-25T05:35:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-25T05:35:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-25T05:35:32.443 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-25T05:35:32.488 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-25T05:35:32.513 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-25T05:35:32.529 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 16/198 2024-03-25T05:35:32.536 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 10/198 2024-03-25T05:35:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 16/198 2024-03-25T05:35:32.666 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 10/198 2024-03-25T05:35:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86 17/198 2024-03-25T05:35:32.704 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 11/198 2024-03-25T05:35:32.752 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86 17/198 2024-03-25T05:35:32.795 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 11/198 2024-03-25T05:35:32.797 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-25T05:35:32.824 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-25T05:35:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:19.0.0-1764.gf73f1dfd.el9.x86_64 12/198 2024-03-25T05:35:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-25T05:35:32.896 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-25T05:35:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-25T05:35:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-25T05:35:33.125 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 16/198 2024-03-25T05:35:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 16/198 2024-03-25T05:35:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86 17/198 2024-03-25T05:35:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86 17/198 2024-03-25T05:35:33.339 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-25T05:35:33.362 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-25T05:35:33.377 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-25T05:35:33.474 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-25T05:35:33.515 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-25T05:35:33.549 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-25T05:35:33.553 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-25T05:35:33.584 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-25T05:35:33.616 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-25T05:35:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-25T05:35:33.810 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-25T05:35:33.860 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-25T05:35:33.870 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-25T05:35:33.940 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-25T05:35:33.988 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-25T05:35:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-25T05:35:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-25T05:35:34.200 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-25T05:35:34.303 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-25T05:35:34.308 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-25T05:35:34.359 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-25T05:35:34.396 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-25T05:35:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-25T05:35:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-25T05:35:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-25T05:35:34.555 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-25T05:35:34.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-25T05:35:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-25T05:35:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-25T05:35:34.711 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-25T05:35:34.748 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-25T05:35:34.791 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-25T05:35:34.824 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-25T05:35:34.852 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-25T05:35:34.869 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-25T05:35:34.921 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-25T05:35:34.949 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:19.0.0-1764.gf73f1dfd.el9. 39/198 2024-03-25T05:35:34.984 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:19.0.0-1764.gf73f1dfd.el 40/198 2024-03-25T05:35:34.990 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-25T05:35:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:19.0.0-1764.gf73f1dfd.el9.x86_6 41/198 2024-03-25T05:35:35.023 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-25T05:35:35.062 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-25T05:35:35.081 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-25T05:35:35.120 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-25T05:35:35.126 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-25T05:35:35.200 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-25T05:35:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-25T05:35:35.290 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-25T05:35:35.332 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-25T05:35:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-25T05:35:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-25T05:35:35.422 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-25T05:35:35.463 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-25T05:35:35.522 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-25T05:35:35.568 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-25T05:35:35.609 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-25T05:35:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-25T05:35:35.746 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.0.0-1764.gf73f1dfd.el9. 39/198 2024-03-25T05:35:35.799 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.0.0-1764.gf73f1dfd.el 40/198 2024-03-25T05:35:35.836 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.0.0-1764.gf73f1dfd.el9.x86_6 41/198 2024-03-25T05:35:35.913 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-25T05:35:35.954 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-25T05:35:35.991 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-25T05:35:36.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-25T05:35:36.075 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-25T05:35:36.115 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-25T05:35:36.136 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-25T05:35:36.143 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-25T05:35:36.176 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-25T05:35:36.225 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-25T05:35:36.262 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_6 53/198 2024-03-25T05:35:36.292 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-25T05:35:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-25T05:35:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-25T05:35:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-25T05:35:36.692 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-25T05:35:36.744 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-25T05:35:36.788 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-25T05:35:36.918 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-25T05:35:36.958 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-25T05:35:37.013 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-25T05:35:37.085 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-25T05:35:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-25T05:35:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-25T05:35:37.384 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-25T05:35:37.404 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-25T05:35:37.491 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-25T05:35:37.549 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-25T05:35:37.568 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-25T05:35:37.573 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-25T05:35:37.603 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-25T05:35:37.613 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-25T05:35:37.646 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-25T05:35:37.681 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-25T05:35:37.688 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-25T05:35:37.731 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_6 53/198 2024-03-25T05:35:37.771 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-25T05:35:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-25T05:35:37.885 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-25T05:35:37.915 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-25T05:35:37.956 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-25T05:35:38.050 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-25T05:35:38.090 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-25T05:35:38.130 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-25T05:35:38.180 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-25T05:35:38.224 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-25T05:35:38.251 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-25T05:35:38.380 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-25T05:35:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-25T05:35:38.488 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-25T05:35:38.519 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-25T05:35:38.530 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-25T05:35:38.575 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-25T05:35:38.578 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-25T05:35:38.634 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-25T05:35:38.776 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-25T05:35:38.817 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-25T05:35:38.832 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-25T05:35:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-25T05:35:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-25T05:35:38.995 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-25T05:35:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-25T05:35:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-25T05:35:39.058 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-25T05:35:39.072 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-25T05:35:39.097 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-25T05:35:39.103 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-25T05:35:39.131 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-25T05:35:39.165 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-25T05:35:39.166 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-25T05:35:39.196 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-25T05:35:39.204 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-25T05:35:39.228 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-25T05:35:39.258 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-25T05:35:39.266 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-25T05:35:39.326 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-25T05:35:39.333 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-25T05:35:39.368 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-25T05:35:39.401 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-25T05:35:39.442 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-25T05:35:39.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-25T05:35:39.513 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-25T05:35:39.561 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-25T05:35:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-25T05:35:39.598 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-25T05:35:39.646 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-25T05:35:39.656 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-25T05:35:39.700 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-25T05:35:39.732 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-25T05:35:39.774 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-25T05:35:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-25T05:35:39.814 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-25T05:35:39.860 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-25T05:35:39.876 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-25T05:35:39.897 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-25T05:35:39.921 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-25T05:35:39.941 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-25T05:35:40.057 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-25T05:35:40.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-25T05:35:40.361 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-25T05:35:40.407 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-25T05:35:40.469 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-25T05:35:40.541 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-25T05:35:40.668 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-25T05:35:40.713 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-25T05:35:40.747 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-25T05:35:40.788 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-25T05:35:40.794 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-25T05:35:40.844 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-25T05:35:40.874 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-25T05:35:40.915 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-25T05:35:41.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-25T05:35:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-25T05:35:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-25T05:35:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-25T05:35:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-25T05:35:41.162 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-25T05:35:41.204 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-25T05:35:41.206 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-25T05:35:41.251 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-25T05:35:41.320 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-25T05:35:41.379 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-25T05:35:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-25T05:35:41.555 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-25T05:35:41.596 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-25T05:35:41.630 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-25T05:35:41.682 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-25T05:35:41.754 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-25T05:35:41.844 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-25T05:35:41.895 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-25T05:35:41.951 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-25T05:35:42.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-25T05:35:42.072 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-25T05:35:42.108 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-25T05:35:42.164 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-25T05:35:42.301 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-25T05:35:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-25T05:35:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-25T05:35:43.254 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-25T05:35:43.285 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-25T05:35:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-25T05:35:43.316 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-25T05:35:43.344 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-25T05:35:43.348 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-25T05:35:43.381 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-25T05:35:43.440 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-25T05:35:43.550 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-25T05:35:43.591 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-25T05:35:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-25T05:35:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 124/198 2024-03-25T05:35:43.771 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 124/198 2024-03-25T05:35:43.803 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 125/198 2024-03-25T05:35:43.825 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-25T05:35:43.831 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-25T05:35:43.854 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-25T05:35:43.945 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-25T05:35:44.287 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-25T05:35:44.318 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 128/198 2024-03-25T05:35:44.389 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 128/198 2024-03-25T05:35:44.411 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 129/198 2024-03-25T05:35:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-25T05:35:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-25T05:35:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-25T05:35:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-25T05:35:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-25T05:35:46.569 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-25T05:35:46.609 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-25T05:35:46.685 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 130/198 2024-03-25T05:35:46.724 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 130/198 2024-03-25T05:35:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-25T05:35:47.015 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 124/198 2024-03-25T05:35:47.160 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 124/198 2024-03-25T05:35:47.189 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 125/198 2024-03-25T05:35:47.244 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-25T05:35:47.263 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 130/198 2024-03-25T05:35:47.302 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 131/198 2024-03-25T05:35:47.392 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 131/198 2024-03-25T05:35:47.392 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-25T05:35:47.392 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-25T05:35:47.392 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:35:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 132/198 2024-03-25T05:35:47.746 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-25T05:35:47.777 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 128/198 2024-03-25T05:35:47.851 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 128/198 2024-03-25T05:35:47.896 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 129/198 2024-03-25T05:35:50.289 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 130/198 2024-03-25T05:35:50.334 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 130/198 2024-03-25T05:35:50.948 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 130/198 2024-03-25T05:35:50.987 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 131/198 2024-03-25T05:35:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 131/198 2024-03-25T05:35:51.121 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-25T05:35:51.121 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-25T05:35:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:35:51.181 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 132/198 2024-03-25T05:35:59.262 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 132/198 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /root 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2024-03-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:35:59.439 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 133/198 2024-03-25T05:35:59.454 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 133/198 2024-03-25T05:35:59.454 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:35:59.454 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-25T05:35:59.454 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:00.935 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 134/198 2024-03-25T05:36:00.961 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 134/198 2024-03-25T05:36:00.961 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:00.961 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-25T05:36:00.961 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T05:36:00.961 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T05:36:00.962 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:01.186 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 135/198 2024-03-25T05:36:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 135/198 2024-03-25T05:36:01.208 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:01.208 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-25T05:36:01.209 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T05:36:01.209 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T05:36:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:01.645 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 136/198 2024-03-25T05:36:01.667 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 136/198 2024-03-25T05:36:01.667 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:01.667 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-25T05:36:01.667 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T05:36:01.667 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T05:36:01.667 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-25T05:36:02.231 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 138/198 2024-03-25T05:36:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 138/198 2024-03-25T05:36:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1764.gf73f1dfd.e 139/198 2024-03-25T05:36:02.354 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1764.gf73f1dfd. 140/198 2024-03-25T05:36:02.384 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noa 141/198 2024-03-25T05:36:02.616 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noa 141/198 2024-03-25T05:36:02.644 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.n 142/198 2024-03-25T05:36:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.n 142/198 2024-03-25T05:36:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73 143/198 2024-03-25T05:36:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73 143/198 2024-03-25T05:36:03.898 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1764.gf73f1dfd.el 144/198 2024-03-25T05:36:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 145/198 2024-03-25T05:36:03.952 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 145/198 2024-03-25T05:36:03.952 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:03.952 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-25T05:36:03.952 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T05:36:03.952 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T05:36:03.952 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 146/198 2024-03-25T05:36:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 146/198 2024-03-25T05:36:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:19.0.0-1764.gf73f1dfd.el9.x86_64 147/198 2024-03-25T05:36:04.246 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 132/198 2024-03-25T05:36:04.246 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-03-25T05:36:04.246 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-03-25T05:36:04.246 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-03-25T05:36:04.246 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-03-25T05:36:04.247 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-03-25T05:36:04.247 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-03-25T05:36:04.247 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-03-25T05:36:04.247 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:04.470 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 133/198 2024-03-25T05:36:04.521 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 133/198 2024-03-25T05:36:04.521 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:04.521 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-25T05:36:04.521 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:04.911 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-25T05:36:04.940 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 149/198 2024-03-25T05:36:04.963 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 149/198 2024-03-25T05:36:04.963 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:04.963 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-25T05:36:04.963 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T05:36:04.963 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T05:36:04.963 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:05.008 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1764.gf73f1 150/198 2024-03-25T05:36:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1764.gf73f1 150/198 2024-03-25T05:36:05.029 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:05.029 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-25T05:36:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 151/198 2024-03-25T05:36:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 151/198 2024-03-25T05:36:05.097 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:05.097 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-25T05:36:05.097 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-25T05:36:05.097 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-25T05:36:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 152/198 2024-03-25T05:36:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 152/198 2024-03-25T05:36:05.423 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:05.423 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-25T05:36:05.423 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T05:36:05.423 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T05:36:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:06.147 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 134/198 2024-03-25T05:36:06.225 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 134/198 2024-03-25T05:36:06.226 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:06.226 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-25T05:36:06.226 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T05:36:06.226 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-25T05:36:06.226 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:06.472 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 135/198 2024-03-25T05:36:06.548 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 135/198 2024-03-25T05:36:06.548 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:06.548 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-25T05:36:06.548 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T05:36:06.548 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-25T05:36:06.548 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:07.023 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 136/198 2024-03-25T05:36:07.107 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 136/198 2024-03-25T05:36:07.107 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:07.107 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-25T05:36:07.107 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T05:36:07.107 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-25T05:36:07.107 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:07.225 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-25T05:36:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 138/198 2024-03-25T05:36:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 138/198 2024-03-25T05:36:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1764.gf73f1dfd.e 139/198 2024-03-25T05:36:08.055 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1764.gf73f1dfd. 140/198 2024-03-25T05:36:08.088 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noa 141/198 2024-03-25T05:36:08.416 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noa 141/198 2024-03-25T05:36:08.447 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.n 142/198 2024-03-25T05:36:09.566 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.n 142/198 2024-03-25T05:36:09.597 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73 143/198 2024-03-25T05:36:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73 143/198 2024-03-25T05:36:09.813 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:19.0.0-1764.gf73f1dfd.el9.x86_64 153/198 2024-03-25T05:36:09.854 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 154/198 2024-03-25T05:36:09.884 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 155/198 2024-03-25T05:36:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1764.gf73f1dfd.el 144/198 2024-03-25T05:36:09.911 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-25T05:36:09.941 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 145/198 2024-03-25T05:36:10.013 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 145/198 2024-03-25T05:36:10.014 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:10.014 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-25T05:36:10.014 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T05:36:10.014 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-25T05:36:10.014 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:10.075 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 146/198 2024-03-25T05:36:10.094 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-shell-2:19.0.0-1764.gf73f1dfd.el9.x86_64 157/198 2024-03-25T05:36:10.114 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 146/198 2024-03-25T05:36:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.0.0-1764.gf73f1dfd.el9.x86_64 147/198 2024-03-25T05:36:10.218 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-25T05:36:10.259 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 159/198 2024-03-25T05:36:10.298 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-25T05:36:10.351 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-25T05:36:10.402 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-25T05:36:10.435 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_ 163/198 2024-03-25T05:36:10.468 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-25T05:36:10.497 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-25T05:36:10.567 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-25T05:36:10.628 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-25T05:36:10.662 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-25T05:36:11.196 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-25T05:36:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 149/198 2024-03-25T05:36:11.267 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-25T05:36:11.299 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 149/198 2024-03-25T05:36:11.299 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:11.299 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-25T05:36:11.299 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T05:36:11.299 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-25T05:36:11.299 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:11.310 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-25T05:36:11.330 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-25T05:36:11.353 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1764.gf73f1 150/198 2024-03-25T05:36:11.441 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1764.gf73f1 150/198 2024-03-25T05:36:11.442 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:11.442 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-25T05:36:11.442 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:11.520 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 151/198 2024-03-25T05:36:11.617 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 151/198 2024-03-25T05:36:11.617 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:11.617 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-25T05:36:11.617 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-25T05:36:11.617 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-25T05:36:11.618 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:11.987 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 152/198 2024-03-25T05:36:12.059 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 152/198 2024-03-25T05:36:12.059 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-25T05:36:12.059 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-25T05:36:12.059 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T05:36:12.059 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-25T05:36:12.059 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:12.152 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:19.0.0-1764.gf73f1dfd.el9.noarch 170/198 2024-03-25T05:36:12.240 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-25T05:36:12.289 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-25T05:36:12.370 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-25T05:36:12.418 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-25T05:36:12.460 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-25T05:36:12.485 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-25T05:36:12.512 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-25T05:36:12.512 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-25T05:36:12.583 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-25T05:36:12.621 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-25T05:36:12.621 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-25T05:36:12.698 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-25T05:36:12.724 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-25T05:36:12.757 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-25T05:36:12.782 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-25T05:36:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-25T05:36:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-25T05:36:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-25T05:36:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-25T05:36:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-25T05:36:12.962 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-25T05:36:12.987 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-25T05:36:13.013 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-25T05:36:13.019 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-25T05:36:13.019 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-25T05:36:13.207 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-25T05:36:13.208 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-25T05:36:13.290 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-25T05:36:13.315 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-25T05:36:13.347 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-25T05:36:13.375 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-25T05:36:13.399 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-25T05:36:13.463 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-25T05:36:16.852 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.0.0-1764.gf73f1dfd.el9.x86_64 153/198 2024-03-25T05:36:16.904 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 154/198 2024-03-25T05:36:16.940 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 155/198 2024-03-25T05:36:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-25T05:36:17.237 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.0.0-1764.gf73f1dfd.el9.x86_64 157/198 2024-03-25T05:36:17.352 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-25T05:36:17.401 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 159/198 2024-03-25T05:36:17.451 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-25T05:36:17.525 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-25T05:36:17.569 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-25T05:36:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_ 163/198 2024-03-25T05:36:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-25T05:36:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-25T05:36:17.776 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-25T05:36:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-25T05:36:17.926 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-25T05:36:18.330 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-25T05:36:18.330 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:19.0.0-1764.gf73f1dfd.el9.x86_64 1/198 2024-03-25T05:36:18.330 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2/198 2024-03-25T05:36:18.330 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 3/198 2024-03-25T05:36:18.330 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 4/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1764.gf73f1 5/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 6/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 7/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 8/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 9/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 10/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 11/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:19.0.0-1764.gf73f1dfd.el9.x86_64 12/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 13/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-shell-2:19.0.0-1764.gf73f1dfd.el9.x86_64 14/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_ 15/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 16/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 17/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_6 18/198 2024-03-25T05:36:18.331 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86 19/198 2024-03-25T05:36:18.332 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 20/198 2024-03-25T05:36:18.332 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1764.gf73f1dfd.el 21/198 2024-03-25T05:36:18.332 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:19.0.0-1764.gf73f1dfd.el9. 22/198 2024-03-25T05:36:18.332 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:19.0.0-1764.gf73f1dfd.el9.x86_6 23/198 2024-03-25T05:36:18.332 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:19.0.0-1764.gf73f1dfd.el9.x86_64 24/198 2024-03-25T05:36:18.332 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 25/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 26/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 27/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 28/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 29/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1764.gf73f1dfd. 30/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noa 31/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.n 32/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73 33/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1764.gf73f1dfd.el 34/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 35/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1764.gf73f1dfd.e 36/198 2024-03-25T05:36:18.346 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 37/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 38/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:19.0.0-1764.gf73f1dfd.el9.noarch 39/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-25T05:36:18.347 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-25T05:36:18.348 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-25T05:36:18.349 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-25T05:36:18.350 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-25T05:36:18.351 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-25T05:36:18.352 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-25T05:36:18.353 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 151/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 153/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-25T05:36:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-25T05:36:18.355 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-25T05:36:18.356 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-25T05:36:18.357 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-25T05:36:18.787 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-25T05:36:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-25T05:36:18.890 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-25T05:36:20.205 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.0.0-1764.gf73f1dfd.el9.noarch 170/198 2024-03-25T05:36:20.297 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-25T05:36:20.344 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-25T05:36:20.459 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-25T05:36:20.490 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-25T05:36:20.523 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-25T05:36:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-25T05:36:20.590 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-25T05:36:20.590 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-25T05:36:20.712 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-25T05:36:20.754 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-25T05:36:20.754 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-25T05:36:20.884 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-25T05:36:20.928 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-25T05:36:20.983 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-25T05:36:21.016 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-25T05:36:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-25T05:36:21.121 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-25T05:36:21.203 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-25T05:36:21.252 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-25T05:36:21.284 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-25T05:36:21.292 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-25T05:36:21.292 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: acl-2.3.1-4.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.293 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.2-8.el9.noarch 2024-03-25T05:36:21.294 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.7.4-5.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-25T05:36:21.296 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.4-9.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-16.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.297 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-25T05:36:21.298 INFO:teuthology.orchestra.run.smithi187.stdout: lua-5.4.4-4.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-13.11-1.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-25T05:36:21.299 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-25T05:36:21.300 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-25T05:36:21.301 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply-3.11-14.el9.noarch 2024-03-25T05:36:21.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-25T05:36:21.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-25T05:36:21.304 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: re2-1:20211101-3.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-25T05:36:21.305 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-25T05:36:21.306 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:21.306 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-03-25T05:36:21.320 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-25T05:36:21.353 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-25T05:36:21.386 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-25T05:36:21.423 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-25T05:36:21.423 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-25T05:36:21.753 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-25T05:36:21.753 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-25T05:36:21.795 DEBUG:teuthology.parallel:result is None 2024-03-25T05:36:21.876 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-25T05:36:21.906 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-25T05:36:21.960 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-25T05:36:21.993 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-25T05:36:22.032 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-25T05:36:22.152 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-25T05:36:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-25T05:36:22.414 INFO:teuthology.orchestra.run.smithi102.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-25T05:36:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:27.373 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.0.0-1764.gf73f1dfd.el9.x86_64 1/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 3/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 4/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1764.gf73f1 5/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 6/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 7/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 8/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 9/198 2024-03-25T05:36:27.374 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 10/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 11/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.0.0-1764.gf73f1dfd.el9.x86_64 12/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 13/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.0.0-1764.gf73f1dfd.el9.x86_64 14/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_ 15/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 16/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 17/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_6 18/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86 19/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 20/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1764.gf73f1dfd.el 21/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.0.0-1764.gf73f1dfd.el9. 22/198 2024-03-25T05:36:27.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.0.0-1764.gf73f1dfd.el9.x86_6 23/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.0.0-1764.gf73f1dfd.el9.x86_64 24/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 25/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 26/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 27/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 28/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 29/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1764.gf73f1dfd. 30/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noa 31/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.n 32/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73 33/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1764.gf73f1dfd.el 34/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 35/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1764.gf73f1dfd.e 36/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 37/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 38/198 2024-03-25T05:36:27.376 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.0.0-1764.gf73f1dfd.el9.noarch 39/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-25T05:36:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-25T05:36:27.378 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-25T05:36:27.378 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-25T05:36:27.378 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-25T05:36:27.378 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-25T05:36:27.378 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-25T05:36:27.378 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-25T05:36:27.379 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-25T05:36:27.380 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-25T05:36:27.381 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-25T05:36:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-25T05:36:27.383 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-25T05:36:27.384 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 151/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-25T05:36:27.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 153/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-25T05:36:27.386 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-25T05:36:27.387 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-25T05:36:27.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-25T05:36:27.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-25T05:36:27.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-25T05:36:27.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-25T05:36:29.819 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-25T05:36:29.819 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-03-25T05:36:29.819 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:29.819 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: acl-2.3.1-4.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-03-25T05:36:29.821 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.0.0-1764.gf73f1dfd.el9.noarch 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-25T05:36:29.823 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: jq-1.6-16.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-25T05:36:29.824 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-25T05:36:29.825 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.11-1.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-25T05:36:29.826 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-25T05:36:29.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-25T05:36:29.828 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-03-25T05:36:29.829 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-25T05:36:29.830 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-25T05:36:29.831 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.0.0-1764.gf73f1dfd.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-3.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-25T05:36:29.832 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:29.833 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-03-25T05:36:30.544 DEBUG:teuthology.parallel:result is None 2024-03-25T05:36:30.544 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f73f1dfd96849300c4322bd7259a3ab37f94c200 2024-03-25T05:36:30.687 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-25T05:36:30.745 INFO:teuthology.orchestra.run.smithi102.stdout:19.0.0-1764.gf73f1dfd.el9 2024-03-25T05:36:30.745 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1764.gf73f1dfd.el9 2024-03-25T05:36:30.745 INFO:teuthology.task.install:The correct ceph version 19.0.0-1764.gf73f1dfd is installed. 2024-03-25T05:36:30.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f73f1dfd96849300c4322bd7259a3ab37f94c200 2024-03-25T05:36:30.992 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-25T05:36:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:19.0.0-1764.gf73f1dfd.el9 2024-03-25T05:36:31.018 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1764.gf73f1dfd.el9 2024-03-25T05:36:31.019 INFO:teuthology.task.install:The correct ceph version 19.0.0-1764.gf73f1dfd is installed. 2024-03-25T05:36:31.021 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-25T05:36:31.021 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:31.021 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-25T05:36:31.105 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:31.105 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-25T05:36:31.138 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-25T05:36:31.139 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:31.139 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-03-25T05:36:31.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-25T05:36:31.330 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:31.330 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-03-25T05:36:31.362 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-25T05:36:31.431 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-25T05:36:31.432 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:31.432 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-25T05:36:31.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-25T05:36:31.621 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:31.621 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-25T05:36:31.652 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-25T05:36:31.724 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-25T05:36:31.724 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:31.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-03-25T05:36:31.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-25T05:36:31.907 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:31.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-03-25T05:36:31.938 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-25T05:36:32.009 INFO:teuthology.run_tasks:Running task ceph... 2024-03-25T05:36:32.092 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-25T05:36:32.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-03-25T05:36:32.097 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2024-03-25T05:36:32.167 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-25T05:36:32.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-25T05:36:32.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-25T05:36:32.235 INFO:tasks.ceph:Creating extra log directories... 2024-03-25T05:36:32.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-25T05:36:32.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-25T05:36:32.308 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-25T05:36:32.308 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-25T05:36:32.308 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-25T05:36:32.309 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:32.309 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-25T05:36:32.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-25T05:36:32.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-25T05:36:32.617 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:32.617 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-25T05:36:32.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-25T05:36:32.761 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-25T05:36:32.797 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-25T05:36:32.797 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-25T05:36:32.797 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035', 'branch': 'squid', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7620035', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '5b534581aae05db8101ae105c576bb56c54e9c12'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 288, 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200', 'sleep_before_teardown': 0, 'subset': '179/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_5b534581aae05db8101ae105c576bb56c54e9c12/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '5b534581aae05db8101ae105c576bb56c54e9c12', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQ1SP74oF+c5wVj+bUO9SS/amN6iBbEmTlPkS95bKPZdnl8lZrkEkIe5FPPUG7iOtcekG5YkjodNJkYFfAbgu0=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFi0pCnzlxdW/rToVAvwGkmc5+ykD7wFD94xMbqIbbyacCEx4x+y0WhN0+zrcCOlGW6kxkAu2QVTzuuCIvoBZo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f73f1dfd96849300c4322bd7259a3ab37f94c200', 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-25T05:36:32.798 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-25T05:36:32.803 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-25T05:36:32.846 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-03-25T05:36:32.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2024-03-25T05:36:32.960 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:32.960 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-03-25T05:36:32.999 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-25T05:36:32.999 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-03-25T05:36:33.083 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-25T05:36:33.083 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:33.084 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-25T05:36:33.084 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:33.084 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:33.084 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-25 05:36:22.870097294 +0000 2024-03-25T05:36:33.084 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-25 05:33:59.927410940 +0000 2024-03-25T05:36:33.084 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-25 05:33:59.927410940 +0000 2024-03-25T05:36:33.084 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-25 05:33:59.927410940 +0000 2024-03-25T05:36:33.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-25T05:36:33.201 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-25T05:36:33.201 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-25T05:36:33.201 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000406886 s, 1.3 MB/s 2024-03-25T05:36:33.205 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-25T05:36:33.248 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-03-25T05:36:33.325 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-25T05:36:33.325 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:33.325 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 650 Links: 1 2024-03-25T05:36:33.326 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:33.326 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:33.326 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-25 05:36:22.871097273 +0000 2024-03-25T05:36:33.326 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-25 05:34:00.500399038 +0000 2024-03-25T05:36:33.326 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-25 05:34:00.501399017 +0000 2024-03-25T05:36:33.326 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-25 05:34:00.500399038 +0000 2024-03-25T05:36:33.326 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-25T05:36:33.443 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-25T05:36:33.443 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-25T05:36:33.443 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000326655 s, 1.6 MB/s 2024-03-25T05:36:33.447 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-25T05:36:33.488 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-03-25T05:36:33.566 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-25T05:36:33.566 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:33.566 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-03-25T05:36:33.566 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:33.566 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:33.566 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-25 05:36:22.871097273 +0000 2024-03-25T05:36:33.567 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-25 05:34:01.061387385 +0000 2024-03-25T05:36:33.567 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-25 05:34:01.061387385 +0000 2024-03-25T05:36:33.567 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-25 05:34:01.061387385 +0000 2024-03-25T05:36:33.567 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-25T05:36:33.672 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-25T05:36:33.672 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-25T05:36:33.672 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000357248 s, 1.4 MB/s 2024-03-25T05:36:33.675 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-25T05:36:33.715 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-03-25T05:36:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-25 05:36:22.872097253 +0000 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-25 05:34:01.642375317 +0000 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-25 05:34:01.642375317 +0000 2024-03-25T05:36:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-25 05:34:01.642375317 +0000 2024-03-25T05:36:33.798 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-25T05:36:33.926 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-25T05:36:33.927 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-25T05:36:33.927 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000268312 s, 1.9 MB/s 2024-03-25T05:36:33.929 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-25T05:36:33.971 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:33.971 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:33.971 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-03-25T05:36:33.989 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-25T05:36:33.989 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-03-25T05:36:34.047 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-25T05:36:34.048 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:34.048 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-03-25T05:36:34.048 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:34.048 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:34.048 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-25 05:36:13.810096430 +0000 2024-03-25T05:36:34.049 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-25 05:32:50.758697041 +0000 2024-03-25T05:36:34.049 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-25 05:32:50.758697041 +0000 2024-03-25T05:36:34.049 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-03-25 05:32:50.758697041 +0000 2024-03-25T05:36:34.049 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-25T05:36:34.117 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-25T05:36:34.117 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-25T05:36:34.117 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000246353 s, 2.1 MB/s 2024-03-25T05:36:34.118 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-25T05:36:34.175 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-03-25T05:36:34.232 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-25T05:36:34.232 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:34.232 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-03-25T05:36:34.233 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:34.233 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:34.233 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-25 05:36:13.810096430 +0000 2024-03-25T05:36:34.233 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-25 05:32:51.114691403 +0000 2024-03-25T05:36:34.233 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-25 05:32:51.114691403 +0000 2024-03-25T05:36:34.233 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-03-25 05:32:51.114691403 +0000 2024-03-25T05:36:34.234 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-25T05:36:34.299 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-25T05:36:34.299 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-25T05:36:34.299 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000280532 s, 1.8 MB/s 2024-03-25T05:36:34.300 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-25T05:36:34.357 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-03-25T05:36:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-25T05:36:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:34.413 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 700 Links: 1 2024-03-25T05:36:34.413 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:34.413 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:34.413 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-25 05:36:13.811096415 +0000 2024-03-25T05:36:34.413 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-25 05:32:51.448686113 +0000 2024-03-25T05:36:34.414 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-25 05:32:51.448686113 +0000 2024-03-25T05:36:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-03-25 05:32:51.448686113 +0000 2024-03-25T05:36:34.414 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-25T05:36:34.479 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-25T05:36:34.479 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-25T05:36:34.479 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000217683 s, 2.4 MB/s 2024-03-25T05:36:34.480 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-25T05:36:34.537 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-03-25T05:36:34.592 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-25T05:36:34.592 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-25T05:36:34.592 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-03-25T05:36:34.592 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:36:34.593 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-03-25T05:36:34.593 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-25 05:36:13.811096415 +0000 2024-03-25T05:36:34.593 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-25 05:32:51.794680633 +0000 2024-03-25T05:36:34.593 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-25 05:32:51.794680633 +0000 2024-03-25T05:36:34.593 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-03-25 05:32:51.794680633 +0000 2024-03-25T05:36:34.593 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-25T05:36:34.658 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-25T05:36:34.658 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-25T05:36:34.658 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000200959 s, 2.5 MB/s 2024-03-25T05:36:34.659 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-25T05:36:34.714 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:34.714 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-25T05:36:34.714 INFO:tasks.ceph:Generating config... 2024-03-25T05:36:34.716 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-25T05:36:34.716 INFO:tasks.ceph:[client] debug client = 20 2024-03-25T05:36:34.716 INFO:tasks.ceph:[client] debug ms = 1 2024-03-25T05:36:34.716 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-25T05:36:34.716 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-25T05:36:34.716 INFO:tasks.ceph:[global] lockdep = True 2024-03-25T05:36:34.716 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-25T05:36:34.716 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-25T05:36:34.716 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-25T05:36:34.716 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-25T05:36:34.716 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-25T05:36:34.717 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-25T05:36:34.717 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-25T05:36:34.717 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-03-25T05:36:34.717 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-25T05:36:34.718 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-25T05:36:34.718 INFO:tasks.ceph:Setting up mon.a... 2024-03-25T05:36:34.719 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-25T05:36:34.854 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2024-03-25T05:36:34.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-25T05:36:34.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-25T05:36:35.065 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2024-03-25T05:36:35.066 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]', 'lockdep': True, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-25T05:36:35.067 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:35.067 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-25T05:36:35.117 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:35.266 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:35.266 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid ad358596-5ce1-459c-a1bc-1e91bde83a5b 2024-03-25T05:36:35.266 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = quincy 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:fsid ad358596-5ce1-459c-a1bc-1e91bde83a5b 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2024-03-25T05:36:35.273597+0000 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-03-25T05:36:35.273597+0000 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 17 (quincy) 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2024-03-25T05:36:35.267 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-25T05:36:35.270 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-25T05:36:35.319 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ad358596-5ce1-459c-a1bc-1e91bde83a5b... 2024-03-25T05:36:35.320 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-25T05:36:35.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.382 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.383 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.384 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.102,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: lockdep = True 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on skipped message = False 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = ad358596-5ce1-459c-a1bc-1e91bde83a5b 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2024-03-25T05:36:35.385 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug trim objects = true 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.386 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore compression mode = aggressive 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2024-03-25T05:36:35.387 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 20 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 20 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 10 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-03-25T05:36:35.388 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-03-25T05:36:35.389 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2024-03-25T05:36:35.390 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2024-03-25T05:36:35.391 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.e] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.f] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2024-03-25T05:36:35.392 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2024-03-25T05:36:35.393 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2024-03-25T05:36:35.393 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2024-03-25T05:36:35.496 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-03-25T05:36:35.496 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-03-25T05:36:35.496 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-25T05:36:35.496 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-03-25T05:36:35.496 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.496 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-25T05:36:35.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-03-25T05:36:35.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.102,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: lockdep = True 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2024-03-25T05:36:35.499 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = ad358596-5ce1-459c-a1bc-1e91bde83a5b 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-03-25T05:36:35.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-03-25T05:36:35.501 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression mode = aggressive 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.502 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-03-25T05:36:35.503 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-03-25T05:36:35.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-03-25T05:36:35.505 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.e] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.f] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-03-25T05:36:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-03-25T05:36:35.507 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-03-25T05:36:35.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-03-25T05:36:35.507 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-03-25T05:36:35.507 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-03-25T05:36:35.539 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-25T05:36:35.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-25T05:36:35.674 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-25T05:36:35.674 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:35.674 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-25T05:36:35.726 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:35.726 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-25T05:36:35.822 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T05:36:35.822 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:35.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-25T05:36:35.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-25T05:36:35.972 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:36:35.972 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:36.067 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T05:36:36.067 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:36.067 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-25T05:36:36.068 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-25T05:36:36.112 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:36:36.112 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:36.169 INFO:tasks.ceph:Setting up mon nodes... 2024-03-25T05:36:36.170 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-25T05:36:36.170 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-25T05:36:36.353 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-25T05:36:36.364 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-25T05:36:36.427 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-25T05:36:36.430 INFO:tasks.ceph:Setting up mds nodes... 2024-03-25T05:36:36.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-25T05:36:36.620 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-25T05:36:36.629 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-25T05:36:36.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-25T05:36:36.902 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-25T05:36:36.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-25T05:36:37.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-03-25T05:36:37.184 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-03-25T05:36:37.193 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-03-25T05:36:37.285 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-25T05:36:37.349 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-25T05:36:37.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-25T05:36:37.380 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-25T05:36:37.477 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-25T05:36:37.479 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-25T05:36:37.505 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-03-25T05:36:37.599 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-03-25T05:36:37.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-03-25T05:36:37.628 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-25T05:36:37.629 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-25T05:36:37.760 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-25T05:36:37.815 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-25T05:36:37.815 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-25T05:36:37.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-25T05:36:37.909 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:37.909 INFO:tasks.ceph:role: osd.0 2024-03-25T05:36:37.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T05:36:37.909 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-25T05:36:38.008 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:38.008 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:38.008 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:38.009 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:38.009 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:38.009 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:38.009 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:38.009 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:38.009 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:38.009 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:38.527 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-03-25T05:36:38.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-03-25T05:36:38.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-25T05:36:38.722 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-25T05:36:38.830 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-25T05:36:38.921 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:38.921 INFO:tasks.ceph:role: osd.1 2024-03-25T05:36:38.921 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T05:36:38.921 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-25T05:36:39.019 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:39.019 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:39.020 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:39.020 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:39.020 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:39.508 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-03-25T05:36:39.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-03-25T05:36:39.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-25T05:36:39.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-25T05:36:39.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-25T05:36:39.855 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:39.855 INFO:tasks.ceph:role: osd.2 2024-03-25T05:36:39.855 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T05:36:39.855 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-25T05:36:39.953 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:39.953 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:39.953 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:39.953 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:39.953 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:39.953 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:39.953 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:39.954 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:39.954 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:39.954 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:40.470 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-03-25T05:36:40.476 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-03-25T05:36:40.476 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-25T05:36:40.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-25T05:36:40.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-25T05:36:40.872 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:40.872 INFO:tasks.ceph:role: osd.3 2024-03-25T05:36:40.873 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T05:36:40.873 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-25T05:36:40.967 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:40.967 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:40.968 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:40.968 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:40.968 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:41.430 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-03-25T05:36:41.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-03-25T05:36:41.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-25T05:36:41.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-25T05:36:41.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:41.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:41.829+0000 7fdea8d71640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-25T05:36:41.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:41.830+0000 7fdea8d71640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-25T05:36:41.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:41.830+0000 7fdea8d71640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-25T05:36:41.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:41.830+0000 7fdea8d71640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-25T05:36:41.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:41.830+0000 7fdea8d71640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-25T05:36:41.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:41.834+0000 7fdea8d71640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-25T05:36:45.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-25T05:36:45.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:45.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:45.231+0000 7f49e7221640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-25T05:36:45.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:45.231+0000 7f49e7221640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-25T05:36:45.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:45.231+0000 7f49e7221640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-25T05:36:45.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:45.231+0000 7f49e7221640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-25T05:36:45.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:45.231+0000 7f49e7221640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-25T05:36:45.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:45.234+0000 7f49e7221640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-25T05:36:48.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-25T05:36:48.260 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:48.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:48.400+0000 7f9dfa824640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-25T05:36:48.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:48.401+0000 7f9dfa824640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-25T05:36:48.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:48.401+0000 7f9dfa824640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-25T05:36:48.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:48.401+0000 7f9dfa824640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-25T05:36:48.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:48.401+0000 7f9dfa824640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-25T05:36:48.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:48.403+0000 7f9dfa824640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-25T05:36:51.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-25T05:36:51.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:51.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:51.572+0000 7feb50c1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-25T05:36:51.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:51.573+0000 7feb50c1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-25T05:36:51.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:51.573+0000 7feb50c1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-25T05:36:51.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:51.573+0000 7feb50c1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-25T05:36:51.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:51.573+0000 7feb50c1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-25T05:36:51.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:36:51.575+0000 7feb50c1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-25T05:36:54.744 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-25T05:36:54.838 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-25T05:36:54.871 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:54.871 INFO:tasks.ceph:role: osd.4 2024-03-25T05:36:54.871 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T05:36:54.871 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-25T05:36:54.948 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:54.948 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:54.948 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:54.948 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:54.948 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:54.948 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:54.949 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:54.949 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:54.949 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:54.949 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:55.468 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-03-25T05:36:55.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-03-25T05:36:55.471 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-25T05:36:55.627 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-25T05:36:55.663 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-25T05:36:55.733 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:55.733 INFO:tasks.ceph:role: osd.5 2024-03-25T05:36:55.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T05:36:55.733 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-25T05:36:55.808 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:55.809 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:55.809 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:55.809 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:55.809 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:56.257 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-03-25T05:36:56.259 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-03-25T05:36:56.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-25T05:36:56.367 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-25T05:36:56.402 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-25T05:36:56.470 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:56.470 INFO:tasks.ceph:role: osd.6 2024-03-25T05:36:56.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T05:36:56.471 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:56.546 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:57.028 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-03-25T05:36:57.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-03-25T05:36:57.031 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-25T05:36:57.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-25T05:36:57.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-25T05:36:57.290 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-25T05:36:57.290 INFO:tasks.ceph:role: osd.7 2024-03-25T05:36:57.290 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T05:36:57.290 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-25T05:36:57.366 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-25T05:36:57.367 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-25T05:36:57.367 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-25T05:36:57.871 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-03-25T05:36:57.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-03-25T05:36:57.874 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-25T05:36:58.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-25T05:36:58.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:36:58.153 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:36:58.159+0000 7feda2b28640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-25T05:36:58.153 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:36:58.159+0000 7feda2b28640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-25T05:36:58.153 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:36:58.159+0000 7feda2b28640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-25T05:36:58.153 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:36:58.159+0000 7feda2b28640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-25T05:36:58.153 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:36:58.159+0000 7feda2b28640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-25T05:36:58.154 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:36:58.159+0000 7feda2b28640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-25T05:37:01.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-25T05:37:01.038 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:37:01.130 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:01.136+0000 7f96b9e11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-25T05:37:01.130 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:01.136+0000 7f96b9e11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-25T05:37:01.131 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:01.136+0000 7f96b9e11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-25T05:37:01.131 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:01.136+0000 7f96b9e11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-25T05:37:01.131 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:01.136+0000 7f96b9e11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-25T05:37:01.131 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:01.137+0000 7f96b9e11640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-25T05:37:02.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:37:02.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:37:03.980 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-25T05:37:04.010 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:04.107+0000 7f4f6ce1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:04.107+0000 7f4f6ce1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:04.107+0000 7f4f6ce1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:04.107+0000 7f4f6ce1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:04.107+0000 7f4f6ce1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:04.108+0000 7f4f6ce1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-25T05:37:06.956 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-25T05:37:06.987 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:37:07.079 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:07.084+0000 7f56d1f26640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-25T05:37:07.079 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:07.084+0000 7f56d1f26640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-25T05:37:07.079 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:07.084+0000 7f56d1f26640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-25T05:37:07.079 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:07.084+0000 7f56d1f26640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-25T05:37:07.079 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:07.084+0000 7f56d1f26640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-25T05:37:07.079 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:07.085+0000 7f56d1f26640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-25T05:37:09.924 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-25T05:37:09.955 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-25T05:37:09.955 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:09.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-25T05:37:10.057 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:10.058 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-25T05:37:10.153 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:10.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-25T05:37:10.244 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:10.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-03-25T05:37:10.338 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:10.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-25T05:37:10.476 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:10.476 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-25T05:37:10.571 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:10.571 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-25T05:37:10.665 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:10.665 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-25T05:37:10.756 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:10.756 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-25T05:37:10.787 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:10.787 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-25T05:37:10.857 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:10.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-25T05:37:10.925 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:10.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-03-25T05:37:10.994 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:10.994 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-25T05:37:11.062 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:11.062 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-25T05:37:11.129 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:11.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-25T05:37:11.195 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:11.196 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-25T05:37:11.262 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:11.262 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-25T05:37:11.317 INFO:tasks.ceph:Adding keys to all mons... 2024-03-25T05:37:11.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-25T05:37:11.324 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-25T05:37:11.348 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBkDQFmPZCAFRAAgRM+MFyyKeJ4W5iNa4XS9Q== 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBkDQFmFt5hJRAAmmYCIrG+L24ZnJYmLw7HzA== 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBkDQFmfrU0NhAAqvnB7GdNfr9DEOs+gvXg1A== 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.e] 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBlDQFmBK5lCxAAotLeL0P/11TMLkeRju2dHg== 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBpDQFmheWHMRAAK1DBzmS3ociQfEN+MUgIYQ== 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBtDQFm6fzdDRAAMMpggo4qur+Kf/4HIZKH1A== 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2024-03-25T05:37:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBwDQFmCiT0FxAA/tnZiK2yTwGEDmXg5f27Dg== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBzDQFmcKsxIhAA5zRyPtEf8lcnJu0uP9onQQ== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBkDQFmmZfjGRAA668ygqeuPE8qPUJMnJ/EHw== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBlDQFmRY9AFRAAbcwVTG56cSH51NBJzZe9EQ== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBlDQFmRJfbHBAAm8to38rk7h6kU4+jraziow== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.f] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBlDQFmYV0uJBAA06t7XCmCa/RcZD0OKL2osA== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB6DQFmr1yJCRAAVlxvhlqraLKAPIRpaIeJBg== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB9DQFmFK8sCBAARo2oEWTOafvfw3bqjGXilA== 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2024-03-25T05:37:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCADQFmC8FvBhAAekX97m+ORMtuzyTW5mzzJA== 2024-03-25T05:37:11.351 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2024-03-25T05:37:11.351 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCDDQFm5ecZBRAAxkkivDgTulod0P32AD37uA== 2024-03-25T05:37:11.351 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2024-03-25T05:37:11.351 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBlDQFmcMu2LRAAJR010rCzFfJhFSHN/QY8HA== 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBkDQFmPZCAFRAAgRM+MFyyKeJ4W5iNa4XS9Q== 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBkDQFmFt5hJRAAmmYCIrG+L24ZnJYmLw7HzA== 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBkDQFmfrU0NhAAqvnB7GdNfr9DEOs+gvXg1A== 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.e] 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBlDQFmBK5lCxAAotLeL0P/11TMLkeRju2dHg== 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBpDQFmheWHMRAAK1DBzmS3ociQfEN+MUgIYQ== 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBtDQFm6fzdDRAAMMpggo4qur+Kf/4HIZKH1A== 2024-03-25T05:37:11.407 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBwDQFmCiT0FxAA/tnZiK2yTwGEDmXg5f27Dg== 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzDQFmcKsxIhAA5zRyPtEf8lcnJu0uP9onQQ== 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBkDQFmmZfjGRAA668ygqeuPE8qPUJMnJ/EHw== 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBlDQFmRY9AFRAAbcwVTG56cSH51NBJzZe9EQ== 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBlDQFmRJfbHBAAm8to38rk7h6kU4+jraziow== 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.f] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBlDQFmYV0uJBAA06t7XCmCa/RcZD0OKL2osA== 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB6DQFmr1yJCRAAVlxvhlqraLKAPIRpaIeJBg== 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-03-25T05:37:11.408 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB9DQFmFK8sCBAARo2oEWTOafvfw3bqjGXilA== 2024-03-25T05:37:11.409 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-03-25T05:37:11.409 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCADQFmC8FvBhAAekX97m+ORMtuzyTW5mzzJA== 2024-03-25T05:37:11.409 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-03-25T05:37:11.409 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCDDQFm5ecZBRAAxkkivDgTulod0P32AD37uA== 2024-03-25T05:37:11.409 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-03-25T05:37:11.409 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBlDQFmcMu2LRAAJR010rCzFfJhFSHN/QY8HA== 2024-03-25T05:37:11.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-25T05:37:11.458 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-25T05:37:11.595 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:11.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:11.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:11.727 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:11.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:11.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:12.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.148 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.155 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.290 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.295 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:12.572 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-25T05:37:12.578 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-25T05:37:12.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:12.725 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:12.862 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:12.869 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:13.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:13.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-25T05:37:13.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.154 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.295 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.572 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.579 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-25T05:37:13.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-25T05:37:13.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-25T05:37:13.855 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-25T05:37:13.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-25T05:37:13.945 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-25T05:37:14.100 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-25T05:37:14.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-25T05:37:14.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-25T05:37:14.296 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-25T05:37:14.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-25T05:37:14.389 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-25T05:37:14.485 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-25T05:37:14.511 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:37:14.519 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-25T05:37:14.567 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-25T05:37:14.567 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-25T05:37:14.567 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-25T05:37:14.572 INFO:tasks.ceph.mon.a:Started 2024-03-25T05:37:14.572 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-25T05:37:14.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-25T05:37:14.608 INFO:tasks.ceph.mon.b:Started 2024-03-25T05:37:14.608 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-25T05:37:14.608 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-25T05:37:14.610 INFO:tasks.ceph.mon.c:Started 2024-03-25T05:37:14.610 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-25T05:37:14.610 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-25T05:37:14.610 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-25T05:37:14.614 INFO:tasks.ceph.mgr.y:Started 2024-03-25T05:37:14.615 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-25T05:37:14.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-25T05:37:14.617 INFO:tasks.ceph.mgr.x:Started 2024-03-25T05:37:14.617 INFO:tasks.ceph:Setting crush tunables to default 2024-03-25T05:37:14.617 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2024-03-25T05:37:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.804+0000 7f62dfa00640 1 Processor -- start 2024-03-25T05:37:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.804+0000 7f62dfa00640 1 -- start start 2024-03-25T05:37:14.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.805+0000 7f62dfa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 0x7f62d8067770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.805+0000 7f62dfa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 0x7f62d815a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dfa00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d815ab50 con 0x7f62d80cc4b0 2024-03-25T05:37:14.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dfa00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d815d520 con 0x7f62d80cc0d0 2024-03-25T05:37:14.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dfa00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d815d800 con 0x7f62d815a1e0 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dd000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 0x7f62d8067770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dda00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 0x7f62d815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62d7e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f62d80cc4b0 0x7f62d80cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60948/0 (socket says 172.21.15.102:60948) 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62d7e00640 1 -- 172.21.15.102:0/2987890434 learned_addr learned my addr 172.21.15.102:0/2987890434 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dda00640 1 -- 172.21.15.102:0/2987890434 >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 msgr2=0x7f62d815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dda00640 1 -- 172.21.15.102:0/2987890434 >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 msgr2=0x7f62d815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dda00640 1 --2- 172.21.15.102:0/2987890434 >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 0x7f62d815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dd000640 1 -- 172.21.15.102:0/2987890434 >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 msgr2=0x7f62d8067770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dd000640 1 -- 172.21.15.102:0/2987890434 >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 msgr2=0x7f62d8067770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dd000640 1 --2- 172.21.15.102:0/2987890434 >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 0x7f62d8067770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dda00640 1 --2- 172.21.15.102:0/2987890434 >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 0x7f62d815a610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-25T05:37:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.806+0000 7f62dd000640 1 --2- 172.21.15.102:0/2987890434 >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 0x7f62d8067770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-25T05:37:14.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.809+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808539226 0 0) 0x7f62d815ab50 con 0x7f62d80cc4b0 2024-03-25T05:37:14.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c0003520 con 0x7f62d80cc4b0 2024-03-25T05:37:14.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142775507 0 0) 0x7f62c0003520 con 0x7f62d80cc4b0 2024-03-25T05:37:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 msgr2=0x7f62d815a610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 --2- 172.21.15.102:0/2987890434 >> v2:172.21.15.187:3300/0 conn(0x7f62d815a1e0 0x7f62d815a610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 msgr2=0x7f62d8067770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 --2- 172.21.15.102:0/2987890434 >> v2:172.21.15.102:3300/0 conn(0x7f62d80cc0d0 0x7f62d8067770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d815dae0 con 0x7f62d80cc4b0 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f62c4001670 con 0x7f62d80cc4b0 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 >> v1:172.21.15.102:6789/0 conn(0x7f62d80cc4b0 legacy=0x7f62d80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62c00047c0 0x7f62c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62c0005180 0x7f62c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d815d520 con 0x7f62c00047c0 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d815d800 con 0x7f62c0005180 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c000c0d0 con 0x7f62c00039c0 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62dd000640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62dda00640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62c0005180 0x7f62c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.810+0000 7f62d7e00640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62c00047c0 0x7f62c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62dd000640 1 -- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62c0005180 msgr2=0x7f62c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62dd000640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62c0005180 0x7f62c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62dd000640 1 -- 172.21.15.102:0/2987890434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62c00047c0 msgr2=0x7f62c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62dd000640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62c00047c0 0x7f62c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62dd000640 1 -- 172.21.15.102:0/2987890434 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0003520 con 0x7f62c00039c0 2024-03-25T05:37:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62d7e00640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62c00047c0 0x7f62c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62dda00640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62c0005180 0x7f62c000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.811+0000 7f62dda00640 1 -- 172.21.15.102:0/2987890434 reap_dead start 2024-03-25T05:37:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.812+0000 7f62dd000640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62c0003de0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00ba10 tx=0x7f62c00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be62700567dec82 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.812+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc033680 con 0x7f62c00039c0 2024-03-25T05:37:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.812+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc0337e0 con 0x7f62c00039c0 2024-03-25T05:37:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.812+0000 7f62d7400640 1 -- 172.21.15.102:0/2987890434 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc033b90 con 0x7f62c00039c0 2024-03-25T05:37:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.813+0000 7f62dfa00640 1 -- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 msgr2=0x7f62c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.813+0000 7f62dfa00640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62c0003de0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00ba10 tx=0x7f62c00057f0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.813+0000 7f62dfa00640 1 -- 172.21.15.102:0/2987890434 shutdown_connections 2024-03-25T05:37:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.813+0000 7f62dfa00640 1 --2- 172.21.15.102:0/2987890434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62c0003de0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.813+0000 7f62dfa00640 1 -- 172.21.15.102:0/2987890434 >> 172.21.15.102:0/2987890434 conn(0x7f62d80726e0 msgr2=0x7f62d8072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.813+0000 7f62dfa00640 1 -- 172.21.15.102:0/2987890434 shutdown_connections 2024-03-25T05:37:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.813+0000 7f62dfa00640 1 -- 172.21.15.102:0/2987890434 wait complete. 2024-03-25T05:37:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.815+0000 7f62dfa00640 1 Processor -- start 2024-03-25T05:37:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.815+0000 7f62dfa00640 1 -- start start 2024-03-25T05:37:14.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dfa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62d815c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dfa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d80c93b0 0x7f62d81594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dfa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d81f2da0 0x7f62d81f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dfa00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d8155c10 con 0x7f62d81f2da0 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dfa00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d8155300 con 0x7f62d80c93b0 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dfa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d81f3760 con 0x7f62c00039c0 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d80c93b0 0x7f62d81594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dd000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62d815c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62dda00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d81f2da0 0x7f62d81f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d80c93b0 0x7f62d81594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:46878/0 (socket says 172.21.15.102:46878) 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.816+0000 7f62d7e00640 1 -- 172.21.15.102:0/1095161773 learned_addr learned my addr 172.21.15.102:0/1095161773 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.817+0000 7f62d7e00640 1 -- 172.21.15.102:0/1095161773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 msgr2=0x7f62d815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.817+0000 7f62d7e00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62d815c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.817+0000 7f62d7e00640 1 -- 172.21.15.102:0/1095161773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d81f2da0 msgr2=0x7f62d81f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.817+0000 7f62d7e00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d81f2da0 0x7f62d81f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.817+0000 7f62d7e00640 1 -- 172.21.15.102:0/1095161773 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d815cda0 con 0x7f62d80c93b0 2024-03-25T05:37:14.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.817+0000 7f62dda00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d81f2da0 0x7f62d81f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:14.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.817+0000 7f62d7e00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d80c93b0 0x7f62d81594d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e7e0 tx=0x7f62c400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:14.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.819+0000 7f62d4c00640 1 -- 172.21.15.102:0/1095161773 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c400c8d0 con 0x7f62d80c93b0 2024-03-25T05:37:14.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.819+0000 7f62d4c00640 1 -- 172.21.15.102:0/1095161773 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c400ca30 con 0x7f62d80c93b0 2024-03-25T05:37:14.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.819+0000 7f62d4c00640 1 -- 172.21.15.102:0/1095161773 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c400cde0 con 0x7f62d80c93b0 2024-03-25T05:37:14.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.819+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d815d080 con 0x7f62d80c93b0 2024-03-25T05:37:14.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.819+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d8155830 con 0x7f62d80c93b0 2024-03-25T05:37:14.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.820+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d8155d50 con 0x7f62d80c93b0 2024-03-25T05:37:14.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.824+0000 7f62d4c00640 1 -- 172.21.15.102:0/1095161773 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f62c401d460 con 0x7f62d80c93b0 2024-03-25T05:37:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.824+0000 7f62d4c00640 1 -- 172.21.15.102:0/1095161773 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f62c40277c0 con 0x7f62d80c93b0 2024-03-25T05:37:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.827+0000 7f62d4c00640 1 -- 172.21.15.102:0/1095161773 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f62d8155d50 con 0x7f62d80c93b0 2024-03-25T05:37:14.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.899+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f62d80686c0 con 0x7f62d80c93b0 2024-03-25T05:37:14.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.905+0000 7f62d4c00640 1 -- 172.21.15.102:0/1095161773 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f62c402b090 con 0x7f62d80c93b0 2024-03-25T05:37:14.898 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d80c93b0 msgr2=0x7f62d81594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d80c93b0 0x7f62d81594d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e7e0 tx=0x7f62c400eca0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 shutdown_connections 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d81f2da0 0x7f62d81f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d80c93b0 0x7f62d81594d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 --2- 172.21.15.102:0/1095161773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62c00039c0 0x7f62d815c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 >> 172.21.15.102:0/1095161773 conn(0x7f62d80726e0 msgr2=0x7f62d80cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 shutdown_connections 2024-03-25T05:37:14.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:14.906+0000 7f62dfa00640 1 -- 172.21.15.102:0/1095161773 wait complete. 2024-03-25T05:37:14.916 INFO:tasks.ceph:check_enable_crimson: False 2024-03-25T05:37:14.916 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-25T05:37:14.916 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:14.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-25T05:37:14.987 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:14.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-25T05:37:15.114 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:15.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-25T05:37:15.241 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:15.242 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-25T05:37:15.267 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:15.273+0000 7fc1cf3f1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-25T05:37:15.319 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:15.326+0000 7fc1cf3f1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-25T05:37:15.322 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:15.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-25T05:37:15.349 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:15.349 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-25T05:37:15.384 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:15.391+0000 7fdea8a50040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-25T05:37:15.415 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:15.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-25T05:37:15.446 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:15.453+0000 7fdea8a50040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-25T05:37:15.483 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-25T05:37:15.483 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-25T05:37:15.550 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 9d812d4c-72b6-4d38-83b2-64a9ea9fde23 0 2024-03-25T05:37:15.701 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.707+0000 7f3cc9e47640 1 Processor -- start 2024-03-25T05:37:15.701 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.707+0000 7f3cc9e47640 1 -- start start 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc9e47640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3cc4150e20 0x7f3cc40c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc9e47640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc40c51b0 con 0x7f3cc4072550 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc9e47640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc4151200 con 0x7f3cc4157440 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc9e47640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc4159fc0 con 0x7f3cc4150e20 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc37fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3cc4150e20 0x7f3cc40c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc37fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3cc4150e20 0x7f3cc40c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46630/0 (socket says 172.21.15.187:46630) 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc37fe640 1 -- 172.21.15.187:0/19436117 learned_addr learned my addr 172.21.15.187:0/19436117 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc37fe640 1 -- 172.21.15.187:0/19436117 >> v1:172.21.15.187:6789/0 conn(0x7f3cc4157440 legacy=0x7f3cc41612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc37fe640 1 -- 172.21.15.187:0/19436117 >> v1:172.21.15.102:6789/0 conn(0x7f3cc4072550 legacy=0x7f3cc4156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:15.702 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.708+0000 7f3cc37fe640 1 -- 172.21.15.187:0/19436117 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc415a280 con 0x7f3cc4150e20 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.709+0000 7f3cc37fe640 1 --2- 172.21.15.187:0/19436117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4150e20 0x7f3cc40c8e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4151390 tx=0x7f3cb402e1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b7abe4e40e4789 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.709+0000 7f3cc27fc640 1 -- 172.21.15.187:0/19436117 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4036440 con 0x7f3cc4150e20 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.709+0000 7f3cc27fc640 1 -- 172.21.15.187:0/19436117 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb40365a0 con 0x7f3cc4150e20 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.709+0000 7f3cc27fc640 1 -- 172.21.15.187:0/19436117 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4036930 con 0x7f3cc4150e20 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.710+0000 7f3cc9e47640 1 -- 172.21.15.187:0/19436117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4150e20 msgr2=0x7f3cc40c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.710+0000 7f3cc9e47640 1 --2- 172.21.15.187:0/19436117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4150e20 0x7f3cc40c8e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4151390 tx=0x7f3cb402e1f0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.710+0000 7f3cc9e47640 1 -- 172.21.15.187:0/19436117 shutdown_connections 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.710+0000 7f3cc9e47640 1 --2- 172.21.15.187:0/19436117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4150e20 0x7f3cc40c8e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.710+0000 7f3cc9e47640 1 -- 172.21.15.187:0/19436117 >> 172.21.15.187:0/19436117 conn(0x7f3cc40674f0 msgr2=0x7f3cc406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.710+0000 7f3cc9e47640 1 -- 172.21.15.187:0/19436117 shutdown_connections 2024-03-25T05:37:15.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.710+0000 7f3cc9e47640 1 -- 172.21.15.187:0/19436117 wait complete. 2024-03-25T05:37:15.705 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.711+0000 7f3cc9e47640 1 Processor -- start 2024-03-25T05:37:15.705 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.711+0000 7f3cc9e47640 1 -- start start 2024-03-25T05:37:15.707 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc9e47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cc4072550 0x7f3cc40cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.707 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc9e47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cc4150e20 0x7f3cc41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.707 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc9e47640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4157440 0x7f3cc4154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.707 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc9e47640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4156490 con 0x7f3cc4072550 2024-03-25T05:37:15.707 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc9e47640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc41ef090 con 0x7f3cc4157440 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc9e47640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc414e830 con 0x7f3cc4150e20 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cc4150e20 0x7f3cc41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc3fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4157440 0x7f3cc4154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cc4150e20 0x7f3cc41548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51686/0 (socket says 172.21.15.187:51686) 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc3fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4157440 0x7f3cc4154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46644/0 (socket says 172.21.15.187:46644) 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 -- 172.21.15.187:0/3634401423 learned_addr learned my addr 172.21.15.187:0/3634401423 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc37fe640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cc4072550 0x7f3cc40cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 -- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4157440 msgr2=0x7f3cc4154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4157440 0x7f3cc4154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 -- 172.21.15.187:0/3634401423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cc4072550 msgr2=0x7f3cc40cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cc4072550 0x7f3cc40cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.708 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 -- 172.21.15.187:0/3634401423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb400b770 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc37fe640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cc4072550 0x7f3cc40cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc3fff640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4157440 0x7f3cc4154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.712+0000 7f3cc2ffd640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cc4150e20 0x7f3cc41548c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00b410 tx=0x7f3cac00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.713+0000 7f3cbbfff640 1 -- 172.21.15.187:0/3634401423 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac011830 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.713+0000 7f3cbbfff640 1 -- 172.21.15.187:0/3634401423 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac011990 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.713+0000 7f3cbbfff640 1 -- 172.21.15.187:0/3634401423 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac011d40 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.713+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc41566c0 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.713+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc41ee760 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.713+0000 7f3cbbfff640 1 -- 172.21.15.187:0/3634401423 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3cac01a790 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.713+0000 7f3cbbfff640 1 -- 172.21.15.187:0/3634401423 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3cac019c00 con 0x7f3cc4150e20 2024-03-25T05:37:15.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.714+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc40686c0 con 0x7f3cc4150e20 2024-03-25T05:37:15.710 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.716+0000 7f3cbbfff640 1 -- 172.21.15.187:0/3634401423 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3cac039dd0 con 0x7f3cc4150e20 2024-03-25T05:37:15.780 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.787+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9d812d4c-72b6-4d38-83b2-64a9ea9fde23", "id": 0} v 0) v1 -- 0x7f3cc4073070 con 0x7f3cc4150e20 2024-03-25T05:37:15.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.791+0000 7f3cbbfff640 1 -- 172.21.15.187:0/3634401423 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d812d4c-72b6-4d38-83b2-64a9ea9fde23", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3cac028070 con 0x7f3cc4150e20 2024-03-25T05:37:15.785 INFO:teuthology.orchestra.run.smithi187.stdout:0 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cc4150e20 msgr2=0x7f3cc41548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cc4150e20 0x7f3cc41548c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00b410 tx=0x7f3cac00b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 shutdown_connections 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cc4157440 0x7f3cc4154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cc4150e20 0x7f3cc41548c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 --2- 172.21.15.187:0/3634401423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cc4072550 0x7f3cc40cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 >> 172.21.15.187:0/3634401423 conn(0x7f3cc40674f0 msgr2=0x7f3cc414ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 shutdown_connections 2024-03-25T05:37:15.787 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.792+0000 7f3cc9e47640 1 -- 172.21.15.187:0/3634401423 wait complete. 2024-03-25T05:37:15.797 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 7aa4e6f1-e102-45e2-929c-243fa8bd31c0 1 2024-03-25T05:37:15.866 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:15.872+0000 7fc1cf3f1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-25T05:37:15.896 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.902+0000 7f0bbcc2a640 1 Processor -- start 2024-03-25T05:37:15.896 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.902+0000 7f0bbcc2a640 1 -- start start 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bbcc2a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0bb8154100 0x7f0bb80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bbcc2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb80b0ce0 0x7f0bb815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bbcc2a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80b12b0 con 0x7f0bb80c9cb0 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bbcc2a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb80cb3a0 con 0x7f0bb8154100 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bbcc2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80caa00 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bb6d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb80b0ce0 0x7f0bb815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bb5d9b640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0bb80c9cb0 0x7f0bb806ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:52026/0 (socket says 172.21.15.187:52026) 2024-03-25T05:37:15.898 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.903+0000 7f0bb5d9b640 1 -- 172.21.15.187:0/861512031 learned_addr learned my addr 172.21.15.187:0/861512031 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-25T05:37:15.899 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.904+0000 7f0bb559a640 1 -- 172.21.15.187:0/861512031 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506775689 0 0) 0x7f0bb80b12b0 con 0x7f0bb80c9cb0 2024-03-25T05:37:15.899 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.904+0000 7f0bb559a640 1 -- 172.21.15.187:0/861512031 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba0003520 con 0x7f0bb80c9cb0 2024-03-25T05:37:15.899 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.904+0000 7f0bb6d9d640 1 -- 172.21.15.187:0/861512031 >> v2:172.21.15.102:3300/0 conn(0x7f0bb8154100 msgr2=0x7f0bb80cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:15.899 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.904+0000 7f0bb6d9d640 1 --2- 172.21.15.187:0/861512031 >> v2:172.21.15.102:3300/0 conn(0x7f0bb8154100 0x7f0bb80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.899 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.904+0000 7f0bb6d9d640 1 -- 172.21.15.187:0/861512031 >> v1:172.21.15.187:6789/0 conn(0x7f0bb80c9cb0 legacy=0x7f0bb806ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.899 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.904+0000 7f0bb6d9d640 1 -- 172.21.15.187:0/861512031 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80cace0 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.900 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.905+0000 7f0bb6d9d640 1 --2- 172.21.15.187:0/861512031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb80b0ce0 0x7f0bb815a290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009d90 tx=0x7f0bb002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c1deebc71d1d67b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:15.900 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.905+0000 7f0bb559a640 1 -- 172.21.15.187:0/861512031 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb002cc50 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.900 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.905+0000 7f0bb559a640 1 -- 172.21.15.187:0/861512031 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb002cdb0 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.900 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.905+0000 7f0bb559a640 1 -- 172.21.15.187:0/861512031 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0034660 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.900 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/861512031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb80b0ce0 msgr2=0x7f0bb815a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.901 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 --2- 172.21.15.187:0/861512031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb80b0ce0 0x7f0bb815a290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009d90 tx=0x7f0bb002bea0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.901 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/861512031 shutdown_connections 2024-03-25T05:37:15.901 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 --2- 172.21.15.187:0/861512031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb80b0ce0 0x7f0bb815a290 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.901 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 --2- 172.21.15.187:0/861512031 >> v2:172.21.15.102:3300/0 conn(0x7f0bb8154100 0x7f0bb80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.901 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/861512031 >> 172.21.15.187:0/861512031 conn(0x7f0bb80ccae0 msgr2=0x7f0bb80c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:15.901 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/861512031 shutdown_connections 2024-03-25T05:37:15.901 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.906+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/861512031 wait complete. 2024-03-25T05:37:15.903 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.907+0000 7f0bbcc2a640 1 Processor -- start 2024-03-25T05:37:15.903 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.907+0000 7f0bbcc2a640 1 -- start start 2024-03-25T05:37:15.903 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb80b0ce0 0x7f0bb80afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.903 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bb80c9cb0 0x7f0bb80b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb8154100 0x7f0bb81f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80af740 con 0x7f0bb80c9cb0 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb814cee0 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb814c620 con 0x7f0bb8154100 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb80b0ce0 0x7f0bb80afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb6d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb8154100 0x7f0bb81f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb80b0ce0 0x7f0bb80afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46654/0 (socket says 172.21.15.187:46654) 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 -- 172.21.15.187:0/483227898 learned_addr learned my addr 172.21.15.187:0/483227898 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb6d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb8154100 0x7f0bb81f2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51712/0 (socket says 172.21.15.187:51712) 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 -- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb8154100 msgr2=0x7f0bb81f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb8154100 0x7f0bb81f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 -- 172.21.15.187:0/483227898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bb80c9cb0 msgr2=0x7f0bb80b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bb80c9cb0 0x7f0bb80b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 -- 172.21.15.187:0/483227898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0009a70 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.904 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb6d9d640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb8154100 0x7f0bb81f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bb659c640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb80b0ce0 0x7f0bb80afb60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00b410 tx=0x7f0bac00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0ba6ffd640 1 -- 172.21.15.187:0/483227898 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac011830 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0ba6ffd640 1 -- 172.21.15.187:0/483227898 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac0119b0 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb814c900 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0ba6ffd640 1 -- 172.21.15.187:0/483227898 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac011d60 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.908+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb814ad70 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.909+0000 7f0ba6ffd640 1 -- 172.21.15.187:0/483227898 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0bac01a790 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.909+0000 7f0ba6ffd640 1 -- 172.21.15.187:0/483227898 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0bac019b20 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.909+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb80686c0 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.905 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.911+0000 7f0ba6ffd640 1 -- 172.21.15.187:0/483227898 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0bac039dd0 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.923 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:15.930+0000 7fc1cf3f1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-25T05:37:15.970 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:15.976+0000 7fc1cf3f1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-25T05:37:15.978 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.984+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7aa4e6f1-e102-45e2-929c-243fa8bd31c0", "id": 1} v 0) v1 -- 0x7f0bb80b08b0 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.984 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.990+0000 7f0ba6ffd640 1 -- 172.21.15.187:0/483227898 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7aa4e6f1-e102-45e2-929c-243fa8bd31c0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0bac028070 con 0x7f0bb80b0ce0 2024-03-25T05:37:15.984 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-03-25T05:37:15.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb80b0ce0 msgr2=0x7f0bb80afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:15.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb80b0ce0 0x7f0bb80afb60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00b410 tx=0x7f0bac00b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 shutdown_connections 2024-03-25T05:37:15.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bb8154100 0x7f0bb81f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bb80c9cb0 0x7f0bb80b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 --2- 172.21.15.187:0/483227898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb80b0ce0 0x7f0bb80afb60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:15.986 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 >> 172.21.15.187:0/483227898 conn(0x7f0bb80ccae0 msgr2=0x7f0bb8072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:15.986 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 shutdown_connections 2024-03-25T05:37:15.986 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:15.991+0000 7f0bbcc2a640 1 -- 172.21.15.187:0/483227898 wait complete. 2024-03-25T05:37:15.996 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new fd1b2f24-36d9-41b4-b194-154cd280b76d 2 2024-03-25T05:37:16.028 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.035+0000 7fc1cf3f1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-25T05:37:16.047 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.054+0000 7fdea8a50040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-25T05:37:16.073 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.079+0000 7fc1cf3f1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-25T05:37:16.097 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.103+0000 7f270f15e640 1 Processor -- start 2024-03-25T05:37:16.097 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.103+0000 7f270f15e640 1 -- start start 2024-03-25T05:37:16.098 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270f15e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2708150e20 0x7f27080c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.098 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270f15e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27080c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.098 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270f15e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2708073290 0x7f2708156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.098 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270f15e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080c51b0 con 0x7f2708073290 2024-03-25T05:37:16.098 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270f15e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2708151200 con 0x7f2708150e20 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270f15e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708159fc0 con 0x7f2708072550 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f2707fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27080c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270cefa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2708150e20 0x7f27080c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270cefa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2708150e20 0x7f27080c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46664/0 (socket says 172.21.15.187:46664) 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f2707fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27080c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51718/0 (socket says 172.21.15.187:51718) 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270cefa640 1 -- 172.21.15.187:0/2519202032 learned_addr learned my addr 172.21.15.187:0/2519202032 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f2707fff640 1 -- 172.21.15.187:0/2519202032 >> v2:172.21.15.187:3300/0 conn(0x7f2708150e20 msgr2=0x7f27080c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f2707fff640 1 --2- 172.21.15.187:0/2519202032 >> v2:172.21.15.187:3300/0 conn(0x7f2708150e20 0x7f27080c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f2707fff640 1 -- 172.21.15.187:0/2519202032 >> v2:172.21.15.102:3300/0 conn(0x7f2708073290 msgr2=0x7f2708156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f2707fff640 1 --2- 172.21.15.187:0/2519202032 >> v2:172.21.15.102:3300/0 conn(0x7f2708073290 0x7f2708156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f2707fff640 1 -- 172.21.15.187:0/2519202032 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270815a280 con 0x7f2708072550 2024-03-25T05:37:16.099 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.104+0000 7f270cefa640 1 --2- 172.21.15.187:0/2519202032 >> v2:172.21.15.187:3300/0 conn(0x7f2708150e20 0x7f27080c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.105+0000 7f2707fff640 1 --2- 172.21.15.187:0/2519202032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27080c93b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26f40097a0 tx=0x7f26f402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa6c784164e81a71 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.105+0000 7f27077fe640 1 -- 172.21.15.187:0/2519202032 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4031830 con 0x7f2708072550 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.105+0000 7f27077fe640 1 -- 172.21.15.187:0/2519202032 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f4031990 con 0x7f2708072550 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.105+0000 7f27077fe640 1 -- 172.21.15.187:0/2519202032 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4031d20 con 0x7f2708072550 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 -- 172.21.15.187:0/2519202032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 msgr2=0x7f27080c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 --2- 172.21.15.187:0/2519202032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27080c93b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26f40097a0 tx=0x7f26f402b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 -- 172.21.15.187:0/2519202032 shutdown_connections 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 --2- 172.21.15.187:0/2519202032 >> v2:172.21.15.102:3300/0 conn(0x7f2708073290 0x7f2708156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 --2- 172.21.15.187:0/2519202032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27080c93b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 --2- 172.21.15.187:0/2519202032 >> v2:172.21.15.187:3300/0 conn(0x7f2708150e20 0x7f27080c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 -- 172.21.15.187:0/2519202032 >> 172.21.15.187:0/2519202032 conn(0x7f27080674f0 msgr2=0x7f270806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 -- 172.21.15.187:0/2519202032 shutdown_connections 2024-03-25T05:37:16.101 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.106+0000 7f270f15e640 1 -- 172.21.15.187:0/2519202032 wait complete. 2024-03-25T05:37:16.102 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.107+0000 7f270f15e640 1 Processor -- start 2024-03-25T05:37:16.102 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.107+0000 7f270f15e640 1 -- start start 2024-03-25T05:37:16.103 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27081f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2708073290 0x7f270813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2708150e20 0x7f2708144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081504e0 con 0x7f2708073290 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708148c80 con 0x7f2708150e20 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270813f140 con 0x7f2708072550 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27081f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27081f12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51720/0 (socket says 172.21.15.187:51720) 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 -- 172.21.15.187:0/1663237156 learned_addr learned my addr 172.21.15.187:0/1663237156 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270d6fb640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2708150e20 0x7f2708144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 -- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2708150e20 msgr2=0x7f2708144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2708150e20 0x7f2708144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 -- 172.21.15.187:0/1663237156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2708073290 msgr2=0x7f270813ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2708073290 0x7f270813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.104 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 -- 172.21.15.187:0/1663237156 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc0094d0 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270cefa640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27081f12a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00e9e0 tx=0x7f26fc00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f27057fa640 1 -- 172.21.15.187:0/1663237156 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00c9d0 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f27057fa640 1 -- 172.21.15.187:0/1663237156 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00cb30 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f4009400 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f27057fa640 1 -- 172.21.15.187:0/1663237156 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00cea0 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.108+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270814f880 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.109+0000 7f27057fa640 1 -- 172.21.15.187:0/1663237156 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f26fc005990 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.109+0000 7f27057fa640 1 -- 172.21.15.187:0/1663237156 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f26fc013890 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.109+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270814f5f0 con 0x7f2708072550 2024-03-25T05:37:16.105 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.111+0000 7f27057fa640 1 -- 172.21.15.187:0/1663237156 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f26fc021060 con 0x7f2708072550 2024-03-25T05:37:16.112 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.118+0000 7fdea8a50040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-25T05:37:16.162 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.169+0000 7fdea8a50040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-25T05:37:16.177 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.183+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd1b2f24-36d9-41b4-b194-154cd280b76d", "id": 2} v 0) v1 -- 0x7f27080686c0 con 0x7f2708072550 2024-03-25T05:37:16.184 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.190+0000 7f27057fa640 1 -- 172.21.15.187:0/1663237156 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd1b2f24-36d9-41b4-b194-154cd280b76d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26fc017070 con 0x7f2708072550 2024-03-25T05:37:16.184 INFO:teuthology.orchestra.run.smithi187.stdout:2 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 msgr2=0x7f27081f12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27081f12a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00e9e0 tx=0x7f26fc00eea0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 shutdown_connections 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2708150e20 0x7f2708144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2708073290 0x7f270813ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 --2- 172.21.15.187:0/1663237156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2708072550 0x7f27081f12a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 >> 172.21.15.187:0/1663237156 conn(0x7f27080674f0 msgr2=0x7f270806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 shutdown_connections 2024-03-25T05:37:16.185 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.191+0000 7f270f15e640 1 -- 172.21.15.187:0/1663237156 wait complete. 2024-03-25T05:37:16.195 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 33b1cd6a-7fe6-4fd6-b015-ca6cd5491236 3 2024-03-25T05:37:16.195 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.201+0000 7fc1cf3f1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-25T05:37:16.225 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.232+0000 7fdea8a50040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-25T05:37:16.269 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.276+0000 7fc1cf3f1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-25T05:37:16.274 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.281+0000 7fdea8a50040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-25T05:37:16.295 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.301+0000 7f578f165640 1 Processor -- start 2024-03-25T05:37:16.295 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.301+0000 7f578f165640 1 -- start start 2024-03-25T05:37:16.296 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f578f165640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f57880c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.296 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f578f165640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57880ca940 con 0x7f57880c2920 2024-03-25T05:37:16.296 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f578f165640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578815e010 con 0x7f57880c2d00 2024-03-25T05:37:16.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f578f165640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57880cabe0 con 0x7f57880cb9a0 2024-03-25T05:37:16.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f5787fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f57880c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f5787fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f57880c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51734/0 (socket says 172.21.15.187:51734) 2024-03-25T05:37:16.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f5787fff640 1 -- 172.21.15.187:0/3468185779 learned_addr learned my addr 172.21.15.187:0/3468185779 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.302+0000 7f5787fff640 1 -- 172.21.15.187:0/3468185779 >> v1:172.21.15.187:6789/0 conn(0x7f57880c2d00 legacy=0x7f578815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.303+0000 7f5787fff640 1 -- 172.21.15.187:0/3468185779 >> v1:172.21.15.102:6789/0 conn(0x7f57880c2920 legacy=0x7f57880c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.303+0000 7f5787fff640 1 -- 172.21.15.187:0/3468185779 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57880caec0 con 0x7f57880cb9a0 2024-03-25T05:37:16.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.303+0000 7f5787fff640 1 --2- 172.21.15.187:0/3468185779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f57880c9bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57740098a0 tx=0x7f577402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4899ec59c09bbf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.303+0000 7f57877fe640 1 -- 172.21.15.187:0/3468185779 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774030840 con 0x7f57880cb9a0 2024-03-25T05:37:16.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.303+0000 7f57877fe640 1 -- 172.21.15.187:0/3468185779 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57740309a0 con 0x7f57880cb9a0 2024-03-25T05:37:16.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.303+0000 7f57877fe640 1 -- 172.21.15.187:0/3468185779 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774030d30 con 0x7f57880cb9a0 2024-03-25T05:37:16.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.304+0000 7f578f165640 1 -- 172.21.15.187:0/3468185779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 msgr2=0x7f57880c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.299 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.304+0000 7f578f165640 1 --2- 172.21.15.187:0/3468185779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f57880c9bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57740098a0 tx=0x7f577402b980 comp rx=0 tx=0).stop 2024-03-25T05:37:16.299 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.304+0000 7f578f165640 1 -- 172.21.15.187:0/3468185779 shutdown_connections 2024-03-25T05:37:16.299 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.304+0000 7f578f165640 1 --2- 172.21.15.187:0/3468185779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f57880c9bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.299 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.304+0000 7f578f165640 1 -- 172.21.15.187:0/3468185779 >> 172.21.15.187:0/3468185779 conn(0x7f578806d940 msgr2=0x7f578806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.299 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.304+0000 7f578f165640 1 -- 172.21.15.187:0/3468185779 shutdown_connections 2024-03-25T05:37:16.299 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.304+0000 7f578f165640 1 -- 172.21.15.187:0/3468185779 wait complete. 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.305+0000 7f578f165640 1 Processor -- start 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.305+0000 7f578f165640 1 -- start start 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578f165640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880c2920 0x7f57881f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578f165640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57880c2d00 0x7f57881534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578f165640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f578814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578f165640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578814fff0 con 0x7f57880c2920 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578f165640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57881e6ed0 con 0x7f57880c2d00 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578f165640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57881e37c0 con 0x7f57880cb9a0 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578d702640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f578814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f5787fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57880c2d00 0x7f57881534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f5787fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57880c2d00 0x7f57881534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46688/0 (socket says 172.21.15.187:46688) 2024-03-25T05:37:16.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578d702640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f578814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51736/0 (socket says 172.21.15.187:51736) 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f5787fff640 1 -- 172.21.15.187:0/1517651051 learned_addr learned my addr 172.21.15.187:0/1517651051 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578d702640 1 -- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57880c2d00 msgr2=0x7f57881534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578d702640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57880c2d00 0x7f57881534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578d702640 1 -- 172.21.15.187:0/1517651051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880c2920 msgr2=0x7f57881f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578d702640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880c2920 0x7f57881f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f578d702640 1 -- 172.21.15.187:0/1517651051 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740094d0 con 0x7f57880cb9a0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.306+0000 7f5787fff640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57880c2d00 0x7f57881534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f578d702640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f578814f580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f578000c700 tx=0x7f578000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f57857fa640 1 -- 172.21.15.187:0/1517651051 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780003b70 con 0x7f57880cb9a0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f57857fa640 1 -- 172.21.15.187:0/1517651051 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780003cd0 con 0x7f57880cb9a0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57881e3520 con 0x7f57880cb9a0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f57857fa640 1 -- 172.21.15.187:0/1517651051 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780005310 con 0x7f57880cb9a0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5788150e60 con 0x7f57880cb9a0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f57857fa640 1 -- 172.21.15.187:0/1517651051 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5780005470 con 0x7f57880cb9a0 2024-03-25T05:37:16.302 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.307+0000 7f57857fa640 1 -- 172.21.15.187:0/1517651051 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f57800128b0 con 0x7f57880cb9a0 2024-03-25T05:37:16.303 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.308+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57880686c0 con 0x7f57880cb9a0 2024-03-25T05:37:16.303 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.310+0000 7f57857fa640 1 -- 172.21.15.187:0/1517651051 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5780003e40 con 0x7f57880cb9a0 2024-03-25T05:37:16.319 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.325+0000 7fc1cf3f1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-25T05:37:16.373 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.379+0000 7fc1cf3f1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-25T05:37:16.378 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.383+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "33b1cd6a-7fe6-4fd6-b015-ca6cd5491236", "id": 3} v 0) v1 -- 0x7f57880c6c20 con 0x7f57880cb9a0 2024-03-25T05:37:16.382 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.389+0000 7f57857fa640 1 -- 172.21.15.187:0/1517651051 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33b1cd6a-7fe6-4fd6-b015-ca6cd5491236", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5780012420 con 0x7f57880cb9a0 2024-03-25T05:37:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:3 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 msgr2=0x7f578814f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f578814f580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f578000c700 tx=0x7f578000cbc0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 shutdown_connections 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57880cb9a0 0x7f578814f580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57880c2d00 0x7f57881534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 --2- 172.21.15.187:0/1517651051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880c2920 0x7f57881f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 >> 172.21.15.187:0/1517651051 conn(0x7f578806d940 msgr2=0x7f57880c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 shutdown_connections 2024-03-25T05:37:16.384 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.390+0000 7f578f165640 1 -- 172.21.15.187:0/1517651051 wait complete. 2024-03-25T05:37:16.394 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new d0980d5a-8623-4729-86c5-c0a944b35fd4 4 2024-03-25T05:37:16.405 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.411+0000 7fdea8a50040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-25T05:37:16.426 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.432+0000 7fc1cf3f1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-25T05:37:16.484 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.489+0000 7fdea8a50040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-25T05:37:16.495 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.501+0000 7f65a30a7640 1 Processor -- start 2024-03-25T05:37:16.495 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.501+0000 7f65a30a7640 1 -- start start 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a30a7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c0c9580 0x7f659c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a30a7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f659c072550 0x7f659c157270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a30a7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c0c51b0 con 0x7f659c150e20 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a30a7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c151200 con 0x7f659c072550 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a30a7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c159fc0 con 0x7f659c0c9580 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a1644640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f659c072550 0x7f659c157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f659bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c0c9580 0x7f659c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a1644640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f659c072550 0x7f659c157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46692/0 (socket says 172.21.15.187:46692) 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f659bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c0c9580 0x7f659c156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51750/0 (socket says 172.21.15.187:51750) 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a1644640 1 -- 172.21.15.187:0/1314850224 learned_addr learned my addr 172.21.15.187:0/1314850224 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a0e43640 1 --1- 172.21.15.187:0/1314850224 >> v1:172.21.15.187:6789/0 conn(0x7f659c150e20 0x7f659c0c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:52046/0 (socket says 172.21.15.187:52046) 2024-03-25T05:37:16.497 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f659bfff640 1 -- 172.21.15.187:0/1314850224 >> v2:172.21.15.187:3300/0 conn(0x7f659c072550 msgr2=0x7f659c157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f659bfff640 1 --2- 172.21.15.187:0/1314850224 >> v2:172.21.15.187:3300/0 conn(0x7f659c072550 0x7f659c157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f659bfff640 1 -- 172.21.15.187:0/1314850224 >> v1:172.21.15.187:6789/0 conn(0x7f659c150e20 legacy=0x7f659c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f659bfff640 1 -- 172.21.15.187:0/1314850224 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c15a280 con 0x7f659c0c9580 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.502+0000 7f65a1644640 1 --2- 172.21.15.187:0/1314850224 >> v2:172.21.15.187:3300/0 conn(0x7f659c072550 0x7f659c157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.503+0000 7f659bfff640 1 --2- 172.21.15.187:0/1314850224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c0c9580 0x7f659c156d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65880097a0 tx=0x7f658802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6185b9739e8f622a server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.503+0000 7f659b7fe640 1 -- 172.21.15.187:0/1314850224 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588030800 con 0x7f659c0c9580 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.503+0000 7f659b7fe640 1 -- 172.21.15.187:0/1314850224 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588030960 con 0x7f659c0c9580 2024-03-25T05:37:16.498 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.503+0000 7f659b7fe640 1 -- 172.21.15.187:0/1314850224 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588030cf0 con 0x7f659c0c9580 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.503+0000 7f65a30a7640 1 -- 172.21.15.187:0/1314850224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c0c9580 msgr2=0x7f659c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.503+0000 7f65a30a7640 1 --2- 172.21.15.187:0/1314850224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c0c9580 0x7f659c156d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65880097a0 tx=0x7f658802b940 comp rx=0 tx=0).stop 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.504+0000 7f65a30a7640 1 -- 172.21.15.187:0/1314850224 shutdown_connections 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.504+0000 7f65a30a7640 1 --2- 172.21.15.187:0/1314850224 >> v2:172.21.15.187:3300/0 conn(0x7f659c072550 0x7f659c157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.504+0000 7f65a30a7640 1 --2- 172.21.15.187:0/1314850224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c0c9580 0x7f659c156d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.504+0000 7f65a30a7640 1 -- 172.21.15.187:0/1314850224 >> 172.21.15.187:0/1314850224 conn(0x7f659c0674f0 msgr2=0x7f659c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.504+0000 7f65a30a7640 1 -- 172.21.15.187:0/1314850224 shutdown_connections 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.504+0000 7f65a30a7640 1 -- 172.21.15.187:0/1314850224 wait complete. 2024-03-25T05:37:16.501 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 Processor -- start 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 -- start start 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f659c072550 0x7f659c14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c150e20 0x7f659c0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f659c156760 0x7f659c0cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c158b10 con 0x7f659c072550 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c159740 con 0x7f659c156760 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.505+0000 7f65a30a7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c159a20 con 0x7f659c150e20 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f659bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c150e20 0x7f659c0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f659c156760 0x7f659c0cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f659c156760 0x7f659c0cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46696/0 (socket says 172.21.15.187:46696) 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f659bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c150e20 0x7f659c0cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51762/0 (socket says 172.21.15.187:51762) 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 -- 172.21.15.187:0/3979180190 learned_addr learned my addr 172.21.15.187:0/3979180190 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.502 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 -- 172.21.15.187:0/3979180190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c150e20 msgr2=0x7f659c0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 --2- 172.21.15.187:0/3979180190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c150e20 0x7f659c0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 -- 172.21.15.187:0/3979180190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f659c072550 msgr2=0x7f659c14b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 --2- 172.21.15.187:0/3979180190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f659c072550 0x7f659c14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 -- 172.21.15.187:0/3979180190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659400bd40 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a1644640 1 --2- 172.21.15.187:0/3979180190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f659c156760 0x7f659c0cb910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f659400e370 tx=0x7f659400e830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65997fa640 1 -- 172.21.15.187:0/3979180190 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594018070 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65997fa640 1 -- 172.21.15.187:0/3979180190 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594009380 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65997fa640 1 -- 172.21.15.187:0/3979180190 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594010040 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6588009400 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c1587a0 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65997fa640 1 -- 172.21.15.187:0/3979180190 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6594003990 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.506+0000 7f65997fa640 1 -- 172.21.15.187:0/3979180190 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6594009b10 con 0x7f659c156760 2024-03-25T05:37:16.503 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.507+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c0686c0 con 0x7f659c156760 2024-03-25T05:37:16.504 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.509+0000 7f65997fa640 1 -- 172.21.15.187:0/3979180190 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6594004840 con 0x7f659c156760 2024-03-25T05:37:16.537 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.543+0000 7fdea8a50040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-25T05:37:16.575 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.582+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0980d5a-8623-4729-86c5-c0a944b35fd4", "id": 4} v 0) v1 -- 0x7f659c06b0c0 con 0x7f659c156760 2024-03-25T05:37:16.582 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.588+0000 7f65997fa640 1 -- 172.21.15.187:0/3979180190 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0980d5a-8623-4729-86c5-c0a944b35fd4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f659402c0b0 con 0x7f659c156760 2024-03-25T05:37:16.582 INFO:teuthology.orchestra.run.smithi187.stdout:4 2024-03-25T05:37:16.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f659c156760 msgr2=0x7f659c0cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 --2- 172.21.15.187:0/3979180190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f659c156760 0x7f659c0cb910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f659400e370 tx=0x7f659400e830 comp rx=0 tx=0).stop 2024-03-25T05:37:16.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 shutdown_connections 2024-03-25T05:37:16.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 --2- 172.21.15.187:0/3979180190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f659c156760 0x7f659c0cb910 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 --2- 172.21.15.187:0/3979180190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f659c150e20 0x7f659c0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 --2- 172.21.15.187:0/3979180190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f659c072550 0x7f659c14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 >> 172.21.15.187:0/3979180190 conn(0x7f659c0674f0 msgr2=0x7f659c0cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 shutdown_connections 2024-03-25T05:37:16.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.589+0000 7f65a30a7640 1 -- 172.21.15.187:0/3979180190 wait complete. 2024-03-25T05:37:16.593 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 8c46e5a1-a5ed-4d53-803b-19f482b077b5 5 2024-03-25T05:37:16.598 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.604+0000 7fdea8a50040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-25T05:37:16.652 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:16.658+0000 7fdea8a50040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-25T05:37:16.733 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.739+0000 7fd2b5aa4640 1 Processor -- start 2024-03-25T05:37:16.733 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2b5aa4640 1 -- start start 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2b5aa4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0150f70 0x7fd2b00c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2b5aa4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2b0073340 0x7fd2b006fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2b5aa4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b00c8610 con 0x7fd2b0070220 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2b5aa4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00c5780 con 0x7fd2b0073340 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2b5aa4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00c88b0 con 0x7fd2b0150f70 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0150f70 0x7fd2b00c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0150f70 0x7fd2b00c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51768/0 (socket says 172.21.15.187:51768) 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.740+0000 7fd2af7fe640 1 -- 172.21.15.187:0/719509932 learned_addr learned my addr 172.21.15.187:0/719509932 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.741+0000 7fd2af7fe640 1 -- 172.21.15.187:0/719509932 >> v2:172.21.15.102:3300/0 conn(0x7fd2b0073340 msgr2=0x7fd2b006fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.741+0000 7fd2af7fe640 1 --2- 172.21.15.187:0/719509932 >> v2:172.21.15.102:3300/0 conn(0x7fd2b0073340 0x7fd2b006fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.741+0000 7fd2af7fe640 1 -- 172.21.15.187:0/719509932 >> v1:172.21.15.102:6789/0 conn(0x7fd2b0070220 legacy=0x7fd2b00c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.735 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.741+0000 7fd2af7fe640 1 -- 172.21.15.187:0/719509932 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00c8b90 con 0x7fd2b0150f70 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.741+0000 7fd2af7fe640 1 --2- 172.21.15.187:0/719509932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0150f70 0x7fd2b00c79c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009870 tx=0x7fd2a002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7359eee3dd3f7879 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2ae7fc640 1 -- 172.21.15.187:0/719509932 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0030840 con 0x7fd2b0150f70 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2ae7fc640 1 -- 172.21.15.187:0/719509932 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00309a0 con 0x7fd2b0150f70 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2ae7fc640 1 -- 172.21.15.187:0/719509932 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0030d30 con 0x7fd2b0150f70 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/719509932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0150f70 msgr2=0x7fd2b00c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 --2- 172.21.15.187:0/719509932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0150f70 0x7fd2b00c79c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009870 tx=0x7fd2a002b980 comp rx=0 tx=0).stop 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/719509932 shutdown_connections 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 --2- 172.21.15.187:0/719509932 >> v2:172.21.15.102:3300/0 conn(0x7fd2b0073340 0x7fd2b006fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 --2- 172.21.15.187:0/719509932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0150f70 0x7fd2b00c79c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/719509932 >> 172.21.15.187:0/719509932 conn(0x7fd2b00cc4c0 msgr2=0x7fd2b00cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/719509932 shutdown_connections 2024-03-25T05:37:16.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.742+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/719509932 wait complete. 2024-03-25T05:37:16.738 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.743+0000 7fd2b5aa4640 1 Processor -- start 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.743+0000 7fd2b5aa4640 1 -- start start 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2b5aa4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0070220 0x7fd2b01f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2b5aa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2b0073340 0x7fd2b014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2b5aa4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2b0150f70 0x7fd2b0158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2b5aa4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b006cdb0 con 0x7fd2b0073340 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2b5aa4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00caad0 con 0x7fd2b0150f70 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2b5aa4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00cbc20 con 0x7fd2b0070220 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0070220 0x7fd2b01f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0070220 0x7fd2b01f1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51774/0 (socket says 172.21.15.187:51774) 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2af7fe640 1 -- 172.21.15.187:0/651796534 learned_addr learned my addr 172.21.15.187:0/651796534 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.740 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2affff640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2b0150f70 0x7fd2b0158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2aeffd640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2b0073340 0x7fd2b014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2af7fe640 1 -- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2b0150f70 msgr2=0x7fd2b0158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2af7fe640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2b0150f70 0x7fd2b0158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2af7fe640 1 -- 172.21.15.187:0/651796534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2b0073340 msgr2=0x7fd2b014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.744+0000 7fd2af7fe640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2b0073340 0x7fd2b014d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd2af7fe640 1 -- 172.21.15.187:0/651796534 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00094d0 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd2af7fe640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0070220 0x7fd2b01f1fc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0000c00 tx=0x7fd2a0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd297fff640 1 -- 172.21.15.187:0/651796534 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0039d90 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd297fff640 1 -- 172.21.15.187:0/651796534 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a0043410 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b01f1b30 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd297fff640 1 -- 172.21.15.187:0/651796534 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00437c0 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b00ca510 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd297fff640 1 -- 172.21.15.187:0/651796534 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd2a0043920 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.745+0000 7fd297fff640 1 -- 172.21.15.187:0/651796534 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd2a004c930 con 0x7fd2b0070220 2024-03-25T05:37:16.741 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.746+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b00c3430 con 0x7fd2b0070220 2024-03-25T05:37:16.742 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.748+0000 7fd297fff640 1 -- 172.21.15.187:0/651796534 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd2a0048070 con 0x7fd2b0070220 2024-03-25T05:37:16.813 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.819+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8c46e5a1-a5ed-4d53-803b-19f482b077b5", "id": 5} v 0) v1 -- 0x7fd2b00686c0 con 0x7fd2b0070220 2024-03-25T05:37:16.819 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.826+0000 7fd297fff640 1 -- 172.21.15.187:0/651796534 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c46e5a1-a5ed-4d53-803b-19f482b077b5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd2a0034070 con 0x7fd2b0070220 2024-03-25T05:37:16.820 INFO:teuthology.orchestra.run.smithi187.stdout:5 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0070220 msgr2=0x7fd2b01f1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0070220 0x7fd2b01f1fc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0000c00 tx=0x7fd2a0004730 comp rx=0 tx=0).stop 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 shutdown_connections 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2b0150f70 0x7fd2b0158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2b0073340 0x7fd2b014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 --2- 172.21.15.187:0/651796534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2b0070220 0x7fd2b01f1fc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 >> 172.21.15.187:0/651796534 conn(0x7fd2b00cc4c0 msgr2=0x7fd2b014fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 shutdown_connections 2024-03-25T05:37:16.821 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.827+0000 7fd2b5aa4640 1 -- 172.21.15.187:0/651796534 wait complete. 2024-03-25T05:37:16.824 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.830+0000 7fc1cf3f1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-25T05:37:16.831 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd 6 2024-03-25T05:37:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46f2102640 1 Processor -- start 2024-03-25T05:37:16.931 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46f2102640 1 -- start start 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46f2102640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f46ec150e20 0x7f46ec0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46f2102640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec0c51b0 con 0x7f46ec072550 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46f2102640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec151200 con 0x7f46ec157440 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46f2102640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec159fc0 con 0x7f46ec150e20 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46ebfff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f46ec157440 0x7f46ec1612f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:52060/0 (socket says 172.21.15.187:52060) 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.937+0000 7f46ebfff640 1 -- 172.21.15.187:0/850966242 learned_addr learned my addr 172.21.15.187:0/850966242 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741254999 0 0) 0x7f46ec151200 con 0x7f46ec157440 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d4003520 con 0x7f46ec157440 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eb7fe640 1 --2- 172.21.15.187:0/850966242 >> v2:172.21.15.102:3300/0 conn(0x7f46ec150e20 0x7f46ec0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047941165 0 0) 0x7f46d4003520 con 0x7f46ec157440 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 >> v2:172.21.15.102:3300/0 conn(0x7f46ec150e20 msgr2=0x7f46ec0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 --2- 172.21.15.187:0/850966242 >> v2:172.21.15.102:3300/0 conn(0x7f46ec150e20 0x7f46ec0c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 >> v1:172.21.15.102:6789/0 conn(0x7f46ec072550 legacy=0x7f46ec156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec15a280 con 0x7f46ec157440 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f46e40019f0 con 0x7f46ec157440 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 >> v1:172.21.15.187:6789/0 conn(0x7f46ec157440 legacy=0x7f46ec1612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46d4003970 0x7f46d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d40047c0 0x7f46d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46d40052a0 0x7f46d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec159fc0 con 0x7f46d40047c0 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400c190 con 0x7f46d40052a0 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400c350 con 0x7f46d4003970 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eb7fe640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46d4003970 0x7f46d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ebfff640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46d40052a0 0x7f46d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eaffd640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d40047c0 0x7f46d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eb7fe640 1 -- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46d40052a0 msgr2=0x7f46d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eb7fe640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46d40052a0 0x7f46d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eb7fe640 1 -- 172.21.15.187:0/850966242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d40047c0 msgr2=0x7f46d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eb7fe640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d40047c0 0x7f46d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46eb7fe640 1 -- 172.21.15.187:0/850966242 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d4003520 con 0x7f46d4003970 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ebfff640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46d40052a0 0x7f46d400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.938+0000 7f46ebfff640 1 -- 172.21.15.187:0/850966242 reap_dead start 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.939+0000 7f46eb7fe640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46d4003970 0x7f46d4003d90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46e000a9a0 tx=0x7f46d40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177ef5a342660584 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.939+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0030400 con 0x7f46d4003970 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.939+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e0030560 con 0x7f46d4003970 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.939+0000 7f46ea7fc640 1 -- 172.21.15.187:0/850966242 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0030950 con 0x7f46d4003970 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.940+0000 7f46f2102640 1 -- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46d4003970 msgr2=0x7f46d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.940+0000 7f46f2102640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46d4003970 0x7f46d4003d90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46e000a9a0 tx=0x7f46d40057f0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.936 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.940+0000 7f46f2102640 1 -- 172.21.15.187:0/850966242 shutdown_connections 2024-03-25T05:37:16.937 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.940+0000 7f46f2102640 1 --2- 172.21.15.187:0/850966242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46d4003970 0x7f46d4003d90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.937 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.940+0000 7f46f2102640 1 -- 172.21.15.187:0/850966242 >> 172.21.15.187:0/850966242 conn(0x7f46ec0674f0 msgr2=0x7f46ec06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:16.937 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.940+0000 7f46f2102640 1 -- 172.21.15.187:0/850966242 shutdown_connections 2024-03-25T05:37:16.937 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.940+0000 7f46f2102640 1 -- 172.21.15.187:0/850966242 wait complete. 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.941+0000 7f46f2102640 1 Processor -- start 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.941+0000 7f46f2102640 1 -- start start 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46f2102640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d4003970 0x7f46ec1f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46f2102640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46ec0cce50 0x7f46ec0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46f2102640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46ec1ed960 0x7f46ec1edde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46f2102640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec1f09b0 con 0x7f46d4003970 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46f2102640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0cb540 con 0x7f46ec0cce50 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46f2102640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec1ee320 con 0x7f46ec1ed960 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46ebfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46ec1ed960 0x7f46ec1edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.939 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46ec0cce50 0x7f46ec0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46ebfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46ec1ed960 0x7f46ec1edde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:51794/0 (socket says 172.21.15.187:51794) 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46ebfff640 1 -- 172.21.15.187:0/1948741327 learned_addr learned my addr 172.21.15.187:0/1948741327 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46ec0cce50 0x7f46ec0c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46718/0 (socket says 172.21.15.187:46718) 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 -- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46ec1ed960 msgr2=0x7f46ec1edde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46ec1ed960 0x7f46ec1edde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 -- 172.21.15.187:0/1948741327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d4003970 msgr2=0x7f46ec1f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d4003970 0x7f46ec1f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 -- 172.21.15.187:0/1948741327 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0ca690 con 0x7f46ec0cce50 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46ebfff640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46ec1ed960 0x7f46ec1edde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.942+0000 7f46eaffd640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46ec0cce50 0x7f46ec0c8920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e4c0 tx=0x7f46dc00e8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.943+0000 7f46d3fff640 1 -- 172.21.15.187:0/1948741327 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0052e0 con 0x7f46ec0cce50 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.943+0000 7f46d3fff640 1 -- 172.21.15.187:0/1948741327 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc005440 con 0x7f46ec0cce50 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.943+0000 7f46d3fff640 1 -- 172.21.15.187:0/1948741327 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc003830 con 0x7f46ec0cce50 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.943+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec0ca930 con 0x7f46ec0cce50 2024-03-25T05:37:16.940 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.943+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec0caef0 con 0x7f46ec0cce50 2024-03-25T05:37:16.941 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.943+0000 7f46d3fff640 1 -- 172.21.15.187:0/1948741327 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f46dc003990 con 0x7f46ec0cce50 2024-03-25T05:37:16.941 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.943+0000 7f46d3fff640 1 -- 172.21.15.187:0/1948741327 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f46dc014de0 con 0x7f46ec0cce50 2024-03-25T05:37:16.941 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.944+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec14e4b0 con 0x7f46ec0cce50 2024-03-25T05:37:16.941 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:16.946+0000 7f46d3fff640 1 -- 172.21.15.187:0/1948741327 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f46dc019070 con 0x7f46ec0cce50 2024-03-25T05:37:16.965 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:16.972+0000 7fc1cf3f1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-25T05:37:17.010 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.016+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd", "id": 6} v 0) v1 -- 0x7f46ec0686c0 con 0x7f46ec0cce50 2024-03-25T05:37:17.016 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.022+0000 7f46d3fff640 1 -- 172.21.15.187:0/1948741327 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46dc014480 con 0x7f46ec0cce50 2024-03-25T05:37:17.016 INFO:teuthology.orchestra.run.smithi187.stdout:6 2024-03-25T05:37:17.017 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.023+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46ec0cce50 msgr2=0x7f46ec0c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.023+0000 7f46f2102640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46ec0cce50 0x7f46ec0c8920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e4c0 tx=0x7f46dc00e8c0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.023+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 shutdown_connections 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.023+0000 7f46f2102640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46ec1ed960 0x7f46ec1edde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.023+0000 7f46f2102640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46ec0cce50 0x7f46ec0c8920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.023+0000 7f46f2102640 1 --2- 172.21.15.187:0/1948741327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46d4003970 0x7f46ec1f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.023+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 >> 172.21.15.187:0/1948741327 conn(0x7f46ec0674f0 msgr2=0x7f46ec14ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.024+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 shutdown_connections 2024-03-25T05:37:17.018 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.024+0000 7f46f2102640 1 -- 172.21.15.187:0/1948741327 wait complete. 2024-03-25T05:37:17.028 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new ef9d78ca-8ce9-417b-a6a5-0d58281d48cb 7 2024-03-25T05:37:17.082 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:17.088+0000 7fc1cf3f1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-25T05:37:17.100 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:17.106+0000 7fdea8a50040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-25T05:37:17.127 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.133+0000 7f1e53c8f640 1 Processor -- start 2024-03-25T05:37:17.127 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.133+0000 7f1e53c8f640 1 -- start start 2024-03-25T05:37:17.128 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.134+0000 7f1e53c8f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1e4c1586d0 0x7f1e4c0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.134+0000 7f1e53c8f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c070530 con 0x7f1e4c0c8100 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.134+0000 7f1e53c8f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c06ff70 con 0x7f1e4c151e40 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.134+0000 7f1e53c8f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4c152220 con 0x7f1e4c1586d0 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.134+0000 7f1e5122a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1e4c1586d0 0x7f1e4c0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.134+0000 7f1e5122a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1e4c1586d0 0x7f1e4c0c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46732/0 (socket says 172.21.15.187:46732) 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.134+0000 7f1e5122a640 1 -- 172.21.15.187:0/2790657837 learned_addr learned my addr 172.21.15.187:0/2790657837 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.135+0000 7f1e5122a640 1 -- 172.21.15.187:0/2790657837 >> v1:172.21.15.187:6789/0 conn(0x7f1e4c151e40 legacy=0x7f1e4c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.135+0000 7f1e5122a640 1 -- 172.21.15.187:0/2790657837 >> v1:172.21.15.102:6789/0 conn(0x7f1e4c0c8100 legacy=0x7f1e4c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:17.129 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.135+0000 7f1e5122a640 1 -- 172.21.15.187:0/2790657837 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c070250 con 0x7f1e4c1586d0 2024-03-25T05:37:17.130 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.135+0000 7f1e5122a640 1 --2- 172.21.15.187:0/2790657837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c1586d0 0x7f1e4c0c45a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009870 tx=0x7f1e4802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25637bd6b7213927 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:17.130 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.135+0000 7f1e50a29640 1 -- 172.21.15.187:0/2790657837 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48030860 con 0x7f1e4c1586d0 2024-03-25T05:37:17.130 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.135+0000 7f1e50a29640 1 -- 172.21.15.187:0/2790657837 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e480309c0 con 0x7f1e4c1586d0 2024-03-25T05:37:17.130 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.135+0000 7f1e50a29640 1 -- 172.21.15.187:0/2790657837 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48030d50 con 0x7f1e4c1586d0 2024-03-25T05:37:17.130 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:17.136+0000 7fc1cf3f1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-25T05:37:17.133 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.136+0000 7f1e53c8f640 1 -- 172.21.15.187:0/2790657837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c1586d0 msgr2=0x7f1e4c0c45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.136+0000 7f1e53c8f640 1 --2- 172.21.15.187:0/2790657837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c1586d0 0x7f1e4c0c45a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009870 tx=0x7f1e4802b9a0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.136+0000 7f1e53c8f640 1 -- 172.21.15.187:0/2790657837 shutdown_connections 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.136+0000 7f1e53c8f640 1 --2- 172.21.15.187:0/2790657837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c1586d0 0x7f1e4c0c45a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.136+0000 7f1e53c8f640 1 -- 172.21.15.187:0/2790657837 >> 172.21.15.187:0/2790657837 conn(0x7f1e4c066ea0 msgr2=0x7f1e4c0672b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.136+0000 7f1e53c8f640 1 -- 172.21.15.187:0/2790657837 shutdown_connections 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.136+0000 7f1e53c8f640 1 -- 172.21.15.187:0/2790657837 wait complete. 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.137+0000 7f1e53c8f640 1 Processor -- start 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.137+0000 7f1e53c8f640 1 -- start start 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e53c8f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c0c8100 0x7f1e4c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e53c8f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e4c151e40 0x7f1e4c0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e53c8f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e4c1586d0 0x7f1e4c1f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e53c8f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c0b0f70 con 0x7f1e4c1586d0 2024-03-25T05:37:17.134 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e53c8f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c1ed670 con 0x7f1e4c0c8100 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e53c8f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c0b0710 con 0x7f1e4c151e40 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c0c8100 0x7f1e4c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c0c8100 0x7f1e4c0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:46736/0 (socket says 172.21.15.187:46736) 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 -- 172.21.15.187:0/3283175190 learned_addr learned my addr 172.21.15.187:0/3283175190 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e5122a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e4c151e40 0x7f1e4c0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 -- 172.21.15.187:0/3283175190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e4c151e40 msgr2=0x7f1e4c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 --2- 172.21.15.187:0/3283175190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e4c151e40 0x7f1e4c0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 -- 172.21.15.187:0/3283175190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e4c1586d0 msgr2=0x7f1e4c1f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 --2- 172.21.15.187:0/3283175190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e4c1586d0 0x7f1e4c1f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 -- 172.21.15.187:0/3283175190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480094d0 con 0x7f1e4c0c8100 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.138+0000 7f1e51a2b640 1 --2- 172.21.15.187:0/3283175190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c0c8100 0x7f1e4c0cd150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c400 tx=0x7f1e3c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.139+0000 7f1e427fc640 1 -- 172.21.15.187:0/3283175190 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0052d0 con 0x7f1e4c0c8100 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.139+0000 7f1e427fc640 1 -- 172.21.15.187:0/3283175190 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c005450 con 0x7f1e4c0c8100 2024-03-25T05:37:17.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.139+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c1f0d60 con 0x7f1e4c0c8100 2024-03-25T05:37:17.136 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.139+0000 7f1e427fc640 1 -- 172.21.15.187:0/3283175190 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c007260 con 0x7f1e4c0c8100 2024-03-25T05:37:17.136 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.139+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c0b09b0 con 0x7f1e4c0c8100 2024-03-25T05:37:17.136 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.139+0000 7f1e427fc640 1 -- 172.21.15.187:0/3283175190 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1e3c0073c0 con 0x7f1e4c0c8100 2024-03-25T05:37:17.136 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.139+0000 7f1e427fc640 1 -- 172.21.15.187:0/3283175190 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f1e3c011590 con 0x7f1e4c0c8100 2024-03-25T05:37:17.136 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.140+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c0686c0 con 0x7f1e4c0c8100 2024-03-25T05:37:17.136 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.142+0000 7f1e427fc640 1 -- 172.21.15.187:0/3283175190 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1e3c020060 con 0x7f1e4c0c8100 2024-03-25T05:37:17.207 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.213+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ef9d78ca-8ce9-417b-a6a5-0d58281d48cb", "id": 7} v 0) v1 -- 0x7f1e4c070710 con 0x7f1e4c0c8100 2024-03-25T05:37:17.214 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.220+0000 7f1e427fc640 1 -- 172.21.15.187:0/3283175190 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef9d78ca-8ce9-417b-a6a5-0d58281d48cb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1e3c003910 con 0x7f1e4c0c8100 2024-03-25T05:37:17.214 INFO:teuthology.orchestra.run.smithi187.stdout:7 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c0c8100 msgr2=0x7f1e4c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 --2- 172.21.15.187:0/3283175190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c0c8100 0x7f1e4c0cd150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c400 tx=0x7f1e3c00c8c0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 shutdown_connections 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 --2- 172.21.15.187:0/3283175190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e4c1586d0 0x7f1e4c1f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 --2- 172.21.15.187:0/3283175190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e4c151e40 0x7f1e4c0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 --2- 172.21.15.187:0/3283175190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e4c0c8100 0x7f1e4c0cd150 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 >> 172.21.15.187:0/3283175190 conn(0x7f1e4c066ea0 msgr2=0x7f1e4c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 shutdown_connections 2024-03-25T05:37:17.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-25T05:37:17.221+0000 7f1e53c8f640 1 -- 172.21.15.187:0/3283175190 wait complete. 2024-03-25T05:37:17.227 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-25T05:37:17.227 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-25T05:37:17.235 INFO:tasks.ceph.osd.0:Started 2024-03-25T05:37:17.235 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-25T05:37:17.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-25T05:37:17.242 INFO:tasks.ceph.osd.1:Started 2024-03-25T05:37:17.242 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-25T05:37:17.242 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-25T05:37:17.248 INFO:tasks.ceph.osd.2:Started 2024-03-25T05:37:17.248 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-25T05:37:17.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-25T05:37:17.249 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:17.256+0000 7fc1cf3f1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-25T05:37:17.254 INFO:tasks.ceph.osd.3:Started 2024-03-25T05:37:17.254 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-25T05:37:17.254 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-25T05:37:17.256 INFO:tasks.ceph.osd.4:Started 2024-03-25T05:37:17.256 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-25T05:37:17.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-25T05:37:17.258 INFO:tasks.ceph.osd.5:Started 2024-03-25T05:37:17.258 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-25T05:37:17.258 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-25T05:37:17.260 INFO:tasks.ceph.osd.6:Started 2024-03-25T05:37:17.260 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-25T05:37:17.260 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-25T05:37:17.262 INFO:tasks.ceph.osd.7:Started 2024-03-25T05:37:17.263 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:17.264 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:17.270+0000 7fdea8a50040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-25T05:37:17.373 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:17.379+0000 7fc1cf3f1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-25T05:37:17.469 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:17.475+0000 7fdea8a50040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-25T05:37:17.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.521+0000 7fe587e00640 1 Processor -- start 2024-03-25T05:37:17.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.521+0000 7fe587e00640 1 -- start start 2024-03-25T05:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.522+0000 7fe587e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe5800c5940 0x7fe5800ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.522+0000 7fe587e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800caa10 con 0x7fe5800c6240 2024-03-25T05:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.522+0000 7fe587e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58015a060 con 0x7fe5800c7940 2024-03-25T05:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.522+0000 7fe587e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58015a340 con 0x7fe5800c5940 2024-03-25T05:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe584a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe5800c6240 0x7fe5800cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60978/0 (socket says 172.21.15.102:60978) 2024-03-25T05:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe584a00640 1 -- 172.21.15.102:0/1917162118 learned_addr learned my addr 172.21.15.102:0/1917162118 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe585400640 1 --2- 172.21.15.102:0/1917162118 >> v2:172.21.15.187:3300/0 conn(0x7fe5800c5940 0x7fe5800ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe57fe00640 1 -- 172.21.15.102:0/1917162118 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017231358 0 0) 0x7fe5800caa10 con 0x7fe5800c6240 2024-03-25T05:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe57fe00640 1 -- 172.21.15.102:0/1917162118 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe568003520 con 0x7fe5800c6240 2024-03-25T05:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe585400640 1 -- 172.21.15.102:0/1917162118 >> v1:172.21.15.187:6789/0 conn(0x7fe5800c7940 legacy=0x7fe5800c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe585400640 1 -- 172.21.15.102:0/1917162118 >> v1:172.21.15.102:6789/0 conn(0x7fe5800c6240 legacy=0x7fe5800cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.523+0000 7fe585400640 1 -- 172.21.15.102:0/1917162118 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58015a620 con 0x7fe5800c5940 2024-03-25T05:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.524+0000 7fe585400640 1 --2- 172.21.15.102:0/1917162118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c5940 0x7fe5800ca4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe5740097a0 tx=0x7fe57402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7ed7b07109de50f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.524+0000 7fe57fe00640 1 -- 172.21.15.102:0/1917162118 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574030610 con 0x7fe5800c5940 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.524+0000 7fe57fe00640 1 -- 172.21.15.102:0/1917162118 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574030770 con 0x7fe5800c5940 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe57fe00640 1 -- 172.21.15.102:0/1917162118 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574030b00 con 0x7fe5800c5940 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe587e00640 1 -- 172.21.15.102:0/1917162118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c5940 msgr2=0x7fe5800ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe587e00640 1 --2- 172.21.15.102:0/1917162118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c5940 0x7fe5800ca4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe5740097a0 tx=0x7fe57402b960 comp rx=0 tx=0).stop 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe587e00640 1 -- 172.21.15.102:0/1917162118 shutdown_connections 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe587e00640 1 --2- 172.21.15.102:0/1917162118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c5940 0x7fe5800ca4d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe587e00640 1 -- 172.21.15.102:0/1917162118 >> 172.21.15.102:0/1917162118 conn(0x7fe5800728c0 msgr2=0x7fe58006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe587e00640 1 -- 172.21.15.102:0/1917162118 shutdown_connections 2024-03-25T05:37:17.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.525+0000 7fe587e00640 1 -- 172.21.15.102:0/1917162118 wait complete. 2024-03-25T05:37:17.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.527+0000 7fe587e00640 1 Processor -- start 2024-03-25T05:37:17.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.527+0000 7fe587e00640 1 -- start start 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe587e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5800c5940 0x7fe5800cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe587e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5800c6240 0x7fe580155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe587e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c7940 0x7fe580156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe587e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801e2330 con 0x7fe5800c6240 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe587e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801e25d0 con 0x7fe5800c7940 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe587e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801e28b0 con 0x7fe5800c5940 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe585400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5800c5940 0x7fe5800cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:17.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe584a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5800c6240 0x7fe580155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe585400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5800c5940 0x7fe5800cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:56608/0 (socket says 172.21.15.102:56608) 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe585400640 1 -- 172.21.15.102:0/2824905410 learned_addr learned my addr 172.21.15.102:0/2824905410 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.528+0000 7fe585e00640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c7940 0x7fe580156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe585400640 1 -- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c7940 msgr2=0x7fe580156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe585400640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c7940 0x7fe580156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe585400640 1 -- 172.21.15.102:0/2824905410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5800c6240 msgr2=0x7fe580155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe585400640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5800c6240 0x7fe580155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe585400640 1 -- 172.21.15.102:0/2824905410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574009400 con 0x7fe5800c5940 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe584a00640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5800c6240 0x7fe580155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe585400640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5800c5940 0x7fe5800cfa80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe57402bf70 tx=0x7fe574004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe57d600640 1 -- 172.21.15.102:0/2824905410 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57403e040 con 0x7fe5800c5940 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe57d600640 1 -- 172.21.15.102:0/2824905410 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574039cb0 con 0x7fe5800c5940 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe57d600640 1 -- 172.21.15.102:0/2824905410 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574044630 con 0x7fe5800c5940 2024-03-25T05:37:17.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5800c5ea0 con 0x7fe5800c5940 2024-03-25T05:37:17.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.529+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801e2e70 con 0x7fe5800c5940 2024-03-25T05:37:17.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.530+0000 7fe57d600640 1 -- 172.21.15.102:0/2824905410 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe574044790 con 0x7fe5800c5940 2024-03-25T05:37:17.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.530+0000 7fe57d600640 1 -- 172.21.15.102:0/2824905410 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe57404da80 con 0x7fe5800c5940 2024-03-25T05:37:17.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.530+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580067fb0 con 0x7fe5800c5940 2024-03-25T05:37:17.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.533+0000 7fe57d600640 1 -- 172.21.15.102:0/2824905410 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe574049070 con 0x7fe5800c5940 2024-03-25T05:37:17.528 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:17.535+0000 7fc1cf3f1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-25T05:37:17.547 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:17.553+0000 7fdea8a50040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-25T05:37:17.570 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:17.576+0000 7fc1cf3f1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-25T05:37:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.618+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5800cafd0 con 0x7fe5800c5940 2024-03-25T05:37:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.619+0000 7fe57d600640 1 -- 172.21.15.102:0/2824905410 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe574034070 con 0x7fe5800c5940 2024-03-25T05:37:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:17.614 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":10,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:17.216204+0000","last_up_change":"0.000000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:17.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.620+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5800c5940 msgr2=0x7fe5800cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:17.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.620+0000 7fe587e00640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5800c5940 0x7fe5800cfa80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe57402bf70 tx=0x7fe574004730 comp rx=0 tx=0).stop 2024-03-25T05:37:17.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.621+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 shutdown_connections 2024-03-25T05:37:17.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.621+0000 7fe587e00640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800c7940 0x7fe580156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.621+0000 7fe587e00640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5800c6240 0x7fe580155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.621+0000 7fe587e00640 1 --2- 172.21.15.102:0/2824905410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5800c5940 0x7fe5800cfa80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:17.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.621+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 >> 172.21.15.102:0/2824905410 conn(0x7fe5800728c0 msgr2=0x7fe5800cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:17.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.621+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 shutdown_connections 2024-03-25T05:37:17.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:17.621+0000 7fe587e00640 1 -- 172.21.15.102:0/2824905410 wait complete. 2024-03-25T05:37:17.631 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-25T05:37:17.631 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-25T05:37:17.685 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:17.691+0000 7fdea8a50040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-25T05:37:17.724 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:17.731+0000 7fc1cf3f1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-25T05:37:17.797 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:17.803+0000 7fdea8a50040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-25T05:37:17.874 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-03-25T05:37:17.880+0000 7f3dfd411640 -1 Falling back to public interface 2024-03-25T05:37:17.875 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-03-25T05:37:17.881+0000 7f5dd058c640 -1 Falling back to public interface 2024-03-25T05:37:17.883 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-03-25T05:37:17.889+0000 7f440e0d9640 -1 Falling back to public interface 2024-03-25T05:37:17.884 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-03-25T05:37:17.890+0000 7f69b0338640 -1 Falling back to public interface 2024-03-25T05:37:17.934 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-03-25T05:37:17.940+0000 7fd74b415640 -1 Falling back to public interface 2024-03-25T05:37:17.956 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-03-25T05:37:17.962+0000 7f2bf16f9640 -1 Falling back to public interface 2024-03-25T05:37:17.964 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-03-25T05:37:17.970+0000 7f22ab114640 -1 Falling back to public interface 2024-03-25T05:37:17.964 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-03-25T05:37:17.970+0000 7f6b28a13640 -1 Falling back to public interface 2024-03-25T05:37:17.977 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:17.983+0000 7fdea8a50040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-25T05:37:18.029 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:18.035+0000 7fdea8a50040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-25T05:37:18.202 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:18.207+0000 7fdea8a50040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-25T05:37:18.438 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:18.526 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:18.533+0000 7fc1cf3f1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-25T05:37:18.597 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.603+0000 7f9543000640 1 Processor -- start 2024-03-25T05:37:18.597 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.603+0000 7f9543000640 1 -- start start 2024-03-25T05:37:18.599 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9543000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f953c0c9450 0x7f953c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:18.599 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9543000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c06c6e0 0x7f953c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9543000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953c15ad60 con 0x7f953c0ca850 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9543000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953c15a520 con 0x7f953c0c9450 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9543000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c15a7a0 con 0x7f953c06c6e0 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f953be00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f953c0c9450 0x7f953c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9533400640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f953c0ca850 0x7f953c159e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60990/0 (socket says 172.21.15.102:60990) 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9533400640 1 -- 172.21.15.102:0/344788479 learned_addr learned my addr 172.21.15.102:0/344788479 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.604+0000 7f9541000640 1 --2- 172.21.15.102:0/344788479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c06c6e0 0x7f953c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.605+0000 7f9541000640 1 -- 172.21.15.102:0/344788479 >> v2:172.21.15.102:3300/0 conn(0x7f953c0c9450 msgr2=0x7f953c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.605+0000 7f9541000640 1 --2- 172.21.15.102:0/344788479 >> v2:172.21.15.102:3300/0 conn(0x7f953c0c9450 0x7f953c15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.605+0000 7f9541000640 1 -- 172.21.15.102:0/344788479 >> v1:172.21.15.102:6789/0 conn(0x7f953c0ca850 legacy=0x7f953c159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.605+0000 7f9541000640 1 -- 172.21.15.102:0/344788479 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c15aa80 con 0x7f953c06c6e0 2024-03-25T05:37:18.600 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.605+0000 7f953be00640 1 --2- 172.21.15.102:0/344788479 >> v2:172.21.15.102:3300/0 conn(0x7f953c0c9450 0x7f953c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:18.601 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.606+0000 7f9541000640 1 --2- 172.21.15.102:0/344788479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c06c6e0 0x7f953c0cb0a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f95340097a0 tx=0x7f953402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947bf7585b6a2cef server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.606+0000 7f953b400640 1 -- 172.21.15.102:0/344788479 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534031780 con 0x7f953c06c6e0 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.606+0000 7f953b400640 1 -- 172.21.15.102:0/344788479 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95340318e0 con 0x7f953c06c6e0 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.606+0000 7f953b400640 1 -- 172.21.15.102:0/344788479 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534031c70 con 0x7f953c06c6e0 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 -- 172.21.15.102:0/344788479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c06c6e0 msgr2=0x7f953c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 --2- 172.21.15.102:0/344788479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c06c6e0 0x7f953c0cb0a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f95340097a0 tx=0x7f953402b820 comp rx=0 tx=0).stop 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 -- 172.21.15.102:0/344788479 shutdown_connections 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 --2- 172.21.15.102:0/344788479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c06c6e0 0x7f953c0cb0a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 --2- 172.21.15.102:0/344788479 >> v2:172.21.15.102:3300/0 conn(0x7f953c0c9450 0x7f953c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 -- 172.21.15.102:0/344788479 >> 172.21.15.102:0/344788479 conn(0x7f953c0619d0 msgr2=0x7f953c061db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 -- 172.21.15.102:0/344788479 shutdown_connections 2024-03-25T05:37:18.602 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.607+0000 7f9543000640 1 -- 172.21.15.102:0/344788479 wait complete. 2024-03-25T05:37:18.603 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.608+0000 7f9543000640 1 Processor -- start 2024-03-25T05:37:18.603 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.609+0000 7f9543000640 1 -- start start 2024-03-25T05:37:18.605 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.609+0000 7f9543000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f953c06c6e0 0x7f953c1e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:18.605 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.609+0000 7f9543000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953c0c9450 0x7f953c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:18.605 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.609+0000 7f9543000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c0ca850 0x7f953c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:18.605 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.609+0000 7f9543000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c155c60 con 0x7f953c06c6e0 2024-03-25T05:37:18.605 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.609+0000 7f9543000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c1567e0 con 0x7f953c0c9450 2024-03-25T05:37:18.605 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.609+0000 7f9543000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c1e5210 con 0x7f953c0ca850 2024-03-25T05:37:18.605 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f953be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f953c06c6e0 0x7f953c1e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9541000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c0ca850 0x7f953c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9533400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953c0c9450 0x7f953c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f953be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f953c06c6e0 0x7f953c1e4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42906/0 (socket says 172.21.15.102:42906) 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f953be00640 1 -- 172.21.15.102:0/2117212374 learned_addr learned my addr 172.21.15.102:0/2117212374 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9541000640 1 -- 172.21.15.102:0/2117212374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953c0c9450 msgr2=0x7f953c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9541000640 1 --2- 172.21.15.102:0/2117212374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953c0c9450 0x7f953c1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9541000640 1 -- 172.21.15.102:0/2117212374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f953c06c6e0 msgr2=0x7f953c1e4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9541000640 1 --2- 172.21.15.102:0/2117212374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f953c06c6e0 0x7f953c1e4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9541000640 1 -- 172.21.15.102:0/2117212374 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c009a70 con 0x7f953c0ca850 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.610+0000 7f9541000640 1 --2- 172.21.15.102:0/2117212374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c0ca850 0x7f953c0cb0a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9534033000 tx=0x7f95340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.611+0000 7f9538c00640 1 -- 172.21.15.102:0/2117212374 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534032820 con 0x7f953c0ca850 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.611+0000 7f9538c00640 1 -- 172.21.15.102:0/2117212374 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534032980 con 0x7f953c0ca850 2024-03-25T05:37:18.606 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.611+0000 7f9538c00640 1 -- 172.21.15.102:0/2117212374 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534032d30 con 0x7f953c0ca850 2024-03-25T05:37:18.607 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.611+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9534009400 con 0x7f953c0ca850 2024-03-25T05:37:18.607 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.611+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c155f20 con 0x7f953c0ca850 2024-03-25T05:37:18.607 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.611+0000 7f9538c00640 1 -- 172.21.15.102:0/2117212374 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f953404e7d0 con 0x7f953c0ca850 2024-03-25T05:37:18.607 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.611+0000 7f9538c00640 1 -- 172.21.15.102:0/2117212374 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9534045400 con 0x7f953c0ca850 2024-03-25T05:37:18.607 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.612+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953c06d4c0 con 0x7f953c0ca850 2024-03-25T05:37:18.608 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.614+0000 7f9538c00640 1 -- 172.21.15.102:0/2117212374 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9534045900 con 0x7f953c0ca850 2024-03-25T05:37:18.675 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.681+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f953c0686b0 con 0x7f953c0ca850 2024-03-25T05:37:18.676 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.682+0000 7f9538c00640 1 -- 172.21.15.102:0/2117212374 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f9534045aa0 con 0x7f953c0ca850 2024-03-25T05:37:18.677 INFO:teuthology.misc.health.smithi102.stdout: 2024-03-25T05:37:18.677 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":10,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:17.216204+0000","last_up_change":"0.000000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c0ca850 msgr2=0x7f953c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 --2- 172.21.15.102:0/2117212374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c0ca850 0x7f953c0cb0a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9534033000 tx=0x7f95340046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 shutdown_connections 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 --2- 172.21.15.102:0/2117212374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f953c0ca850 0x7f953c0cb0a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 --2- 172.21.15.102:0/2117212374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953c0c9450 0x7f953c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 --2- 172.21.15.102:0/2117212374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f953c06c6e0 0x7f953c1e4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 >> 172.21.15.102:0/2117212374 conn(0x7f953c0619d0 msgr2=0x7f953c061db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 shutdown_connections 2024-03-25T05:37:18.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:18.683+0000 7f9543000640 1 -- 172.21.15.102:0/2117212374 wait complete. 2024-03-25T05:37:18.690 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-25T05:37:18.801 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:18.807+0000 7fc1cf3f1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-25T05:37:18.853 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:18.860+0000 7fc1cf3f1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-25T05:37:18.967 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:18.973+0000 7fc1cf3f1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-25T05:37:19.299 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:19.304+0000 7fdea8a50040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-25T05:37:19.617 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:19.622+0000 7fdea8a50040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-25T05:37:19.678 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:19.684+0000 7fdea8a50040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-25T05:37:19.806 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-03-25T05:37:19.812+0000 7fdea8a50040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-25T05:37:20.005 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:20.011+0000 7fc17085e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-25T05:37:20.006 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-03-25T05:37:20.012+0000 7fc17085e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-25T05:37:21.321 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-03-25T05:37:21.327+0000 7f2bf16f9640 -1 osd.3 0 log_to_monitors true 2024-03-25T05:37:21.393 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-03-25T05:37:21.399+0000 7f440e0d9640 -1 osd.4 0 log_to_monitors true 2024-03-25T05:37:21.397 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-03-25T05:37:21.403+0000 7f3dfd411640 -1 osd.7 0 log_to_monitors true 2024-03-25T05:37:21.404 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-03-25T05:37:21.410+0000 7f5dd058c640 -1 osd.6 0 log_to_monitors true 2024-03-25T05:37:21.408 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-03-25T05:37:21.414+0000 7f69b0338640 -1 osd.5 0 log_to_monitors true 2024-03-25T05:37:21.569 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-03-25T05:37:21.575+0000 7f22ab114640 -1 osd.2 0 log_to_monitors true 2024-03-25T05:37:21.578 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-03-25T05:37:21.584+0000 7f6b28a13640 -1 osd.1 0 log_to_monitors true 2024-03-25T05:37:21.763 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-03-25T05:37:21.768+0000 7fd74b415640 -1 osd.0 0 log_to_monitors true 2024-03-25T05:37:23.802 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-03-25T05:37:23.808+0000 7f440a06f640 -1 osd.4 0 waiting for initial osdmap 2024-03-25T05:37:23.804 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-03-25T05:37:23.811+0000 7f3df8dd3640 -1 osd.7 0 waiting for initial osdmap 2024-03-25T05:37:23.818 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-03-25T05:37:23.824+0000 7f4401e8f640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:23.818 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-03-25T05:37:23.824+0000 7f3df0bf3640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:23.827 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-03-25T05:37:23.833+0000 7f5dcc522640 -1 osd.6 0 waiting for initial osdmap 2024-03-25T05:37:23.840 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-03-25T05:37:23.846+0000 7f5dc4342640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:23.840 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-03-25T05:37:23.847+0000 7f69ac2ce640 -1 osd.5 0 waiting for initial osdmap 2024-03-25T05:37:23.853 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-03-25T05:37:23.859+0000 7f69a40ee640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:24.240 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-03-25T05:37:24.246+0000 7f6b23c00640 -1 osd.1 0 waiting for initial osdmap 2024-03-25T05:37:24.249 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-03-25T05:37:24.255+0000 7f6b19200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:24.255 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-03-25T05:37:24.261+0000 7f2bec600640 -1 osd.3 0 waiting for initial osdmap 2024-03-25T05:37:24.269 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-03-25T05:37:24.275+0000 7f2be2600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:24.295 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-03-25T05:37:24.301+0000 7fd745e00640 -1 osd.0 0 waiting for initial osdmap 2024-03-25T05:37:24.300 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-03-25T05:37:24.306+0000 7fd73be00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:24.318 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-03-25T05:37:24.324+0000 7f22a6000640 -1 osd.2 0 waiting for initial osdmap 2024-03-25T05:37:24.326 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-03-25T05:37:24.331+0000 7f229c000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-25T05:37:25.496 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:25.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.684+0000 7f98e3200640 1 Processor -- start 2024-03-25T05:37:25.678 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.684+0000 7f98e3200640 1 -- start start 2024-03-25T05:37:25.679 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.685+0000 7f98e3200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e4150a40 0x7f98e4071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:25.679 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.685+0000 7f98e3200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f98e40c6a50 0x7f98e4072370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:25.679 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.685+0000 7f98e3200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e40c6500 con 0x7f98e40c59d0 2024-03-25T05:37:25.680 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.685+0000 7f98e3200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e40c2570 con 0x7f98e40c6a50 2024-03-25T05:37:25.680 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.685+0000 7f98e3200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40c6730 con 0x7f98e4150a40 2024-03-25T05:37:25.680 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.685+0000 7f98e1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e4150a40 0x7f98e4071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:25.680 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.685+0000 7f98e2800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f98e40c59d0 0x7f98e415a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:33254/0 (socket says 172.21.15.102:33254) 2024-03-25T05:37:25.681 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.686+0000 7f98e2800640 1 -- 172.21.15.102:0/2268584317 learned_addr learned my addr 172.21.15.102:0/2268584317 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:25.681 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.686+0000 7f98dbe00640 1 --2- 172.21.15.102:0/2268584317 >> v2:172.21.15.102:3300/0 conn(0x7f98e40c6a50 0x7f98e4072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:25.681 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.686+0000 7f98e1400640 1 -- 172.21.15.102:0/2268584317 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431154094 0 0) 0x7f98e40c6500 con 0x7f98e40c59d0 2024-03-25T05:37:25.681 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.686+0000 7f98e1e00640 1 -- 172.21.15.102:0/2268584317 >> v2:172.21.15.102:3300/0 conn(0x7f98e40c6a50 msgr2=0x7f98e4072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:25.681 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.686+0000 7f98e1e00640 1 --2- 172.21.15.102:0/2268584317 >> v2:172.21.15.102:3300/0 conn(0x7f98e40c6a50 0x7f98e4072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.681 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.686+0000 7f98e1e00640 1 -- 172.21.15.102:0/2268584317 >> v1:172.21.15.187:6789/0 conn(0x7f98e40c59d0 legacy=0x7f98e415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:25.681 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.686+0000 7f98e1e00640 1 -- 172.21.15.102:0/2268584317 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4150e20 con 0x7f98e4150a40 2024-03-25T05:37:25.682 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.687+0000 7f98e1e00640 1 --2- 172.21.15.102:0/2268584317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e4150a40 0x7f98e4071e30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98d40097a0 tx=0x7f98d402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3149323d33de727c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:25.682 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.687+0000 7f98e1400640 1 -- 172.21.15.102:0/2268584317 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4031830 con 0x7f98e4150a40 2024-03-25T05:37:25.682 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.687+0000 7f98e1400640 1 -- 172.21.15.102:0/2268584317 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4031990 con 0x7f98e4150a40 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.687+0000 7f98e1400640 1 -- 172.21.15.102:0/2268584317 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4031d20 con 0x7f98e4150a40 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 -- 172.21.15.102:0/2268584317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e4150a40 msgr2=0x7f98e4071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 --2- 172.21.15.102:0/2268584317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e4150a40 0x7f98e4071e30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98d40097a0 tx=0x7f98d402b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 -- 172.21.15.102:0/2268584317 shutdown_connections 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 --2- 172.21.15.102:0/2268584317 >> v2:172.21.15.102:3300/0 conn(0x7f98e40c6a50 0x7f98e4072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 --2- 172.21.15.102:0/2268584317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e4150a40 0x7f98e4071e30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 -- 172.21.15.102:0/2268584317 >> 172.21.15.102:0/2268584317 conn(0x7f98e406cb70 msgr2=0x7f98e406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 -- 172.21.15.102:0/2268584317 shutdown_connections 2024-03-25T05:37:25.683 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.688+0000 7f98e3200640 1 -- 172.21.15.102:0/2268584317 wait complete. 2024-03-25T05:37:25.684 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.690+0000 7f98e3200640 1 Processor -- start 2024-03-25T05:37:25.684 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.690+0000 7f98e3200640 1 -- start start 2024-03-25T05:37:25.685 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e3200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e40c59d0 0x7f98e414d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:25.685 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e3200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e40c6a50 0x7f98e40c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:25.685 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e3200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e4150a40 0x7f98e413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:25.685 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e3200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e413ebc0 con 0x7f98e4150a40 2024-03-25T05:37:25.685 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e3200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e414cd40 con 0x7f98e40c6a50 2024-03-25T05:37:25.686 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e3200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e414f560 con 0x7f98e40c59d0 2024-03-25T05:37:25.686 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e2800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e4150a40 0x7f98e413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:25.686 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e40c59d0 0x7f98e414d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:25.686 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e2800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e4150a40 0x7f98e413fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56780/0 (socket says 172.21.15.102:56780) 2024-03-25T05:37:25.686 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e2800640 1 -- 172.21.15.102:0/4178834471 learned_addr learned my addr 172.21.15.102:0/4178834471 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:25.686 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98dbe00640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e40c6a50 0x7f98e40c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e1e00640 1 -- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e40c6a50 msgr2=0x7f98e40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e1e00640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e40c6a50 0x7f98e40c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e1e00640 1 -- 172.21.15.102:0/4178834471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e4150a40 msgr2=0x7f98e413fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e1e00640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e4150a40 0x7f98e413fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e1e00640 1 -- 172.21.15.102:0/4178834471 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009400 con 0x7f98e40c59d0 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.691+0000 7f98e2800640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e4150a40 0x7f98e413fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.692+0000 7f98e1e00640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e40c59d0 0x7f98e414d1d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f98d4033000 tx=0x7f98d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.692+0000 7f98da000640 1 -- 172.21.15.102:0/4178834471 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d403a8f0 con 0x7f98e40c59d0 2024-03-25T05:37:25.687 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.692+0000 7f98da000640 1 -- 172.21.15.102:0/4178834471 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d403aa50 con 0x7f98e40c59d0 2024-03-25T05:37:25.688 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.692+0000 7f98da000640 1 -- 172.21.15.102:0/4178834471 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d403ae00 con 0x7f98e40c59d0 2024-03-25T05:37:25.688 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.692+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e414f820 con 0x7f98e40c59d0 2024-03-25T05:37:25.688 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.692+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e414c6f0 con 0x7f98e40c59d0 2024-03-25T05:37:25.688 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.693+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e404f2f0 con 0x7f98e40c59d0 2024-03-25T05:37:25.688 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.694+0000 7f98da000640 1 -- 172.21.15.102:0/4178834471 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f98d404d450 con 0x7f98e40c59d0 2024-03-25T05:37:25.689 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.695+0000 7f98da000640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f98c006b7b0 0x7f98c006dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:25.689 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.695+0000 7f98da000640 1 -- 172.21.15.102:0/4178834471 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f98d40abab0 con 0x7f98e40c59d0 2024-03-25T05:37:25.689 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.695+0000 7f98dbe00640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f98c006b7b0 0x7f98c006dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:25.690 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.696+0000 7f98dbe00640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f98c006b7b0 0x7f98c006dc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98e413e5c0 tx=0x7f98cc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:25.694 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.700+0000 7f98da000640 1 -- 172.21.15.102:0/4178834471 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f98d4076b20 con 0x7f98e40c59d0 2024-03-25T05:37:25.879 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.885+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e4133340 con 0x7f98e40c59d0 2024-03-25T05:37:25.880 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.886+0000 7f98da000640 1 -- 172.21.15.102:0/4178834471 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12924 (secure 0 0 0) 0x7f98d4035090 con 0x7f98e40c59d0 2024-03-25T05:37:25.881 INFO:teuthology.misc.health.smithi102.stdout: 2024-03-25T05:37:25.881 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":14,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:25.864676+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:25.883 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.888+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f98c006b7b0 msgr2=0x7f98c006dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:25.883 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.888+0000 7f98e3200640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f98c006b7b0 0x7f98c006dc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98e413e5c0 tx=0x7f98cc009190 comp rx=0 tx=0).stop 2024-03-25T05:37:25.883 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.888+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e40c59d0 msgr2=0x7f98e414d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:25.883 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.888+0000 7f98e3200640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e40c59d0 0x7f98e414d1d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f98d4033000 tx=0x7f98d40046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.883 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 shutdown_connections 2024-03-25T05:37:25.883 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f98c006b7b0 0x7f98c006dc70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.883 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e4150a40 0x7f98e413fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.884 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e40c6a50 0x7f98e40c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.884 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 --2- 172.21.15.102:0/4178834471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98e40c59d0 0x7f98e414d1d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:25.884 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 >> 172.21.15.102:0/4178834471 conn(0x7f98e406cb70 msgr2=0x7f98e40c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:25.884 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 shutdown_connections 2024-03-25T05:37:25.884 INFO:teuthology.misc.health.smithi102.stderr:2024-03-25T05:37:25.889+0000 7f98e3200640 1 -- 172.21.15.102:0/4178834471 wait complete. 2024-03-25T05:37:25.896 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-25T05:37:25.896 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-25T05:37:25.897 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-25T05:37:25.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-25T05:37:25.902 INFO:tasks.ceph.mds.a:Started 2024-03-25T05:37:25.902 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-25T05:37:25.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-25T05:37:25.908 INFO:tasks.ceph.mds.c:Started 2024-03-25T05:37:25.908 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-25T05:37:25.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-25T05:37:25.912 INFO:tasks.ceph.mds.e:Started 2024-03-25T05:37:25.912 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-25T05:37:25.913 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-25T05:37:25.917 INFO:tasks.ceph.mds.b:Started 2024-03-25T05:37:25.917 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-25T05:37:25.917 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-25T05:37:25.919 INFO:tasks.ceph.mds.d:Started 2024-03-25T05:37:25.919 INFO:tasks.ceph.mds.f:Restarting daemon 2024-03-25T05:37:25.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-03-25T05:37:25.922 INFO:tasks.ceph.mds.f:Started 2024-03-25T05:37:25.922 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-25T05:37:25.922 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:26.002 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-03-25T05:37:26.002 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-03-25T05:37:26.003 INFO:tasks.ceph.mds.f.smithi187.stdout:starting mds.f at 2024-03-25T05:37:26.054 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2024-03-25T05:37:26.056 INFO:tasks.ceph.mds.e.smithi102.stdout:starting mds.e at 2024-03-25T05:37:26.063 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2024-03-25T05:37:26.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.112+0000 7f0652c00640 1 Processor -- start 2024-03-25T05:37:26.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.113+0000 7f0652c00640 1 -- start start 2024-03-25T05:37:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f0652c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f064c0c5940 0x7f064c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f0652c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0c6240 0x7f064c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f0652c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0caa10 con 0x7f064c0cfcc0 2024-03-25T05:37:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f0652c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c15a060 con 0x7f064c0c5940 2024-03-25T05:37:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f0652c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c15a340 con 0x7f064c0c6240 2024-03-25T05:37:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f064be00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f064c0c5940 0x7f064c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f064be00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f064c0c5940 0x7f064c0ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56830/0 (socket says 172.21.15.102:56830) 2024-03-25T05:37:26.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f064be00640 1 -- 172.21.15.102:0/1673536163 learned_addr learned my addr 172.21.15.102:0/1673536163 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:26.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f0643400640 1 --2- 172.21.15.102:0/1673536163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0c6240 0x7f064c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f064be00640 1 -- 172.21.15.102:0/1673536163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0c6240 msgr2=0x7f064c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:26.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f064be00640 1 --2- 172.21.15.102:0/1673536163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0c6240 0x7f064c0cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f064be00640 1 -- 172.21.15.102:0/1673536163 >> v1:172.21.15.187:6789/0 conn(0x7f064c0cfcc0 legacy=0x7f064c0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.114+0000 7f064be00640 1 -- 172.21.15.102:0/1673536163 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c15a620 con 0x7f064c0c5940 2024-03-25T05:37:26.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.115+0000 7f064be00640 1 --2- 172.21.15.102:0/1673536163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c5940 0x7f064c0ca4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e14e1882172cdf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f064b400640 1 -- 172.21.15.102:0/1673536163 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c030840 con 0x7f064c0c5940 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f064b400640 1 -- 172.21.15.102:0/1673536163 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c0309a0 con 0x7f064c0c5940 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f064b400640 1 -- 172.21.15.102:0/1673536163 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c030d30 con 0x7f064c0c5940 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 -- 172.21.15.102:0/1673536163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c5940 msgr2=0x7f064c0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 --2- 172.21.15.102:0/1673536163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c5940 0x7f064c0ca4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c02b980 comp rx=0 tx=0).stop 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 -- 172.21.15.102:0/1673536163 shutdown_connections 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 --2- 172.21.15.102:0/1673536163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0c6240 0x7f064c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 --2- 172.21.15.102:0/1673536163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c5940 0x7f064c0ca4d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 -- 172.21.15.102:0/1673536163 >> 172.21.15.102:0/1673536163 conn(0x7f064c0728c0 msgr2=0x7f064c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 -- 172.21.15.102:0/1673536163 shutdown_connections 2024-03-25T05:37:26.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.116+0000 7f0652c00640 1 -- 172.21.15.102:0/1673536163 wait complete. 2024-03-25T05:37:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.118+0000 7f0652c00640 1 Processor -- start 2024-03-25T05:37:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.118+0000 7f0652c00640 1 -- start start 2024-03-25T05:37:26.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0652c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c0c5940 0x7f064c1f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0652c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c6240 0x7f064c1e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0652c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0cfcc0 0x7f064c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0652c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1f0580 con 0x7f064c0c6240 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0652c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1e3260 con 0x7f064c0c5940 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0652c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1e4280 con 0x7f064c0cfcc0 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c6240 0x7f064c1e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c6240 0x7f064c1e2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56834/0 (socket says 172.21.15.102:56834) 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 -- 172.21.15.102:0/2346343699 learned_addr learned my addr 172.21.15.102:0/2346343699 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f064be00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c0c5940 0x7f064c1f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0650c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0cfcc0 0x7f064c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 -- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0cfcc0 msgr2=0x7f064c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0cfcc0 0x7f064c0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 -- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c0c5940 msgr2=0x7f064c1f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c0c5940 0x7f064c1f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.119+0000 7f0643400640 1 -- 172.21.15.102:0/2346343699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0094d0 con 0x7f064c0c6240 2024-03-25T05:37:26.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.120+0000 7f0643400640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c6240 0x7f064c1e2d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f063400e9b0 tx=0x7f063400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.120+0000 7f0648c00640 1 -- 172.21.15.102:0/2346343699 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634009670 con 0x7f064c0c6240 2024-03-25T05:37:26.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.120+0000 7f0648c00640 1 -- 172.21.15.102:0/2346343699 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400c9a0 con 0x7f064c0c6240 2024-03-25T05:37:26.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.120+0000 7f0648c00640 1 -- 172.21.15.102:0/2346343699 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400cd50 con 0x7f064c0c6240 2024-03-25T05:37:26.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.120+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0c5ea0 con 0x7f064c0c6240 2024-03-25T05:37:26.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.120+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c1e3fa0 con 0x7f064c0c6240 2024-03-25T05:37:26.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.121+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c067fb0 con 0x7f064c0c6240 2024-03-25T05:37:26.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.122+0000 7f0648c00640 1 -- 172.21.15.102:0/2346343699 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f0634013470 con 0x7f064c0c6240 2024-03-25T05:37:26.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.124+0000 7f0648c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f062806b780 0x7f062806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.124+0000 7f0648c00640 1 -- 172.21.15.102:0/2346343699 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f0634089f90 con 0x7f064c0c6240 2024-03-25T05:37:26.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.124+0000 7f064be00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f062806b780 0x7f062806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.125+0000 7f064be00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f062806b780 0x7f062806dc40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f063c036000 tx=0x7f063c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.129+0000 7f0648c00640 1 -- 172.21.15.102:0/2346343699 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0634054e00 con 0x7f064c0c6240 2024-03-25T05:37:26.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.328+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f064c0cafd0 con 0x7f064c0c6240 2024-03-25T05:37:26.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.331+0000 7f0648c00640 1 -- 172.21.15.102:0/2346343699 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12924 (secure 0 0 0) 0x7f0634017090 con 0x7f064c0c6240 2024-03-25T05:37:26.325 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:26.325 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":14,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:25.864676+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f062806b780 msgr2=0x7f062806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f062806b780 0x7f062806dc40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f063c036000 tx=0x7f063c008030 comp rx=0 tx=0).stop 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c6240 msgr2=0x7f064c1e2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c6240 0x7f064c1e2d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f063400e9b0 tx=0x7f063400ee70 comp rx=0 tx=0).stop 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 shutdown_connections 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f062806b780 0x7f062806dc40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0cfcc0 0x7f064c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c0c6240 0x7f064c1e2d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 --2- 172.21.15.102:0/2346343699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c0c5940 0x7f064c1f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 >> 172.21.15.102:0/2346343699 conn(0x7f064c0728c0 msgr2=0x7f064c1588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 shutdown_connections 2024-03-25T05:37:26.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.334+0000 7f0652c00640 1 -- 172.21.15.102:0/2346343699 wait complete. 2024-03-25T05:37:26.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T05:37:25.079908+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-25T05:37:26.346 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-25T05:37:26.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.548+0000 7fc526200640 1 Processor -- start 2024-03-25T05:37:26.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.548+0000 7fc526200640 1 -- start start 2024-03-25T05:37:26.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.549+0000 7fc526200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc526200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5200c2420 0x7fc5201513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc526200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52015af20 con 0x7fc5200c3010 2024-03-25T05:37:26.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc526200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200c81e0 con 0x7fc5200c2420 2024-03-25T05:37:26.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc526200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52015b190 con 0x7fc5200c33f0 2024-03-25T05:37:26.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc525800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5200c2420 0x7fc5201513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc51fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc524e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc5200c3010 0x7fc520158310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37392/0 (socket says 172.21.15.102:37392) 2024-03-25T05:37:26.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc524e00640 1 -- 172.21.15.102:0/170707761 learned_addr learned my addr 172.21.15.102:0/170707761 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc525800640 1 -- 172.21.15.102:0/170707761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 msgr2=0x7fc5200c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc525800640 1 --2- 172.21.15.102:0/170707761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc525800640 1 -- 172.21.15.102:0/170707761 >> v1:172.21.15.102:6789/0 conn(0x7fc5200c3010 legacy=0x7fc520158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc525800640 1 -- 172.21.15.102:0/170707761 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52015b470 con 0x7fc5200c2420 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.550+0000 7fc51fe00640 1 --2- 172.21.15.102:0/170707761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.551+0000 7fc525800640 1 --2- 172.21.15.102:0/170707761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201513b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc518009d90 tx=0x7fc51802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af0822f3c2608a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc51f400640 1 -- 172.21.15.102:0/170707761 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51802cce0 con 0x7fc5200c2420 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc51f400640 1 -- 172.21.15.102:0/170707761 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51802ce40 con 0x7fc5200c2420 2024-03-25T05:37:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc51f400640 1 -- 172.21.15.102:0/170707761 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518034660 con 0x7fc5200c2420 2024-03-25T05:37:26.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 -- 172.21.15.102:0/170707761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 msgr2=0x7fc5201513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 --2- 172.21.15.102:0/170707761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201513b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc518009d90 tx=0x7fc51802bf30 comp rx=0 tx=0).stop 2024-03-25T05:37:26.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 -- 172.21.15.102:0/170707761 shutdown_connections 2024-03-25T05:37:26.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 --2- 172.21.15.102:0/170707761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201513b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 --2- 172.21.15.102:0/170707761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 -- 172.21.15.102:0/170707761 >> 172.21.15.102:0/170707761 conn(0x7fc520070ad0 msgr2=0x7fc520070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:26.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 -- 172.21.15.102:0/170707761 shutdown_connections 2024-03-25T05:37:26.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.552+0000 7fc526200640 1 -- 172.21.15.102:0/170707761 wait complete. 2024-03-25T05:37:26.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.554+0000 7fc526200640 1 Processor -- start 2024-03-25T05:37:26.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.554+0000 7fc526200640 1 -- start start 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc526200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc526200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5200c3010 0x7fc5201ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc526200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc526200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5201f3920 con 0x7fc5200c2420 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc526200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52015a070 con 0x7fc5200c3010 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc526200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200cbc60 con 0x7fc5200c33f0 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc524e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc524e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201ef450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56850/0 (socket says 172.21.15.102:56850) 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc524e00640 1 -- 172.21.15.102:0/2567412289 learned_addr learned my addr 172.21.15.102:0/2567412289 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc51fe00640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5200c3010 0x7fc5201ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.555+0000 7fc525800640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc524e00640 1 -- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 msgr2=0x7fc5200c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc524e00640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc524e00640 1 -- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5200c3010 msgr2=0x7fc5201ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc524e00640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5200c3010 0x7fc5201ef990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc524e00640 1 -- 172.21.15.102:0/2567412289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c009400 con 0x7fc5200c2420 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc524e00640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201ef450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc51400c400 tx=0x7fc51400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc51cc00640 1 -- 172.21.15.102:0/2567412289 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514005ce0 con 0x7fc5200c2420 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc51cc00640 1 -- 172.21.15.102:0/2567412289 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514005e40 con 0x7fc5200c2420 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc518009a70 con 0x7fc5200c2420 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc51cc00640 1 -- 172.21.15.102:0/2567412289 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5140072f0 con 0x7fc5200c2420 2024-03-25T05:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.556+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52015bdf0 con 0x7fc5200c2420 2024-03-25T05:37:26.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.557+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52004f2f0 con 0x7fc5200c2420 2024-03-25T05:37:26.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.558+0000 7fc51cc00640 1 -- 172.21.15.102:0/2567412289 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fc514007510 con 0x7fc5200c2420 2024-03-25T05:37:26.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.559+0000 7fc51cc00640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc50006b780 0x7fc50006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.559+0000 7fc51cc00640 1 -- 172.21.15.102:0/2567412289 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4846+0+0 (secure 0 0 0) 0x7fc514089280 con 0x7fc5200c2420 2024-03-25T05:37:26.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.559+0000 7fc51fe00640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc50006b780 0x7fc50006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.560+0000 7fc51fe00640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc50006b780 0x7fc50006dc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc5200cbae0 tx=0x7fc50c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.564+0000 7fc51cc00640 1 -- 172.21.15.102:0/2567412289 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc514054180 con 0x7fc5200c2420 2024-03-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.760+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc52014f640 con 0x7fc5200c2420 2024-03-25T05:37:26.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.760+0000 7fc51cc00640 1 -- 172.21.15.102:0/2567412289 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v14) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc514017020 con 0x7fc5200c2420 2024-03-25T05:37:26.755 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc50006b780 msgr2=0x7fc50006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc50006b780 0x7fc50006dc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc5200cbae0 tx=0x7fc50c009190 comp rx=0 tx=0).stop 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 msgr2=0x7fc5201ef450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201ef450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc51400c400 tx=0x7fc51400c8c0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 shutdown_connections 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc50006b780 0x7fc50006dc40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5200c33f0 0x7fc5200c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5200c3010 0x7fc5201ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 --2- 172.21.15.102:0/2567412289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5200c2420 0x7fc5201ef450 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 >> 172.21.15.102:0/2567412289 conn(0x7fc520070ad0 msgr2=0x7fc52014da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 shutdown_connections 2024-03-25T05:37:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.763+0000 7fc526200640 1 -- 172.21.15.102:0/2567412289 wait complete. 2024-03-25T05:37:26.776 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T05:37:26.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.987+0000 7facc4000640 1 Processor -- start 2024-03-25T05:37:26.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.987+0000 7facc4000640 1 -- start start 2024-03-25T05:37:26.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.988+0000 7facc4000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7facbc0c2ee0 0x7facbc15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.988+0000 7facc4000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc0733b0 con 0x7facbc150db0 2024-03-25T05:37:26.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facc4000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc072830 con 0x7facbc06f700 2024-03-25T05:37:26.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facc4000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0c37a0 con 0x7facbc0c2ee0 2024-03-25T05:37:26.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facc1600640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7facbc150db0 0x7facbc071c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37408/0 (socket says 172.21.15.102:37408) 2024-03-25T05:37:26.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facc1600640 1 -- 172.21.15.102:0/3167940091 learned_addr learned my addr 172.21.15.102:0/3167940091 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:26.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facc2000640 1 --2- 172.21.15.102:0/3167940091 >> v2:172.21.15.102:3300/0 conn(0x7facbc0c2ee0 0x7facbc15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facbbe00640 1 -- 172.21.15.102:0/3167940091 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973800478 0 0) 0x7facbc0733b0 con 0x7facbc150db0 2024-03-25T05:37:26.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facbbe00640 1 -- 172.21.15.102:0/3167940091 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca4005730 con 0x7facbc150db0 2024-03-25T05:37:26.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facbbe00640 1 -- 172.21.15.102:0/3167940091 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096053963 0 0) 0x7facbc072830 con 0x7facbc06f700 2024-03-25T05:37:26.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.989+0000 7facbbe00640 1 -- 172.21.15.102:0/3167940091 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facbc0733b0 con 0x7facbc06f700 2024-03-25T05:37:26.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.990+0000 7facc2000640 1 -- 172.21.15.102:0/3167940091 >> v1:172.21.15.187:6789/0 conn(0x7facbc06f700 legacy=0x7facbc0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.990+0000 7facc2000640 1 -- 172.21.15.102:0/3167940091 >> v1:172.21.15.102:6789/0 conn(0x7facbc150db0 legacy=0x7facbc071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.990+0000 7facc2000640 1 -- 172.21.15.102:0/3167940091 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc072b10 con 0x7facbc0c2ee0 2024-03-25T05:37:26.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.991+0000 7facc2000640 1 --2- 172.21.15.102:0/3167940091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc0c2ee0 0x7facbc15a6a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7facb4009d90 tx=0x7facb402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7087fec99eb27e6b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.991+0000 7facbbe00640 1 -- 172.21.15.102:0/3167940091 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb402cc60 con 0x7facbc0c2ee0 2024-03-25T05:37:26.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.991+0000 7facbbe00640 1 -- 172.21.15.102:0/3167940091 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb402cdc0 con 0x7facbc0c2ee0 2024-03-25T05:37:26.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.991+0000 7facbbe00640 1 -- 172.21.15.102:0/3167940091 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4034660 con 0x7facbc0c2ee0 2024-03-25T05:37:26.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.992+0000 7facc4000640 1 -- 172.21.15.102:0/3167940091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc0c2ee0 msgr2=0x7facbc15a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.992+0000 7facc4000640 1 --2- 172.21.15.102:0/3167940091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc0c2ee0 0x7facbc15a6a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7facb4009d90 tx=0x7facb402beb0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.992+0000 7facc4000640 1 -- 172.21.15.102:0/3167940091 shutdown_connections 2024-03-25T05:37:26.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.992+0000 7facc4000640 1 --2- 172.21.15.102:0/3167940091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc0c2ee0 0x7facbc15a6a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.992+0000 7facc4000640 1 -- 172.21.15.102:0/3167940091 >> 172.21.15.102:0/3167940091 conn(0x7facbc0c7dd0 msgr2=0x7facbc0c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:26.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.992+0000 7facc4000640 1 -- 172.21.15.102:0/3167940091 shutdown_connections 2024-03-25T05:37:26.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.992+0000 7facc4000640 1 -- 172.21.15.102:0/3167940091 wait complete. 2024-03-25T05:37:26.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.994+0000 7facc4000640 1 Processor -- start 2024-03-25T05:37:26.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.994+0000 7facc4000640 1 -- start start 2024-03-25T05:37:26.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc4000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facbc06f700 0x7facbc14b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc4000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facbc0c2ee0 0x7facbc14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc4000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc150db0 0x7facbc1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc4000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc149480 con 0x7facbc150db0 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc4000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc148be0 con 0x7facbc06f700 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc4000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc148ec0 con 0x7facbc0c2ee0 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc150db0 0x7facbc1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc150db0 0x7facbc1595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56860/0 (socket says 172.21.15.102:56860) 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 -- 172.21.15.102:0/3481040830 learned_addr learned my addr 172.21.15.102:0/3481040830 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc1600640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facbc06f700 0x7facbc14b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc0c00640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facbc0c2ee0 0x7facbc14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 -- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facbc0c2ee0 msgr2=0x7facbc14bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facbc0c2ee0 0x7facbc14bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 -- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facbc06f700 msgr2=0x7facbc14b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:26.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facbc06f700 0x7facbc14b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc2000640 1 -- 172.21.15.102:0/3481040830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009a70 con 0x7facbc150db0 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.995+0000 7facc0c00640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facbc0c2ee0 0x7facbc14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.996+0000 7facc2000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc150db0 0x7facbc1595b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7facb4009d90 tx=0x7facb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.996+0000 7facb9600640 1 -- 172.21.15.102:0/3481040830 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4040650 con 0x7facbc150db0 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.996+0000 7facb9600640 1 -- 172.21.15.102:0/3481040830 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40407b0 con 0x7facbc150db0 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.996+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc1491a0 con 0x7facbc150db0 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.996+0000 7facb9600640 1 -- 172.21.15.102:0/3481040830 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4040b60 con 0x7facbc150db0 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.996+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc14b460 con 0x7facbc150db0 2024-03-25T05:37:26.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.998+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc14afe0 con 0x7facbc150db0 2024-03-25T05:37:26.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:26.998+0000 7facb9600640 1 -- 172.21.15.102:0/3481040830 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7facb4040cc0 con 0x7facbc150db0 2024-03-25T05:37:26.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.000+0000 7facb9600640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fac9c06b780 0x7fac9c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:26.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.000+0000 7facb9600640 1 -- 172.21.15.102:0/3481040830 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facb40aca20 con 0x7facbc150db0 2024-03-25T05:37:26.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.000+0000 7facc1600640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fac9c06b780 0x7fac9c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:26.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.001+0000 7facc1600640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fac9c06b780 0x7fac9c06dc40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7facb0000f60 tx=0x7facb0007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.004+0000 7facb9600640 1 -- 172.21.15.102:0/3481040830 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7facbc14afe0 con 0x7facbc150db0 2024-03-25T05:37:27.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.269+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facbc14afe0 con 0x7facbc150db0 2024-03-25T05:37:27.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.270+0000 7facb9600640 1 -- 172.21.15.102:0/3481040830 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5292 (secure 0 0 0) 0x7facbc14afe0 con 0x7facbc150db0 2024-03-25T05:37:27.265 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:27.265 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4291,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-25T05:37:27.265 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 3 2024-03-25T05:37:27.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fac9c06b780 msgr2=0x7fac9c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fac9c06b780 0x7fac9c06dc40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7facb0000f60 tx=0x7facb0007d70 comp rx=0 tx=0).stop 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc150db0 msgr2=0x7facbc1595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc150db0 0x7facbc1595b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7facb4009d90 tx=0x7facb4004a40 comp rx=0 tx=0).stop 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 shutdown_connections 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fac9c06b780 0x7fac9c06dc40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facbc150db0 0x7facbc1595b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facbc0c2ee0 0x7facbc14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 --2- 172.21.15.102:0/3481040830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facbc06f700 0x7facbc14b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 >> 172.21.15.102:0/3481040830 conn(0x7facbc0c7dd0 msgr2=0x7facbc0c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 shutdown_connections 2024-03-25T05:37:27.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.273+0000 7facc4000640 1 -- 172.21.15.102:0/3481040830 wait complete. 2024-03-25T05:37:27.283 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:27.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.465+0000 7f4adfc00640 1 Processor -- start 2024-03-25T05:37:27.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.465+0000 7f4adfc00640 1 -- start start 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.466+0000 7f4adfc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c5940 0x7f4ad80ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.466+0000 7f4adfc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4ad80c7940 0x7f4ad80c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.466+0000 7f4adfc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad80c8310 con 0x7f4ad80c6240 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.466+0000 7f4adfc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad80caa10 con 0x7f4ad80c7940 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.466+0000 7f4adfc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad815a060 con 0x7f4ad80c5940 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4add200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c5940 0x7f4ad80ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4addc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4ad80c7940 0x7f4ad80c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4ad7e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4ad80c6240 0x7f4ad80cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:33300/0 (socket says 172.21.15.102:33300) 2024-03-25T05:37:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4ad7e00640 1 -- 172.21.15.102:0/583012573 learned_addr learned my addr 172.21.15.102:0/583012573 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:27.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4ad7400640 1 -- 172.21.15.102:0/583012573 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285602122 0 0) 0x7f4ad80c8310 con 0x7f4ad80c6240 2024-03-25T05:37:27.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4add200640 1 -- 172.21.15.102:0/583012573 >> v2:172.21.15.102:3300/0 conn(0x7f4ad80c7940 msgr2=0x7f4ad80c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:27.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4add200640 1 --2- 172.21.15.102:0/583012573 >> v2:172.21.15.102:3300/0 conn(0x7f4ad80c7940 0x7f4ad80c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4add200640 1 -- 172.21.15.102:0/583012573 >> v1:172.21.15.187:6789/0 conn(0x7f4ad80c6240 legacy=0x7f4ad80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4add200640 1 -- 172.21.15.102:0/583012573 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad815a340 con 0x7f4ad80c5940 2024-03-25T05:37:27.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.467+0000 7f4addc00640 1 --2- 172.21.15.102:0/583012573 >> v2:172.21.15.102:3300/0 conn(0x7f4ad80c7940 0x7f4ad80c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.469+0000 7f4add200640 1 --2- 172.21.15.102:0/583012573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c5940 0x7f4ad80ca4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0097a0 tx=0x7f4acc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f6aae420c037d23 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.469+0000 7f4ad7400640 1 -- 172.21.15.102:0/583012573 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc02d040 con 0x7f4ad80c5940 2024-03-25T05:37:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.469+0000 7f4ad7400640 1 -- 172.21.15.102:0/583012573 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc031810 con 0x7f4ad80c5940 2024-03-25T05:37:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.469+0000 7f4ad7400640 1 -- 172.21.15.102:0/583012573 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc031ba0 con 0x7f4ad80c5940 2024-03-25T05:37:27.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 -- 172.21.15.102:0/583012573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c5940 msgr2=0x7f4ad80ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 --2- 172.21.15.102:0/583012573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c5940 0x7f4ad80ca4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0097a0 tx=0x7f4acc02b8b0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 -- 172.21.15.102:0/583012573 shutdown_connections 2024-03-25T05:37:27.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 --2- 172.21.15.102:0/583012573 >> v2:172.21.15.102:3300/0 conn(0x7f4ad80c7940 0x7f4ad80c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 --2- 172.21.15.102:0/583012573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c5940 0x7f4ad80ca4d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 -- 172.21.15.102:0/583012573 >> 172.21.15.102:0/583012573 conn(0x7f4ad80728c0 msgr2=0x7f4ad806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:27.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 -- 172.21.15.102:0/583012573 shutdown_connections 2024-03-25T05:37:27.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.470+0000 7f4adfc00640 1 -- 172.21.15.102:0/583012573 wait complete. 2024-03-25T05:37:27.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.472+0000 7f4adfc00640 1 Processor -- start 2024-03-25T05:37:27.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.472+0000 7f4adfc00640 1 -- start start 2024-03-25T05:37:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4adfc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad80c5940 0x7f4ad80b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4adfc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad80c6240 0x7f4ad80ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4adfc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c7940 0x7f4ad80cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4adfc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad81e6cf0 con 0x7f4ad80c5940 2024-03-25T05:37:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4adfc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad81f0a70 con 0x7f4ad80c6240 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4adfc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad81e2f60 con 0x7f4ad80c7940 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4add200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad80c5940 0x7f4ad80b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4add200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad80c5940 0x7f4ad80b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56882/0 (socket says 172.21.15.102:56882) 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4addc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c7940 0x7f4ad80cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4add200640 1 -- 172.21.15.102:0/4085076711 learned_addr learned my addr 172.21.15.102:0/4085076711 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4ad7e00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad80c6240 0x7f4ad80ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4addc00640 1 -- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad80c6240 msgr2=0x7f4ad80ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4addc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad80c6240 0x7f4ad80ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4addc00640 1 -- 172.21.15.102:0/4085076711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad80c5940 msgr2=0x7f4ad80b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4addc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad80c5940 0x7f4ad80b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.473+0000 7f4addc00640 1 -- 172.21.15.102:0/4085076711 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009a70 con 0x7f4ad80c7940 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.474+0000 7f4addc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c7940 0x7f4ad80cec90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000efc0 tx=0x7f4ad000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.474+0000 7f4ad4c00640 1 -- 172.21.15.102:0/4085076711 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000cd30 con 0x7f4ad80c7940 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.474+0000 7f4ad4c00640 1 -- 172.21.15.102:0/4085076711 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad000f040 con 0x7f4ad80c7940 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.474+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc009400 con 0x7f4ad80c7940 2024-03-25T05:37:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.474+0000 7f4ad4c00640 1 -- 172.21.15.102:0/4085076711 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0003bd0 con 0x7f4ad80c7940 2024-03-25T05:37:27.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.474+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad81e3200 con 0x7f4ad80c7940 2024-03-25T05:37:27.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.475+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad81f0c20 con 0x7f4ad80c7940 2024-03-25T05:37:27.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.476+0000 7f4ad4c00640 1 -- 172.21.15.102:0/4085076711 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f4ad0014480 con 0x7f4ad80c7940 2024-03-25T05:37:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.477+0000 7f4ad4c00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ab806b7b0 0x7f4ab806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.477+0000 7f4ad4c00640 1 -- 172.21.15.102:0/4085076711 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ad008a7b0 con 0x7f4ad80c7940 2024-03-25T05:37:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.477+0000 7f4add200640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ab806b7b0 0x7f4ab806dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.478+0000 7f4add200640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ab806b7b0 0x7f4ab806dc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4acc02b8f0 tx=0x7f4acc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:27.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.481+0000 7f4ad4c00640 1 -- 172.21.15.102:0/4085076711 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4ad81f0c20 con 0x7f4ad80c7940 2024-03-25T05:37:27.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.685+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad81f0c20 con 0x7f4ad80c7940 2024-03-25T05:37:27.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.686+0000 7f4ad4c00640 1 -- 172.21.15.102:0/4085076711 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12933 (secure 0 0 0) 0x7f4ad81f0c20 con 0x7f4ad80c7940 2024-03-25T05:37:27.680 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:27.680 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:26.873430+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ab806b7b0 msgr2=0x7f4ab806dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ab806b7b0 0x7f4ab806dc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4acc02b8f0 tx=0x7f4acc03d040 comp rx=0 tx=0).stop 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c7940 msgr2=0x7f4ad80cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c7940 0x7f4ad80cec90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000efc0 tx=0x7f4ad000c490 comp rx=0 tx=0).stop 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 shutdown_connections 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ab806b7b0 0x7f4ab806dc70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad80c7940 0x7f4ad80cec90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad80c6240 0x7f4ad80ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 --2- 172.21.15.102:0/4085076711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad80c5940 0x7f4ad80b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 >> 172.21.15.102:0/4085076711 conn(0x7f4ad80728c0 msgr2=0x7f4ad80b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 shutdown_connections 2024-03-25T05:37:27.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.688+0000 7f4adfc00640 1 -- 172.21.15.102:0/4085076711 wait complete. 2024-03-25T05:37:27.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T05:37:25.079908+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-25T05:37:27.699 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-25T05:37:27.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.883+0000 7f2816e00640 1 Processor -- start 2024-03-25T05:37:27.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.883+0000 7f2816e00640 1 -- start start 2024-03-25T05:37:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f2816e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28100c5a50 0x7f28100cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f2816e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28100c4e20 con 0x7f28100cb1e0 2024-03-25T05:37:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f2816e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281015d4a0 con 0x7f28100ca630 2024-03-25T05:37:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f2816e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281015e120 con 0x7f28100c5a50 2024-03-25T05:37:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280fe00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f28100cb1e0 0x7f28100c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37420/0 (socket says 172.21.15.102:37420) 2024-03-25T05:37:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280fe00640 1 -- 172.21.15.102:0/419891537 learned_addr learned my addr 172.21.15.102:0/419891537 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280f400640 1 --2- 172.21.15.102:0/419891537 >> v2:172.21.15.187:3300/0 conn(0x7f28100c5a50 0x7f28100cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280ea00640 1 -- 172.21.15.102:0/419891537 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268411522 0 0) 0x7f28100c4e20 con 0x7f28100cb1e0 2024-03-25T05:37:27.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280ea00640 1 -- 172.21.15.102:0/419891537 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f4003520 con 0x7f28100cb1e0 2024-03-25T05:37:27.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280f400640 1 -- 172.21.15.102:0/419891537 >> v1:172.21.15.187:6789/0 conn(0x7f28100ca630 legacy=0x7f2810164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280f400640 1 -- 172.21.15.102:0/419891537 >> v1:172.21.15.102:6789/0 conn(0x7f28100cb1e0 legacy=0x7f28100c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.885+0000 7f280f400640 1 -- 172.21.15.102:0/419891537 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281015d780 con 0x7f28100c5a50 2024-03-25T05:37:27.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.887+0000 7f280f400640 1 --2- 172.21.15.102:0/419891537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100c5a50 0x7f28100cb5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0097a0 tx=0x7f27fc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6b3b864a75172bc server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:27.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.887+0000 7f280ea00640 1 -- 172.21.15.102:0/419891537 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc031830 con 0x7f28100c5a50 2024-03-25T05:37:27.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.887+0000 7f280ea00640 1 -- 172.21.15.102:0/419891537 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc031990 con 0x7f28100c5a50 2024-03-25T05:37:27.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.887+0000 7f280ea00640 1 -- 172.21.15.102:0/419891537 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc031d20 con 0x7f28100c5a50 2024-03-25T05:37:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.887+0000 7f2816e00640 1 -- 172.21.15.102:0/419891537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100c5a50 msgr2=0x7f28100cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.887+0000 7f2816e00640 1 --2- 172.21.15.102:0/419891537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100c5a50 0x7f28100cb5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0097a0 tx=0x7f27fc02b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.888+0000 7f2816e00640 1 -- 172.21.15.102:0/419891537 shutdown_connections 2024-03-25T05:37:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.888+0000 7f2816e00640 1 --2- 172.21.15.102:0/419891537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100c5a50 0x7f28100cb5c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.888+0000 7f2816e00640 1 -- 172.21.15.102:0/419891537 >> 172.21.15.102:0/419891537 conn(0x7f2810066cc0 msgr2=0x7f28100670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.888+0000 7f2816e00640 1 -- 172.21.15.102:0/419891537 shutdown_connections 2024-03-25T05:37:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.888+0000 7f2816e00640 1 -- 172.21.15.102:0/419891537 wait complete. 2024-03-25T05:37:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.889+0000 7f2816e00640 1 Processor -- start 2024-03-25T05:37:27.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.890+0000 7f2816e00640 1 -- start start 2024-03-25T05:37:27.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.890+0000 7f2816e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28100c5a50 0x7f2810146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.890+0000 7f2816e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100ca630 0x7f2810149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.890+0000 7f2816e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28100cb1e0 0x7f28101432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.890+0000 7f2816e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2810145b80 con 0x7f28100cb1e0 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.890+0000 7f2816e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101449b0 con 0x7f28100ca630 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f2816e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28100b3bb0 con 0x7f28100c5a50 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28100c5a50 0x7f2810146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100ca630 0x7f2810149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f2814e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28100cb1e0 0x7f28101432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100ca630 0x7f2810149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:39850/0 (socket says 172.21.15.102:39850) 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28100c5a50 0x7f2810146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:56766/0 (socket says 172.21.15.102:56766) 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 -- 172.21.15.102:0/1268394203 learned_addr learned my addr 172.21.15.102:0/1268394203 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 -- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28100c5a50 msgr2=0x7f2810146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28100c5a50 0x7f2810146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 -- 172.21.15.102:0/1268394203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28100cb1e0 msgr2=0x7f28101432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28100cb1e0 0x7f28101432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280f400640 1 -- 172.21.15.102:0/1268394203 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009400 con 0x7f28100ca630 2024-03-25T05:37:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f280fe00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28100c5a50 0x7f2810146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.891+0000 7f2814e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28100cb1e0 0x7f28101432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.892+0000 7f280f400640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100ca630 0x7f2810149ec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009890 tx=0x7f27fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.892+0000 7f2807e00640 1 -- 172.21.15.102:0/1268394203 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc03b980 con 0x7f28100ca630 2024-03-25T05:37:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.892+0000 7f2807e00640 1 -- 172.21.15.102:0/1268394203 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc03bb00 con 0x7f28100ca630 2024-03-25T05:37:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.892+0000 7f2807e00640 1 -- 172.21.15.102:0/1268394203 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc045400 con 0x7f28100ca630 2024-03-25T05:37:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.892+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28101451c0 con 0x7f28100ca630 2024-03-25T05:37:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.892+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2810144ee0 con 0x7f28100ca630 2024-03-25T05:37:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.893+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28100caab0 con 0x7f28100ca630 2024-03-25T05:37:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.894+0000 7f2807e00640 1 -- 172.21.15.102:0/1268394203 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f27fc04e430 con 0x7f28100ca630 2024-03-25T05:37:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.895+0000 7f2807e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f27f006b780 0x7f27f006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.895+0000 7f2807e00640 1 -- 172.21.15.102:0/1268394203 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27fc0abf40 con 0x7f28100ca630 2024-03-25T05:37:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.895+0000 7f280fe00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f27f006b780 0x7f27f006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.896+0000 7f280fe00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f27f006b780 0x7f27f006dc40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28000011e0 tx=0x7f2800007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:27.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:27.900+0000 7f2807e00640 1 -- 172.21.15.102:0/1268394203 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f27fc076da0 con 0x7f28100ca630 2024-03-25T05:37:28.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.097+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28100c4a00 con 0x7f28100ca630 2024-03-25T05:37:28.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.098+0000 7f2807e00640 1 -- 172.21.15.102:0/1268394203 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27fc07a460 con 0x7f28100ca630 2024-03-25T05:37:28.093 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.100+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f27f006b780 msgr2=0x7f27f006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.100+0000 7f2816e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f27f006b780 0x7f27f006dc40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28000011e0 tx=0x7f2800007d30 comp rx=0 tx=0).stop 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.100+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100ca630 msgr2=0x7f2810149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.100+0000 7f2816e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100ca630 0x7f2810149ec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009890 tx=0x7f27fc0046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 shutdown_connections 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f27f006b780 0x7f27f006dc40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28100cb1e0 0x7f28101432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28100ca630 0x7f2810149ec0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 --2- 172.21.15.102:0/1268394203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28100c5a50 0x7f2810146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 >> 172.21.15.102:0/1268394203 conn(0x7f2810066cc0 msgr2=0x7f28100c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:28.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 shutdown_connections 2024-03-25T05:37:28.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.101+0000 7f2816e00640 1 -- 172.21.15.102:0/1268394203 wait complete. 2024-03-25T05:37:28.111 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-25T05:37:28.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.293+0000 7f1926200640 1 Processor -- start 2024-03-25T05:37:28.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.293+0000 7f1926200640 1 -- start start 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f1926200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1920150db0 0x7f1920071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f1926200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f192006f700 0x7f1920072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f1926200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19200733b0 con 0x7f19200c27d0 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f1926200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19200c37a0 con 0x7f192006f700 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f1926200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19200c8aa0 con 0x7f1920150db0 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f191ea00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f192006f700 0x7f1920072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f191f400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1920150db0 0x7f1920071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f191ea00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f192006f700 0x7f1920072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56898/0 (socket says 172.21.15.102:56898) 2024-03-25T05:37:28.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.295+0000 7f191ea00640 1 -- 172.21.15.102:0/3805807834 learned_addr learned my addr 172.21.15.102:0/3805807834 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:28.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.296+0000 7f191ea00640 1 -- 172.21.15.102:0/3805807834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1920150db0 msgr2=0x7f1920071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:28.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.296+0000 7f191e000640 1 -- 172.21.15.102:0/3805807834 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707371402 0 0) 0x7f19200733b0 con 0x7f19200c27d0 2024-03-25T05:37:28.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.296+0000 7f191ea00640 1 --2- 172.21.15.102:0/3805807834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1920150db0 0x7f1920071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.296+0000 7f191ea00640 1 -- 172.21.15.102:0/3805807834 >> v1:172.21.15.187:6789/0 conn(0x7f19200c27d0 legacy=0x7f192015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.296+0000 7f191ea00640 1 -- 172.21.15.102:0/3805807834 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920072830 con 0x7f192006f700 2024-03-25T05:37:28.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.296+0000 7f191f400640 1 --2- 172.21.15.102:0/3805807834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1920150db0 0x7f1920071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:28.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.297+0000 7f191ea00640 1 --2- 172.21.15.102:0/3805807834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006f700 0x7f1920072160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f190c009870 tx=0x7f190c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd67a386e8a6bd35 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:28.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.297+0000 7f191e000640 1 -- 172.21.15.102:0/3805807834 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c031640 con 0x7f192006f700 2024-03-25T05:37:28.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.297+0000 7f191e000640 1 -- 172.21.15.102:0/3805807834 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c0317a0 con 0x7f192006f700 2024-03-25T05:37:28.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.297+0000 7f191e000640 1 -- 172.21.15.102:0/3805807834 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c031b30 con 0x7f192006f700 2024-03-25T05:37:28.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.297+0000 7f1926200640 1 -- 172.21.15.102:0/3805807834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006f700 msgr2=0x7f1920072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.297+0000 7f1926200640 1 --2- 172.21.15.102:0/3805807834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006f700 0x7f1920072160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f190c009870 tx=0x7f190c02b8f0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.298+0000 7f1926200640 1 -- 172.21.15.102:0/3805807834 shutdown_connections 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.298+0000 7f1926200640 1 --2- 172.21.15.102:0/3805807834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006f700 0x7f1920072160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.298+0000 7f1926200640 1 --2- 172.21.15.102:0/3805807834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1920150db0 0x7f1920071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.298+0000 7f1926200640 1 -- 172.21.15.102:0/3805807834 >> 172.21.15.102:0/3805807834 conn(0x7f19200c7dd0 msgr2=0x7f19200c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.298+0000 7f1926200640 1 -- 172.21.15.102:0/3805807834 shutdown_connections 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.298+0000 7f1926200640 1 -- 172.21.15.102:0/3805807834 wait complete. 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.299+0000 7f1926200640 1 Processor -- start 2024-03-25T05:37:28.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.299+0000 7f1926200640 1 -- start start 2024-03-25T05:37:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f1926200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f192006f700 0x7f19200ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f1926200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19200c27d0 0x7f19201ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f1926200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920150db0 0x7f1920142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f1926200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19201efcf0 con 0x7f1920150db0 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f1926200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19201ebae0 con 0x7f19200c27d0 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f1926200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1920159070 con 0x7f192006f700 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f191ea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19200c27d0 0x7f19201ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f191fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920150db0 0x7f1920142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f191f400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f192006f700 0x7f19200ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f191ea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19200c27d0 0x7f19201ebf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:39864/0 (socket says 172.21.15.102:39864) 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f191ea00640 1 -- 172.21.15.102:0/2910131476 learned_addr learned my addr 172.21.15.102:0/2910131476 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.300+0000 7f191f400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f192006f700 0x7f19200ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:56776/0 (socket says 172.21.15.102:56776) 2024-03-25T05:37:28.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191ea00640 1 -- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f192006f700 msgr2=0x7f19200ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191ea00640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f192006f700 0x7f19200ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191ea00640 1 -- 172.21.15.102:0/2910131476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920150db0 msgr2=0x7f1920142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191ea00640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920150db0 0x7f1920142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191ea00640 1 -- 172.21.15.102:0/2910131476 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191000d8a0 con 0x7f19200c27d0 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191f400640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f192006f700 0x7f19200ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191fe00640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920150db0 0x7f1920142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f191ea00640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19200c27d0 0x7f19201ebf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f190c000c00 tx=0x7f190c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f1917400640 1 -- 172.21.15.102:0/2910131476 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c004230 con 0x7f19200c27d0 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f1917400640 1 -- 172.21.15.102:0/2910131476 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c0043b0 con 0x7f19200c27d0 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f1917400640 1 -- 172.21.15.102:0/2910131476 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c004520 con 0x7f19200c27d0 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190c0094d0 con 0x7f19200c27d0 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.301+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192014c4e0 con 0x7f19200c27d0 2024-03-25T05:37:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.302+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1920067fb0 con 0x7f19200c27d0 2024-03-25T05:37:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.303+0000 7f1917400640 1 -- 172.21.15.102:0/2910131476 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f190c043070 con 0x7f19200c27d0 2024-03-25T05:37:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.304+0000 7f1917400640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f190006b780 0x7f190006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.304+0000 7f1917400640 1 -- 172.21.15.102:0/2910131476 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f190c0ab8d0 con 0x7f19200c27d0 2024-03-25T05:37:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.304+0000 7f191f400640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f190006b780 0x7f190006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.305+0000 7f191f400640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f190006b780 0x7f190006dc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1910013680 tx=0x7f191000f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:28.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.308+0000 7f1917400640 1 -- 172.21.15.102:0/2910131476 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f190c076730 con 0x7f19200c27d0 2024-03-25T05:37:28.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.509+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f19200c5690 con 0x7f19200c27d0 2024-03-25T05:37:28.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.510+0000 7f1917400640 1 -- 172.21.15.102:0/2910131476 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f190c035020 con 0x7f19200c27d0 2024-03-25T05:37:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:28.505 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2024-03-25T05:37:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-03-25T05:37:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2024-03-25T05:37:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2024-03-25T05:37:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-25T05:37:28.505 INFO:teuthology.orchestra.run.smithi102.stdout:] 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f190006b780 msgr2=0x7f190006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f190006b780 0x7f190006dc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1910013680 tx=0x7f191000f040 comp rx=0 tx=0).stop 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19200c27d0 msgr2=0x7f19201ebf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19200c27d0 0x7f19201ebf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f190c000c00 tx=0x7f190c0046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 shutdown_connections 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f190006b780 0x7f190006dc40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920150db0 0x7f1920142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19200c27d0 0x7f19201ebf00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 --2- 172.21.15.102:0/2910131476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f192006f700 0x7f19200ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 >> 172.21.15.102:0/2910131476 conn(0x7f19200c7dd0 msgr2=0x7f19200c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 shutdown_connections 2024-03-25T05:37:28.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.513+0000 7f1926200640 1 -- 172.21.15.102:0/2910131476 wait complete. 2024-03-25T05:37:28.525 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-25T05:37:28.525 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-25T05:37:28.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.739+0000 7f8c34c00640 1 Processor -- start 2024-03-25T05:37:28.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.740+0000 7f8c34c00640 1 -- start start 2024-03-25T05:37:28.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c34c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c30067770 0x7f8c300cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c34c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8c3015a1e0 0x7f8c3015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c34c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3015abb0 con 0x7f8c300cc0d0 2024-03-25T05:37:28.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c34c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c300cc9f0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c34c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3015d520 con 0x7f8c30067770 2024-03-25T05:37:28.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c2d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c30067770 0x7f8c300cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c2d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c30067770 0x7f8c300cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:56780/0 (socket says 172.21.15.102:56780) 2024-03-25T05:37:28.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c2d400640 1 -- 172.21.15.102:0/240950696 learned_addr learned my addr 172.21.15.102:0/240950696 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:28.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.741+0000 7f8c2e800640 1 --2- 172.21.15.102:0/240950696 >> v2:172.21.15.102:3300/0 conn(0x7f8c3015a1e0 0x7f8c3015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.742+0000 7f8c2d400640 1 -- 172.21.15.102:0/240950696 >> v2:172.21.15.102:3300/0 conn(0x7f8c3015a1e0 msgr2=0x7f8c3015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:28.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.742+0000 7f8c2d400640 1 --2- 172.21.15.102:0/240950696 >> v2:172.21.15.102:3300/0 conn(0x7f8c3015a1e0 0x7f8c3015a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.742+0000 7f8c2d400640 1 -- 172.21.15.102:0/240950696 >> v1:172.21.15.102:6789/0 conn(0x7f8c300cc0d0 legacy=0x7f8c300cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.742+0000 7f8c2d400640 1 -- 172.21.15.102:0/240950696 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3015d800 con 0x7f8c30067770 2024-03-25T05:37:28.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.743+0000 7f8c2d400640 1 --2- 172.21.15.102:0/240950696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c30067770 0x7f8c300cc4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009870 tx=0x7f8c1c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfd7e9519108ae3 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:28.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.743+0000 7f8c2ca00640 1 -- 172.21.15.102:0/240950696 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c030840 con 0x7f8c30067770 2024-03-25T05:37:28.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.743+0000 7f8c2ca00640 1 -- 172.21.15.102:0/240950696 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0309a0 con 0x7f8c30067770 2024-03-25T05:37:28.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.743+0000 7f8c2ca00640 1 -- 172.21.15.102:0/240950696 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c030d30 con 0x7f8c30067770 2024-03-25T05:37:28.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 -- 172.21.15.102:0/240950696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c30067770 msgr2=0x7f8c300cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 --2- 172.21.15.102:0/240950696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c30067770 0x7f8c300cc4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009870 tx=0x7f8c1c02b980 comp rx=0 tx=0).stop 2024-03-25T05:37:28.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 -- 172.21.15.102:0/240950696 shutdown_connections 2024-03-25T05:37:28.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 --2- 172.21.15.102:0/240950696 >> v2:172.21.15.102:3300/0 conn(0x7f8c3015a1e0 0x7f8c3015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 --2- 172.21.15.102:0/240950696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c30067770 0x7f8c300cc4b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 -- 172.21.15.102:0/240950696 >> 172.21.15.102:0/240950696 conn(0x7f8c300726e0 msgr2=0x7f8c30072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:28.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 -- 172.21.15.102:0/240950696 shutdown_connections 2024-03-25T05:37:28.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.744+0000 7f8c34c00640 1 -- 172.21.15.102:0/240950696 wait complete. 2024-03-25T05:37:28.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.746+0000 7f8c34c00640 1 Processor -- start 2024-03-25T05:37:28.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.746+0000 7f8c34c00640 1 -- start start 2024-03-25T05:37:28.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c34c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30067770 0x7f8c30155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c34c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c300cc0d0 0x7f8c301eff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c34c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c3015a1e0 0x7f8c30157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c34c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30154f50 con 0x7f8c300cc0d0 2024-03-25T05:37:28.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c34c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301f0490 con 0x7f8c30067770 2024-03-25T05:37:28.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c34c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300c8a30 con 0x7f8c3015a1e0 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c2d400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c300cc0d0 0x7f8c301eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c2de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30067770 0x7f8c30155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c2e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c3015a1e0 0x7f8c30157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c2e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c3015a1e0 0x7f8c30157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:56788/0 (socket says 172.21.15.102:56788) 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c2de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30067770 0x7f8c30155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:39872/0 (socket says 172.21.15.102:39872) 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.747+0000 7f8c2e800640 1 -- 172.21.15.102:0/3759310943 learned_addr learned my addr 172.21.15.102:0/3759310943 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c2e800640 1 -- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30067770 msgr2=0x7f8c30155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c2e800640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30067770 0x7f8c30155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c2e800640 1 -- 172.21.15.102:0/3759310943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c300cc0d0 msgr2=0x7f8c301eff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c2e800640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c300cc0d0 0x7f8c301eff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c2e800640 1 -- 172.21.15.102:0/3759310943 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0094d0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c2e800640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c3015a1e0 0x7f8c30157c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c28007e60 tx=0x7f8c2800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:28.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c26000640 1 -- 172.21.15.102:0/3759310943 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28014420 con 0x7f8c3015a1e0 2024-03-25T05:37:28.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c26000640 1 -- 172.21.15.102:0/3759310943 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c280145a0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c301581b0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c26000640 1 -- 172.21.15.102:0/3759310943 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28014950 con 0x7f8c3015a1e0 2024-03-25T05:37:28.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.748+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c301546f0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.749+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c300686c0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.750+0000 7f8c26000640 1 -- 172.21.15.102:0/3759310943 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f8c28014ab0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.751+0000 7f8c26000640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8c1006b780 0x7f8c1006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:28.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.751+0000 7f8c26000640 1 -- 172.21.15.102:0/3759310943 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8c2808a6a0 con 0x7f8c3015a1e0 2024-03-25T05:37:28.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.751+0000 7f8c2de00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8c1006b780 0x7f8c1006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:28.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.752+0000 7f8c2de00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8c1006b780 0x7f8c1006dc40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c20001780 tx=0x7f8c20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:28.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.755+0000 7f8c26000640 1 -- 172.21.15.102:0/3759310943 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8c28055470 con 0x7f8c3015a1e0 2024-03-25T05:37:28.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:28.955+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8c300c8b70 con 0x7f8c3015a1e0 2024-03-25T05:37:29.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.389+0000 7f8c26000640 1 -- 172.21.15.102:0/3759310943 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8c28058b30 con 0x7f8c3015a1e0 2024-03-25T05:37:29.383 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2024-03-25T05:37:29.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8c1006b780 msgr2=0x7f8c1006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:29.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8c1006b780 0x7f8c1006dc40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c20001780 tx=0x7f8c20009040 comp rx=0 tx=0).stop 2024-03-25T05:37:29.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c3015a1e0 msgr2=0x7f8c30157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:29.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c3015a1e0 0x7f8c30157c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c28007e60 tx=0x7f8c2800e4b0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 shutdown_connections 2024-03-25T05:37:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8c1006b780 0x7f8c1006dc40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c3015a1e0 0x7f8c30157c70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c300cc0d0 0x7f8c301eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 --2- 172.21.15.102:0/3759310943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30067770 0x7f8c30155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.395+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 >> 172.21.15.102:0/3759310943 conn(0x7f8c300726e0 msgr2=0x7f8c300ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:29.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.397+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 shutdown_connections 2024-03-25T05:37:29.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.397+0000 7f8c34c00640 1 -- 172.21.15.102:0/3759310943 wait complete. 2024-03-25T05:37:29.416 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-25T05:37:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.626+0000 7f35b1200640 1 Processor -- start 2024-03-25T05:37:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.626+0000 7f35b1200640 1 -- start start 2024-03-25T05:37:29.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.627+0000 7f35b1200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35ac0c49f0 0x7f35ac0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:29.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.627+0000 7f35b1200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f35ac0cb210 0x7f35ac159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:29.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.627+0000 7f35b1200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac0b2b60 con 0x7f35ac154180 2024-03-25T05:37:29.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.627+0000 7f35b1200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0cbe30 con 0x7f35ac0c49f0 2024-03-25T05:37:29.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.627+0000 7f35b1200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0c5b50 con 0x7f35ac0cb210 2024-03-25T05:37:29.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a3e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35ac0c49f0 0x7f35ac0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:29.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a9e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f35ac154180 0x7f35ac0ca0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37442/0 (socket says 172.21.15.102:37442) 2024-03-25T05:37:29.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a3e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35ac0c49f0 0x7f35ac0cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56930/0 (socket says 172.21.15.102:56930) 2024-03-25T05:37:29.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a9e00640 1 -- 172.21.15.102:0/3199215443 learned_addr learned my addr 172.21.15.102:0/3199215443 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:29.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35aa800640 1 --2- 172.21.15.102:0/3199215443 >> v2:172.21.15.187:3300/0 conn(0x7f35ac0cb210 0x7f35ac159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a3e00640 1 -- 172.21.15.102:0/3199215443 >> v2:172.21.15.187:3300/0 conn(0x7f35ac0cb210 msgr2=0x7f35ac159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a3e00640 1 --2- 172.21.15.102:0/3199215443 >> v2:172.21.15.187:3300/0 conn(0x7f35ac0cb210 0x7f35ac159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a3e00640 1 -- 172.21.15.102:0/3199215443 >> v1:172.21.15.102:6789/0 conn(0x7f35ac154180 legacy=0x7f35ac0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35a3e00640 1 -- 172.21.15.102:0/3199215443 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0cbb50 con 0x7f35ac0c49f0 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.628+0000 7f35aa800640 1 --2- 172.21.15.102:0/3199215443 >> v2:172.21.15.187:3300/0 conn(0x7f35ac0cb210 0x7f35ac159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.629+0000 7f35a3e00640 1 --2- 172.21.15.102:0/3199215443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0c49f0 0x7f35ac0cacd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0b2900 tx=0x7f359402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486886ee6b445d50 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.629+0000 7f35a9400640 1 -- 172.21.15.102:0/3199215443 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594031830 con 0x7f35ac0c49f0 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35a9400640 1 -- 172.21.15.102:0/3199215443 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594031990 con 0x7f35ac0c49f0 2024-03-25T05:37:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35a9400640 1 -- 172.21.15.102:0/3199215443 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594031d20 con 0x7f35ac0c49f0 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 -- 172.21.15.102:0/3199215443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0c49f0 msgr2=0x7f35ac0cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 --2- 172.21.15.102:0/3199215443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0c49f0 0x7f35ac0cacd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0b2900 tx=0x7f359402b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 -- 172.21.15.102:0/3199215443 shutdown_connections 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 --2- 172.21.15.102:0/3199215443 >> v2:172.21.15.187:3300/0 conn(0x7f35ac0cb210 0x7f35ac159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 --2- 172.21.15.102:0/3199215443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0c49f0 0x7f35ac0cacd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 -- 172.21.15.102:0/3199215443 >> 172.21.15.102:0/3199215443 conn(0x7f35ac06c6f0 msgr2=0x7f35ac06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 -- 172.21.15.102:0/3199215443 shutdown_connections 2024-03-25T05:37:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.630+0000 7f35b1200640 1 -- 172.21.15.102:0/3199215443 wait complete. 2024-03-25T05:37:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.632+0000 7f35b1200640 1 Processor -- start 2024-03-25T05:37:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.632+0000 7f35b1200640 1 -- start start 2024-03-25T05:37:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.633+0000 7f35b1200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35ac0c49f0 0x7f35ac155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.633+0000 7f35b1200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0cb210 0x7f35ac155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.633+0000 7f35b1200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35ac154180 0x7f35ac156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.633+0000 7f35b1200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac156b90 con 0x7f35ac0cb210 2024-03-25T05:37:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.633+0000 7f35b1200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac151bf0 con 0x7f35ac154180 2024-03-25T05:37:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.633+0000 7f35b1200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac14f000 con 0x7f35ac0c49f0 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35ac0c49f0 0x7f35ac155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a3e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0cb210 0x7f35ac155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35ac0c49f0 0x7f35ac155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:56798/0 (socket says 172.21.15.102:56798) 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 -- 172.21.15.102:0/1051527832 learned_addr learned my addr 172.21.15.102:0/1051527832 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35aa800640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35ac154180 0x7f35ac156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 -- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35ac154180 msgr2=0x7f35ac156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35ac154180 0x7f35ac156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 -- 172.21.15.102:0/1051527832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0cb210 msgr2=0x7f35ac155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0cb210 0x7f35ac155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 -- 172.21.15.102:0/1051527832 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009a70 con 0x7f35ac0c49f0 2024-03-25T05:37:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a3e00640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0cb210 0x7f35ac155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a9e00640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35ac0c49f0 0x7f35ac155d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f359c00c400 tx=0x7f359c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.634+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c005ce0 con 0x7f35ac0c49f0 2024-03-25T05:37:29.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.635+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c005e40 con 0x7f35ac0c49f0 2024-03-25T05:37:29.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.635+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0072d0 con 0x7f35ac0c49f0 2024-03-25T05:37:29.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.635+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3594009400 con 0x7f35ac0c49f0 2024-03-25T05:37:29.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.635+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac14f5b0 con 0x7f35ac0c49f0 2024-03-25T05:37:29.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.636+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac0cb790 con 0x7f35ac0c49f0 2024-03-25T05:37:29.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.637+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f359c007430 con 0x7f35ac0c49f0 2024-03-25T05:37:29.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.637+0000 7f35a2000640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f358806b7b0 0x7f358806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:29.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.638+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f359c0893f0 con 0x7f35ac0c49f0 2024-03-25T05:37:29.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.638+0000 7f35a3e00640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f358806b7b0 0x7f358806dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:29.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.638+0000 7f35a3e00640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f358806b7b0 0x7f358806dc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3594036000 tx=0x7f359403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:29.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.642+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f359c0540e0 con 0x7f35ac0c49f0 2024-03-25T05:37:29.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:29.839+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f35ac067fb0 con 0x7f35ac0c49f0 2024-03-25T05:37:30.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.136+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f359c0890d0 con 0x7f35ac0c49f0 2024-03-25T05:37:30.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.394+0000 7f35a2000640 1 -- 172.21.15.102:0/1051527832 <== mon.2 v2:172.21.15.187:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f359c077240 con 0x7f35ac0c49f0 2024-03-25T05:37:30.389 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2024-03-25T05:37:30.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.401+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f358806b7b0 msgr2=0x7f358806dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:30.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.401+0000 7f35b1200640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f358806b7b0 0x7f358806dc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3594036000 tx=0x7f359403c040 comp rx=0 tx=0).stop 2024-03-25T05:37:30.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.401+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35ac0c49f0 msgr2=0x7f35ac155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:30.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.401+0000 7f35b1200640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35ac0c49f0 0x7f35ac155d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f359c00c400 tx=0x7f359c00c800 comp rx=0 tx=0).stop 2024-03-25T05:37:30.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.403+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 shutdown_connections 2024-03-25T05:37:30.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.403+0000 7f35b1200640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f358806b7b0 0x7f358806dc70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.403+0000 7f35b1200640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35ac154180 0x7f35ac156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.403+0000 7f35b1200640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ac0cb210 0x7f35ac155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.403+0000 7f35b1200640 1 --2- 172.21.15.102:0/1051527832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35ac0c49f0 0x7f35ac155d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.403+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 >> 172.21.15.102:0/1051527832 conn(0x7f35ac06c6f0 msgr2=0x7f35ac150060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:30.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.404+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 shutdown_connections 2024-03-25T05:37:30.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.406+0000 7f35b1200640 1 -- 172.21.15.102:0/1051527832 wait complete. 2024-03-25T05:37:30.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-25T05:37:30.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.624+0000 7f2c1ea00640 1 Processor -- start 2024-03-25T05:37:30.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.624+0000 7f2c1ea00640 1 -- start start 2024-03-25T05:37:30.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c1ea00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c18154220 0x7f2c180c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:30.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c1ea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:30.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c1ea00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1815a9a0 con 0x7f2c180c5d30 2024-03-25T05:37:30.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c1ea00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c180c4b00 con 0x7f2c18154220 2024-03-25T05:37:30.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c1ea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18154600 con 0x7f2c180ca1d0 2024-03-25T05:37:30.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c17e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c18154220 0x7f2c180c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:30.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c17400640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2c180c5d30 0x7f2c180cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37458/0 (socket says 172.21.15.102:37458) 2024-03-25T05:37:30.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c17400640 1 -- 172.21.15.102:0/1312995218 learned_addr learned my addr 172.21.15.102:0/1312995218 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:30.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.626+0000 7f2c1ca00640 1 --2- 172.21.15.102:0/1312995218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:30.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.627+0000 7f2c17e00640 1 -- 172.21.15.102:0/1312995218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 msgr2=0x7f2c18159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:30.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.627+0000 7f2c17e00640 1 --2- 172.21.15.102:0/1312995218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.627+0000 7f2c17e00640 1 -- 172.21.15.102:0/1312995218 >> v1:172.21.15.102:6789/0 conn(0x7f2c180c5d30 legacy=0x7f2c180cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:30.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.627+0000 7f2c17e00640 1 -- 172.21.15.102:0/1312995218 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1815ac60 con 0x7f2c18154220 2024-03-25T05:37:30.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.627+0000 7f2c16a00640 1 -- 172.21.15.102:0/1312995218 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733601816 0 0) 0x7f2c1815a9a0 con 0x7f2c180c5d30 2024-03-25T05:37:30.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.627+0000 7f2c1ca00640 1 --2- 172.21.15.102:0/1312995218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.628+0000 7f2c17e00640 1 --2- 172.21.15.102:0/1312995218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c180c57f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097a0 tx=0x7f2c0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f148f7ec95f9797f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.628+0000 7f2c16a00640 1 -- 172.21.15.102:0/1312995218 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08031830 con 0x7f2c18154220 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.628+0000 7f2c16a00640 1 -- 172.21.15.102:0/1312995218 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08031990 con 0x7f2c18154220 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.628+0000 7f2c16a00640 1 -- 172.21.15.102:0/1312995218 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08031d20 con 0x7f2c18154220 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 -- 172.21.15.102:0/1312995218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 msgr2=0x7f2c180c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/1312995218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c180c57f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097a0 tx=0x7f2c0802b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 -- 172.21.15.102:0/1312995218 shutdown_connections 2024-03-25T05:37:30.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/1312995218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/1312995218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c180c57f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 -- 172.21.15.102:0/1312995218 >> 172.21.15.102:0/1312995218 conn(0x7f2c1806c710 msgr2=0x7f2c1806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:30.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 -- 172.21.15.102:0/1312995218 shutdown_connections 2024-03-25T05:37:30.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.629+0000 7f2c1ea00640 1 -- 172.21.15.102:0/1312995218 wait complete. 2024-03-25T05:37:30.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.630+0000 7f2c1ea00640 1 Processor -- start 2024-03-25T05:37:30.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.631+0000 7f2c1ea00640 1 -- start start 2024-03-25T05:37:30.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.631+0000 7f2c1ea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c180c5d30 0x7f2c1815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:30.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.631+0000 7f2c1ea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c1814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ea00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181f3830 con 0x7f2c18154220 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ea00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1815db60 con 0x7f2c180c5d30 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18073020 con 0x7f2c180ca1d0 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c1814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c1814ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56958/0 (socket says 172.21.15.102:56958) 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 -- 172.21.15.102:0/437648492 learned_addr learned my addr 172.21.15.102:0/437648492 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c17400640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c17e00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c180c5d30 0x7f2c1815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 -- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 msgr2=0x7f2c18159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 -- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c180c5d30 msgr2=0x7f2c1815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c180c5d30 0x7f2c1815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:30.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 -- 172.21.15.102:0/437648492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c08009400 con 0x7f2c18154220 2024-03-25T05:37:30.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.632+0000 7f2c1ca00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c1814ea10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2c10007ef0 tx=0x7f2c1000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:30.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.633+0000 7f2c0fe00640 1 -- 172.21.15.102:0/437648492 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10003b90 con 0x7f2c18154220 2024-03-25T05:37:30.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.633+0000 7f2c0fe00640 1 -- 172.21.15.102:0/437648492 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1000f040 con 0x7f2c18154220 2024-03-25T05:37:30.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.633+0000 7f2c0fe00640 1 -- 172.21.15.102:0/437648492 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000de80 con 0x7f2c18154220 2024-03-25T05:37:30.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.633+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c181ef920 con 0x7f2c18154220 2024-03-25T05:37:30.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.633+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1815ddd0 con 0x7f2c18154220 2024-03-25T05:37:30.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.634+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c180cfae0 con 0x7f2c18154220 2024-03-25T05:37:30.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.635+0000 7f2c0fe00640 1 -- 172.21.15.102:0/437648492 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2c10004030 con 0x7f2c18154220 2024-03-25T05:37:30.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.636+0000 7f2c0fe00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2bf806b810 0x7f2bf806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:30.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.636+0000 7f2c0fe00640 1 -- 172.21.15.102:0/437648492 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2c1008a3d0 con 0x7f2c18154220 2024-03-25T05:37:30.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.636+0000 7f2c17e00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2bf806b810 0x7f2bf806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:30.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.637+0000 7f2c17e00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2bf806b810 0x7f2bf806dcd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c08036000 tx=0x7f2c0803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:30.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.644+0000 7f2c0fe00640 1 -- 172.21.15.102:0/437648492 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2c10054ef0 con 0x7f2c18154220 2024-03-25T05:37:30.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:30.877+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2c180cb830 con 0x7f2c18154220 2024-03-25T05:37:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.393+0000 7f2c0fe00640 1 -- 172.21.15.102:0/437648492 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2c100585b0 con 0x7f2c18154220 2024-03-25T05:37:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 2 and data pool 3 2024-03-25T05:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.396+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2bf806b810 msgr2=0x7f2bf806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.396+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2bf806b810 0x7f2bf806dcd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c08036000 tx=0x7f2c0803c040 comp rx=0 tx=0).stop 2024-03-25T05:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.396+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 msgr2=0x7f2c1814ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c1814ea10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2c10007ef0 tx=0x7f2c1000d4a0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 shutdown_connections 2024-03-25T05:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2bf806b810 0x7f2bf806dcd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c18154220 0x7f2c1814ea10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c180ca1d0 0x7f2c18159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 --2- 172.21.15.102:0/437648492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c180c5d30 0x7f2c1815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 >> 172.21.15.102:0/437648492 conn(0x7f2c1806c710 msgr2=0x7f2c180cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 shutdown_connections 2024-03-25T05:37:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.397+0000 7f2c1ea00640 1 -- 172.21.15.102:0/437648492 wait complete. 2024-03-25T05:37:31.415 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-25T05:37:31.415 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-25T05:37:31.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.597+0000 7fe01c600640 1 Processor -- start 2024-03-25T05:37:31.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.597+0000 7fe01c600640 1 -- start start 2024-03-25T05:37:31.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.598+0000 7fe01c600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe0140c5a50 0x7fe0140cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:31.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.598+0000 7fe01c600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140ca630 0x7fe014164700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.598+0000 7fe01c600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140c4e20 con 0x7fe0140cb1e0 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.598+0000 7fe01c600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01415e120 con 0x7fe0140c5a50 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.598+0000 7fe01c600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140b28d0 con 0x7fe0140ca630 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe019c00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe0140cb1e0 0x7fe0140c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37460/0 (socket says 172.21.15.102:37460) 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe019c00640 1 -- 172.21.15.102:0/2693817441 learned_addr learned my addr 172.21.15.102:0/2693817441 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe01a600640 1 --2- 172.21.15.102:0/2693817441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140ca630 0x7fe014164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe019200640 1 --2- 172.21.15.102:0/2693817441 >> v2:172.21.15.187:3300/0 conn(0x7fe0140c5a50 0x7fe0140cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe013e00640 1 -- 172.21.15.102:0/2693817441 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364991342 0 0) 0x7fe0140c4e20 con 0x7fe0140cb1e0 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe013e00640 1 -- 172.21.15.102:0/2693817441 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff8003520 con 0x7fe0140cb1e0 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe01a600640 1 -- 172.21.15.102:0/2693817441 >> v2:172.21.15.187:3300/0 conn(0x7fe0140c5a50 msgr2=0x7fe0140cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe01a600640 1 --2- 172.21.15.102:0/2693817441 >> v2:172.21.15.187:3300/0 conn(0x7fe0140c5a50 0x7fe0140cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe01a600640 1 -- 172.21.15.102:0/2693817441 >> v1:172.21.15.102:6789/0 conn(0x7fe0140cb1e0 legacy=0x7fe0140c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:31.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.599+0000 7fe01a600640 1 -- 172.21.15.102:0/2693817441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01415d4a0 con 0x7fe0140ca630 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.600+0000 7fe01a600640 1 --2- 172.21.15.102:0/2693817441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140ca630 0x7fe014164700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0040097a0 tx=0x7fe00402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac1f2a95b3d2e2f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe013e00640 1 -- 172.21.15.102:0/2693817441 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004031780 con 0x7fe0140ca630 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe013e00640 1 -- 172.21.15.102:0/2693817441 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0040318e0 con 0x7fe0140ca630 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe013e00640 1 -- 172.21.15.102:0/2693817441 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004031c70 con 0x7fe0140ca630 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 -- 172.21.15.102:0/2693817441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140ca630 msgr2=0x7fe014164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 --2- 172.21.15.102:0/2693817441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140ca630 0x7fe014164700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0040097a0 tx=0x7fe00402b820 comp rx=0 tx=0).stop 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 -- 172.21.15.102:0/2693817441 shutdown_connections 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 --2- 172.21.15.102:0/2693817441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140ca630 0x7fe014164700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 --2- 172.21.15.102:0/2693817441 >> v2:172.21.15.187:3300/0 conn(0x7fe0140c5a50 0x7fe0140cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 -- 172.21.15.102:0/2693817441 >> 172.21.15.102:0/2693817441 conn(0x7fe014066cc0 msgr2=0x7fe0140670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 -- 172.21.15.102:0/2693817441 shutdown_connections 2024-03-25T05:37:31.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.601+0000 7fe01c600640 1 -- 172.21.15.102:0/2693817441 wait complete. 2024-03-25T05:37:31.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.603+0000 7fe01c600640 1 Processor -- start 2024-03-25T05:37:31.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.603+0000 7fe01c600640 1 -- start start 2024-03-25T05:37:31.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe01c600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0140c5a50 0x7fe01415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:31.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe01c600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0140ca630 0x7fe0141efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:31.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe01c600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140cb1e0 0x7fe0141effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe01c600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0141f3b40 con 0x7fe0140c5a50 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe01c600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0141ef620 con 0x7fe0140ca630 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe01c600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01414ead0 con 0x7fe0140cb1e0 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe019c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0140c5a50 0x7fe01415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe019c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0140c5a50 0x7fe01415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56970/0 (socket says 172.21.15.102:56970) 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe019c00640 1 -- 172.21.15.102:0/1732196355 learned_addr learned my addr 172.21.15.102:0/1732196355 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe01a600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140cb1e0 0x7fe0141effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.604+0000 7fe019200640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0140ca630 0x7fe0141efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe019c00640 1 -- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140cb1e0 msgr2=0x7fe0141effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe019c00640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140cb1e0 0x7fe0141effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe019c00640 1 -- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0140ca630 msgr2=0x7fe0141efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:31.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe019c00640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0140ca630 0x7fe0141efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe019c00640 1 -- 172.21.15.102:0/1732196355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004009400 con 0x7fe0140c5a50 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe019c00640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0140c5a50 0x7fe01415c410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0010e0 tx=0x7fe00c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe011600640 1 -- 172.21.15.102:0/1732196355 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c005ce0 con 0x7fe0140c5a50 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe011600640 1 -- 172.21.15.102:0/1732196355 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c005e60 con 0x7fe0140c5a50 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0140ce370 con 0x7fe0140c5a50 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe011600640 1 -- 172.21.15.102:0/1732196355 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c007310 con 0x7fe0140c5a50 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.605+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0141f3860 con 0x7fe0140c5a50 2024-03-25T05:37:31.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.606+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0141ef790 con 0x7fe0140c5a50 2024-03-25T05:37:31.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.607+0000 7fe011600640 1 -- 172.21.15.102:0/1732196355 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe00c007470 con 0x7fe0140c5a50 2024-03-25T05:37:31.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.608+0000 7fe011600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdff406b840 0x7fdff406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:31.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.609+0000 7fe011600640 1 -- 172.21.15.102:0/1732196355 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe00c089670 con 0x7fe0140c5a50 2024-03-25T05:37:31.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.609+0000 7fe019200640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdff406b840 0x7fdff406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:31.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.609+0000 7fe019200640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdff406b840 0x7fdff406dd00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe01406cb70 tx=0x7fe00000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:31.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.613+0000 7fe011600640 1 -- 172.21.15.102:0/1732196355 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe0141ef790 con 0x7fe0140c5a50 2024-03-25T05:37:31.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:31.816+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe0141ef790 con 0x7fe0140c5a50 2024-03-25T05:37:32.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.130+0000 7fe011600640 1 -- 172.21.15.102:0/1732196355 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe0141ef790 con 0x7fe0140c5a50 2024-03-25T05:37:32.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdff406b840 msgr2=0x7fdff406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:32.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdff406b840 0x7fdff406dd00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe01406cb70 tx=0x7fe00000b040 comp rx=0 tx=0).stop 2024-03-25T05:37:32.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0140c5a50 msgr2=0x7fe01415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:32.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0140c5a50 0x7fe01415c410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0010e0 tx=0x7fe00c00c890 comp rx=0 tx=0).stop 2024-03-25T05:37:32.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 shutdown_connections 2024-03-25T05:37:32.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdff406b840 0x7fdff406dd00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0140cb1e0 0x7fe0141effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0140ca630 0x7fe0141efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 --2- 172.21.15.102:0/1732196355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0140c5a50 0x7fe01415c410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 >> 172.21.15.102:0/1732196355 conn(0x7fe014066cc0 msgr2=0x7fe0140c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:32.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 shutdown_connections 2024-03-25T05:37:32.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.134+0000 7fe01c600640 1 -- 172.21.15.102:0/1732196355 wait complete. 2024-03-25T05:37:32.151 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-25T05:37:32.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.373+0000 7f3378c00640 1 Processor -- start 2024-03-25T05:37:32.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.373+0000 7f3378c00640 1 -- start start 2024-03-25T05:37:32.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3378c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f33740c4900 0x7f33740726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:32.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3378c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33740c59c0 con 0x7f3374072c20 2024-03-25T05:37:32.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3378c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33740ca410 con 0x7f3374153f90 2024-03-25T05:37:32.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3378c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33740b2d90 con 0x7f33740c4900 2024-03-25T05:37:32.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3372800640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3374072c20 0x7f3374159db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37468/0 (socket says 172.21.15.102:37468) 2024-03-25T05:37:32.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3372800640 1 -- 172.21.15.102:0/191010272 learned_addr learned my addr 172.21.15.102:0/191010272 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:32.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3371e00640 1 --1- 172.21.15.102:0/191010272 >> v1:172.21.15.187:6789/0 conn(0x7f3374153f90 0x7f33740cb780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:33330/0 (socket says 172.21.15.102:33330) 2024-03-25T05:37:32.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.375+0000 7f3371400640 1 --2- 172.21.15.102:0/191010272 >> v2:172.21.15.187:3300/0 conn(0x7f33740c4900 0x7f33740726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:32.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.376+0000 7f3370a00640 1 -- 172.21.15.102:0/191010272 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761182558 0 0) 0x7f33740ca410 con 0x7f3374153f90 2024-03-25T05:37:32.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.376+0000 7f3370a00640 1 -- 172.21.15.102:0/191010272 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3358003520 con 0x7f3374153f90 2024-03-25T05:37:32.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.376+0000 7f3371400640 1 -- 172.21.15.102:0/191010272 >> v1:172.21.15.187:6789/0 conn(0x7f3374153f90 legacy=0x7f33740cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:32.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.376+0000 7f3370a00640 1 -- 172.21.15.102:0/191010272 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977714914 0 0) 0x7f33740c59c0 con 0x7f3374072c20 2024-03-25T05:37:32.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.376+0000 7f3371400640 1 -- 172.21.15.102:0/191010272 >> v1:172.21.15.102:6789/0 conn(0x7f3374072c20 legacy=0x7f3374159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:32.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.376+0000 7f3371400640 1 -- 172.21.15.102:0/191010272 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33740ca6f0 con 0x7f33740c4900 2024-03-25T05:37:32.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.377+0000 7f3371400640 1 --2- 172.21.15.102:0/191010272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740726e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f33600097a0 tx=0x7f336002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5cb1ee61d89fbdc server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:32.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.378+0000 7f3370a00640 1 -- 172.21.15.102:0/191010272 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336002f810 con 0x7f33740c4900 2024-03-25T05:37:32.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.378+0000 7f3370a00640 1 -- 172.21.15.102:0/191010272 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336002f970 con 0x7f33740c4900 2024-03-25T05:37:32.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.378+0000 7f3370a00640 1 -- 172.21.15.102:0/191010272 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336002fd00 con 0x7f33740c4900 2024-03-25T05:37:32.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.379+0000 7f3378c00640 1 -- 172.21.15.102:0/191010272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 msgr2=0x7f33740726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:32.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.379+0000 7f3378c00640 1 --2- 172.21.15.102:0/191010272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740726e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f33600097a0 tx=0x7f336002b9f0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.379+0000 7f3378c00640 1 -- 172.21.15.102:0/191010272 shutdown_connections 2024-03-25T05:37:32.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.379+0000 7f3378c00640 1 --2- 172.21.15.102:0/191010272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740726e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.379+0000 7f3378c00640 1 -- 172.21.15.102:0/191010272 >> 172.21.15.102:0/191010272 conn(0x7f337406c3c0 msgr2=0x7f337406cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:32.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.379+0000 7f3378c00640 1 -- 172.21.15.102:0/191010272 shutdown_connections 2024-03-25T05:37:32.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.379+0000 7f3378c00640 1 -- 172.21.15.102:0/191010272 wait complete. 2024-03-25T05:37:32.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.380+0000 7f3378c00640 1 Processor -- start 2024-03-25T05:37:32.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.381+0000 7f3378c00640 1 -- start start 2024-03-25T05:37:32.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.381+0000 7f3378c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3374072c20 0x7f3374152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:32.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.381+0000 7f3378c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.381+0000 7f3378c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3374153f90 0x7f33740c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.381+0000 7f3378c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3374143b90 con 0x7f3374072c20 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.381+0000 7f3378c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3374143170 con 0x7f33740c4900 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.381+0000 7f3378c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3374144af0 con 0x7f3374153f90 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3374072c20 0x7f3374152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3374072c20 0x7f3374152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56982/0 (socket says 172.21.15.102:56982) 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 -- 172.21.15.102:0/4063511495 learned_addr learned my addr 172.21.15.102:0/4063511495 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3372800640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3374153f90 0x7f33740c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371400640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 -- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3374153f90 msgr2=0x7f33740c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3374153f90 0x7f33740c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 -- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 msgr2=0x7f33740c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:32.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371e00640 1 -- 172.21.15.102:0/4063511495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360009400 con 0x7f3374072c20 2024-03-25T05:37:32.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.382+0000 7f3371400640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:32.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.383+0000 7f3371e00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3374072c20 0x7f3374152410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f336400c410 tx=0x7f336400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:32.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.383+0000 7f336a000640 1 -- 172.21.15.102:0/4063511495 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33640074e0 con 0x7f3374072c20 2024-03-25T05:37:32.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.383+0000 7f336a000640 1 -- 172.21.15.102:0/4063511495 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364007640 con 0x7f3374072c20 2024-03-25T05:37:32.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.383+0000 7f336a000640 1 -- 172.21.15.102:0/4063511495 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364004a00 con 0x7f3374072c20 2024-03-25T05:37:32.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.383+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3374143410 con 0x7f3374072c20 2024-03-25T05:37:32.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.383+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3374144dd0 con 0x7f3374072c20 2024-03-25T05:37:32.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.384+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33741439b0 con 0x7f3374072c20 2024-03-25T05:37:32.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.385+0000 7f336a000640 1 -- 172.21.15.102:0/4063511495 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3364004b60 con 0x7f3374072c20 2024-03-25T05:37:32.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.386+0000 7f336a000640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f335406b840 0x7f335406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:32.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.386+0000 7f336a000640 1 -- 172.21.15.102:0/4063511495 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f3364089bf0 con 0x7f3374072c20 2024-03-25T05:37:32.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.386+0000 7f3371400640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f335406b840 0x7f335406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:32.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.387+0000 7f3371400640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f335406b840 0x7f335406dd00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3360036000 tx=0x7f3360008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:32.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.390+0000 7f336a000640 1 -- 172.21.15.102:0/4063511495 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3364054640 con 0x7f3374072c20 2024-03-25T05:37:32.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:32.593+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f33740b2920 con 0x7f3374072c20 2024-03-25T05:37:32.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:37:32.965 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:37:34.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.414+0000 7f336a000640 1 -- 172.21.15.102:0/4063511495 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f3364057d00 con 0x7f3374072c20 2024-03-25T05:37:34.409 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data_ec' created 2024-03-25T05:37:34.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.418+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f335406b840 msgr2=0x7f335406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.418+0000 7f3378c00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f335406b840 0x7f335406dd00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3360036000 tx=0x7f3360008030 comp rx=0 tx=0).stop 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.418+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3374072c20 msgr2=0x7f3374152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.418+0000 7f3378c00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3374072c20 0x7f3374152410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f336400c410 tx=0x7f336400c8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.419+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 shutdown_connections 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.419+0000 7f3378c00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f335406b840 0x7f335406dd00 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3360036000 tx=0x7f3360008030 comp rx=0 tx=0).stop 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.419+0000 7f3378c00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3374153f90 0x7f33740c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.419+0000 7f3378c00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33740c4900 0x7f33740c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.419+0000 7f3378c00640 1 --2- 172.21.15.102:0/4063511495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3374072c20 0x7f3374152410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.419+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 >> 172.21.15.102:0/4063511495 conn(0x7f337406c3c0 msgr2=0x7f33740cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:34.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.420+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 shutdown_connections 2024-03-25T05:37:34.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.420+0000 7f3378c00640 1 -- 172.21.15.102:0/4063511495 wait complete. 2024-03-25T05:37:34.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-25T05:37:34.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.633+0000 7fd604a00640 1 Processor -- start 2024-03-25T05:37:34.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.634+0000 7fd604a00640 1 -- start start 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd604a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd6001504b0 0x7fd60006f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd604a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd600071c90 0x7fd6000715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd604a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd600156ca0 con 0x7fd6000c6b30 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd604a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd600071af0 con 0x7fd6001504b0 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd604a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000c5d70 con 0x7fd600071c90 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd5ff400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd6001504b0 0x7fd60006f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd5ff400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd6001504b0 0x7fd60006f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57638/0 (socket says 172.21.15.102:57638) 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd5ff400640 1 -- 172.21.15.102:0/909164708 learned_addr learned my addr 172.21.15.102:0/909164708 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:34.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.636+0000 7fd5ffe00640 1 --2- 172.21.15.102:0/909164708 >> v2:172.21.15.187:3300/0 conn(0x7fd600071c90 0x7fd6000715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:34.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.637+0000 7fd5ff400640 1 -- 172.21.15.102:0/909164708 >> v2:172.21.15.187:3300/0 conn(0x7fd600071c90 msgr2=0x7fd6000715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:34.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.637+0000 7fd5ff400640 1 --2- 172.21.15.102:0/909164708 >> v2:172.21.15.187:3300/0 conn(0x7fd600071c90 0x7fd6000715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.637+0000 7fd5ff400640 1 -- 172.21.15.102:0/909164708 >> v1:172.21.15.102:6789/0 conn(0x7fd6000c6b30 legacy=0x7fd60006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:34.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.637+0000 7fd5ff400640 1 -- 172.21.15.102:0/909164708 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000c6050 con 0x7fd6001504b0 2024-03-25T05:37:34.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.637+0000 7fd5fe000640 1 -- 172.21.15.102:0/909164708 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656753950 0 0) 0x7fd600156ca0 con 0x7fd6000c6b30 2024-03-25T05:37:34.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.639+0000 7fd5ff400640 1 --2- 172.21.15.102:0/909164708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6001504b0 0x7fd60006f4c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd600067cb0 tx=0x7fd5f002cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a7bb314548e125 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:34.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.639+0000 7fd5fe000640 1 -- 172.21.15.102:0/909164708 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f002d9f0 con 0x7fd6001504b0 2024-03-25T05:37:34.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.639+0000 7fd5fe000640 1 -- 172.21.15.102:0/909164708 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f002db50 con 0x7fd6001504b0 2024-03-25T05:37:34.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.639+0000 7fd5fe000640 1 -- 172.21.15.102:0/909164708 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0035440 con 0x7fd6001504b0 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.639+0000 7fd604a00640 1 -- 172.21.15.102:0/909164708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6001504b0 msgr2=0x7fd60006f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.639+0000 7fd604a00640 1 --2- 172.21.15.102:0/909164708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6001504b0 0x7fd60006f4c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd600067cb0 tx=0x7fd5f002cc40 comp rx=0 tx=0).stop 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.640+0000 7fd604a00640 1 -- 172.21.15.102:0/909164708 shutdown_connections 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.640+0000 7fd604a00640 1 --2- 172.21.15.102:0/909164708 >> v2:172.21.15.187:3300/0 conn(0x7fd600071c90 0x7fd6000715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.640+0000 7fd604a00640 1 --2- 172.21.15.102:0/909164708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6001504b0 0x7fd60006f4c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.640+0000 7fd604a00640 1 -- 172.21.15.102:0/909164708 >> 172.21.15.102:0/909164708 conn(0x7fd6000cb2d0 msgr2=0x7fd6000cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.640+0000 7fd604a00640 1 -- 172.21.15.102:0/909164708 shutdown_connections 2024-03-25T05:37:34.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.640+0000 7fd604a00640 1 -- 172.21.15.102:0/909164708 wait complete. 2024-03-25T05:37:34.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.642+0000 7fd604a00640 1 Processor -- start 2024-03-25T05:37:34.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.642+0000 7fd604a00640 1 -- start start 2024-03-25T05:37:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd604a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd600071c90 0x7fd6001e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd604a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6000c6b30 0x7fd600072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd604a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6001504b0 0x7fd6001eee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd604a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6001e1140 con 0x7fd6000c6b30 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd604a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6001f3080 con 0x7fd600071c90 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd604a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6001dea80 con 0x7fd6001504b0 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5fea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6000c6b30 0x7fd600072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ff400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd600071c90 0x7fd6001e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5fea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6000c6b30 0x7fd600072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57652/0 (socket says 172.21.15.102:57652) 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5fea00640 1 -- 172.21.15.102:0/3303299712 learned_addr learned my addr 172.21.15.102:0/3303299712 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ffe00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6001504b0 0x7fd6001eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ff400640 1 -- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6001504b0 msgr2=0x7fd6001eee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ff400640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6001504b0 0x7fd6001eee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ff400640 1 -- 172.21.15.102:0/3303299712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6000c6b30 msgr2=0x7fd600072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ff400640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6000c6b30 0x7fd600072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ff400640 1 -- 172.21.15.102:0/3303299712 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f00094d0 con 0x7fd600071c90 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5fea00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6000c6b30 0x7fd600072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.643+0000 7fd5ffe00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6001504b0 0x7fd6001eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.644+0000 7fd5ff400640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd600071c90 0x7fd6001e0c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0034000 tx=0x7fd5f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.644+0000 7fd5f7400640 1 -- 172.21.15.102:0/3303299712 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0040680 con 0x7fd600071c90 2024-03-25T05:37:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.644+0000 7fd5f7400640 1 -- 172.21.15.102:0/3303299712 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f000c040 con 0x7fd600071c90 2024-03-25T05:37:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.644+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6001f2470 con 0x7fd600071c90 2024-03-25T05:37:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.644+0000 7fd5f7400640 1 -- 172.21.15.102:0/3303299712 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0040a40 con 0x7fd600071c90 2024-03-25T05:37:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.644+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6001f2a30 con 0x7fd600071c90 2024-03-25T05:37:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.646+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60004f2f0 con 0x7fd600071c90 2024-03-25T05:37:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.647+0000 7fd5f7400640 1 -- 172.21.15.102:0/3303299712 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd5f0040ba0 con 0x7fd600071c90 2024-03-25T05:37:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.648+0000 7fd5f7400640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd5e006b810 0x7fd5e006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.648+0000 7fd5f7400640 1 -- 172.21.15.102:0/3303299712 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd5f00acce0 con 0x7fd600071c90 2024-03-25T05:37:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.648+0000 7fd5fea00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd5e006b810 0x7fd5e006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.649+0000 7fd5fea00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd5e006b810 0x7fd5e006dcd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6001e1570 tx=0x7fd5ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.652+0000 7fd5f7400640 1 -- 172.21.15.102:0/3303299712 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd5f0077480 con 0x7fd600071c90 2024-03-25T05:37:34.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:34.861+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fd6000c72c0 con 0x7fd600071c90 2024-03-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.429+0000 7fd5f7400640 1 -- 172.21.15.102:0/3303299712 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd5f003a020 con 0x7fd600071c90 2024-03-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi102.stderr:set pool 4 allow_ec_overwrites to true 2024-03-25T05:37:35.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.438+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd5e006b810 msgr2=0x7fd5e006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:35.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.438+0000 7fd604a00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd5e006b810 0x7fd5e006dcd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6001e1570 tx=0x7fd5ec009040 comp rx=0 tx=0).stop 2024-03-25T05:37:35.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.438+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd600071c90 msgr2=0x7fd6001e0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:35.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.438+0000 7fd604a00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd600071c90 0x7fd6001e0c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0034000 tx=0x7fd5f00046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.440+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 shutdown_connections 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.440+0000 7fd604a00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd5e006b810 0x7fd5e006dcd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.440+0000 7fd604a00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6001504b0 0x7fd6001eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.440+0000 7fd604a00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6000c6b30 0x7fd600072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.440+0000 7fd604a00640 1 --2- 172.21.15.102:0/3303299712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd600071c90 0x7fd6001e0c00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.440+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 >> 172.21.15.102:0/3303299712 conn(0x7fd6000cb2d0 msgr2=0x7fd60014d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.440+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 shutdown_connections 2024-03-25T05:37:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.441+0000 7fd604a00640 1 -- 172.21.15.102:0/3303299712 wait complete. 2024-03-25T05:37:35.464 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-25T05:37:35.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.644+0000 7f3a5fe00640 1 Processor -- start 2024-03-25T05:37:35.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.644+0000 7f3a5fe00640 1 -- start start 2024-03-25T05:37:35.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580ca630 0x7f3a580cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:35.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5fe00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a580c4e20 con 0x7f3a580cb1e0 2024-03-25T05:37:35.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5fe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5815d4a0 con 0x7f3a580c5a50 2024-03-25T05:37:35.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815e120 con 0x7f3a580ca630 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5ca00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3a580c5a50 0x7f3a581626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:45720/0 (socket says 172.21.15.102:45720) 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5ca00640 1 -- 172.21.15.102:0/2218216610 learned_addr learned my addr 172.21.15.102:0/2218216610 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5d400640 1 --1- 172.21.15.102:0/2218216610 >> v1:172.21.15.102:6789/0 conn(0x7f3a580cb1e0 0x7f3a580c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37632/0 (socket says 172.21.15.102:37632) 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a5de00640 1 --2- 172.21.15.102:0/2218216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580ca630 0x7f3a580cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.646+0000 7f3a57e00640 1 -- 172.21.15.102:0/2218216610 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997592840 0 0) 0x7f3a5815d4a0 con 0x7f3a580c5a50 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.647+0000 7f3a57e00640 1 -- 172.21.15.102:0/2218216610 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a40003520 con 0x7f3a580c5a50 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.647+0000 7f3a57e00640 1 -- 172.21.15.102:0/2218216610 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286217558 0 0) 0x7f3a580c4e20 con 0x7f3a580cb1e0 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.647+0000 7f3a57e00640 1 -- 172.21.15.102:0/2218216610 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5815d4a0 con 0x7f3a580cb1e0 2024-03-25T05:37:35.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.647+0000 7f3a5de00640 1 -- 172.21.15.102:0/2218216610 >> v1:172.21.15.187:6789/0 conn(0x7f3a580c5a50 legacy=0x7f3a581626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:35.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.647+0000 7f3a5de00640 1 -- 172.21.15.102:0/2218216610 >> v1:172.21.15.102:6789/0 conn(0x7f3a580cb1e0 legacy=0x7f3a580c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:35.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.647+0000 7f3a5de00640 1 -- 172.21.15.102:0/2218216610 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5815d780 con 0x7f3a580ca630 2024-03-25T05:37:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.648+0000 7f3a5de00640 1 --2- 172.21.15.102:0/2218216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580ca630 0x7f3a580cb5c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009dc0 tx=0x7f3a5002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ffcb4b34f84db52 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a57e00640 1 -- 172.21.15.102:0/2218216610 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5002cc40 con 0x7f3a580ca630 2024-03-25T05:37:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a57e00640 1 -- 172.21.15.102:0/2218216610 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5002cda0 con 0x7f3a580ca630 2024-03-25T05:37:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a57e00640 1 -- 172.21.15.102:0/2218216610 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50034660 con 0x7f3a580ca630 2024-03-25T05:37:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a5fe00640 1 -- 172.21.15.102:0/2218216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580ca630 msgr2=0x7f3a580cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:35.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/2218216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580ca630 0x7f3a580cb5c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009dc0 tx=0x7f3a5002be90 comp rx=0 tx=0).stop 2024-03-25T05:37:35.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a5fe00640 1 -- 172.21.15.102:0/2218216610 shutdown_connections 2024-03-25T05:37:35.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/2218216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580ca630 0x7f3a580cb5c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a5fe00640 1 -- 172.21.15.102:0/2218216610 >> 172.21.15.102:0/2218216610 conn(0x7f3a58066cc0 msgr2=0x7f3a580670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:35.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a5fe00640 1 -- 172.21.15.102:0/2218216610 shutdown_connections 2024-03-25T05:37:35.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.649+0000 7f3a5fe00640 1 -- 172.21.15.102:0/2218216610 wait complete. 2024-03-25T05:37:35.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.652+0000 7f3a5fe00640 1 Processor -- start 2024-03-25T05:37:35.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.652+0000 7f3a5fe00640 1 -- start start 2024-03-25T05:37:35.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.653+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580c5a50 0x7f3a581f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.653+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a580ca630 0x7f3a5806c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a580cb1e0 0x7f3a580b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5fe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a581f0e50 con 0x7f3a580ca630 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5fe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b5850 con 0x7f3a580cb1e0 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b4fb0 con 0x7f3a580c5a50 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a580ca630 0x7f3a5806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580c5a50 0x7f3a581f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a580ca630 0x7f3a5806c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57658/0 (socket says 172.21.15.102:57658) 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 -- 172.21.15.102:0/1640231761 learned_addr learned my addr 172.21.15.102:0/1640231761 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:35.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5de00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a580cb1e0 0x7f3a580b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:35.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 -- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580c5a50 msgr2=0x7f3a581f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:35.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580c5a50 0x7f3a581f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 -- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a580cb1e0 msgr2=0x7f3a580b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:35.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a580cb1e0 0x7f3a580b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:35.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5ca00640 1 -- 172.21.15.102:0/1640231761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50009a70 con 0x7f3a580ca630 2024-03-25T05:37:35.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.654+0000 7f3a5de00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a580cb1e0 0x7f3a580b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:35.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.655+0000 7f3a5ca00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a580ca630 0x7f3a5806c210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c500 tx=0x7f3a4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:35.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.655+0000 7f3a55600640 1 -- 172.21.15.102:0/1640231761 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44005ce0 con 0x7f3a580ca630 2024-03-25T05:37:35.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.655+0000 7f3a55600640 1 -- 172.21.15.102:0/1640231761 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a44005e60 con 0x7f3a580ca630 2024-03-25T05:37:35.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.655+0000 7f3a55600640 1 -- 172.21.15.102:0/1640231761 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44007330 con 0x7f3a580ca630 2024-03-25T05:37:35.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.655+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a580b5290 con 0x7f3a580ca630 2024-03-25T05:37:35.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.655+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a580b3760 con 0x7f3a580ca630 2024-03-25T05:37:35.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.656+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a58067fb0 con 0x7f3a580ca630 2024-03-25T05:37:35.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.658+0000 7f3a55600640 1 -- 172.21.15.102:0/1640231761 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a44007550 con 0x7f3a580ca630 2024-03-25T05:37:35.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.659+0000 7f3a55600640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f3a3806b810 0x7f3a3806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:35.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.659+0000 7f3a55600640 1 -- 172.21.15.102:0/1640231761 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3a44089af0 con 0x7f3a580ca630 2024-03-25T05:37:35.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.659+0000 7f3a5d400640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f3a3806b810 0x7f3a3806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:35.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.660+0000 7f3a5d400640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f3a3806b810 0x7f3a3806dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c000f60 tx=0x7f3a4c007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:35.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.664+0000 7f3a55600640 1 -- 172.21.15.102:0/1640231761 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3a44054350 con 0x7f3a580ca630 2024-03-25T05:37:35.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:35.894+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f3a5814e490 con 0x7f3a580ca630 2024-03-25T05:37:36.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.425+0000 7f3a55600640 1 -- 172.21.15.102:0/1640231761 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3a44017020 con 0x7f3a580ca630 2024-03-25T05:37:36.420 INFO:teuthology.orchestra.run.smithi102.stderr:added data pool 4 to fsmap 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f3a3806b810 msgr2=0x7f3a3806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f3a3806b810 0x7f3a3806dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c000f60 tx=0x7f3a4c007cf0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a580ca630 msgr2=0x7f3a5806c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a580ca630 0x7f3a5806c210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c500 tx=0x7f3a4400c9c0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 shutdown_connections 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f3a3806b810 0x7f3a3806dcd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a580cb1e0 0x7f3a580b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a580ca630 0x7f3a5806c210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 --2- 172.21.15.102:0/1640231761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a580c5a50 0x7f3a581f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.428+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 >> 172.21.15.102:0/1640231761 conn(0x7f3a58066cc0 msgr2=0x7f3a580cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:36.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.429+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 shutdown_connections 2024-03-25T05:37:36.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.429+0000 7f3a5fe00640 1 -- 172.21.15.102:0/1640231761 wait complete. 2024-03-25T05:37:36.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.642+0000 7f1183200640 1 Processor -- start 2024-03-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.642+0000 7f1183200640 1 -- start start 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.643+0000 7f1183200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c5940 0x7f117c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.643+0000 7f1183200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f117c0c7940 0x7f117c0c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f1183200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c0c8310 con 0x7f117c0c6240 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f1183200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c0caa10 con 0x7f117c0c7940 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f1183200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c15a060 con 0x7f117c0c5940 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f1173e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f117c0c6240 0x7f117c0cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37634/0 (socket says 172.21.15.102:37634) 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f1173e00640 1 -- 172.21.15.102:0/2774686153 learned_addr learned my addr 172.21.15.102:0/2774686153 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f117be00640 1 --2- 172.21.15.102:0/2774686153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c5940 0x7f117c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f1181200640 1 --2- 172.21.15.102:0/2774686153 >> v2:172.21.15.187:3300/0 conn(0x7f117c0c7940 0x7f117c0c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f117b400640 1 -- 172.21.15.102:0/2774686153 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258379468 0 0) 0x7f117c0c8310 con 0x7f117c0c6240 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f117b400640 1 -- 172.21.15.102:0/2774686153 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1160003520 con 0x7f117c0c6240 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f117be00640 1 -- 172.21.15.102:0/2774686153 >> v2:172.21.15.187:3300/0 conn(0x7f117c0c7940 msgr2=0x7f117c0c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f117be00640 1 --2- 172.21.15.102:0/2774686153 >> v2:172.21.15.187:3300/0 conn(0x7f117c0c7940 0x7f117c0c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f117be00640 1 -- 172.21.15.102:0/2774686153 >> v1:172.21.15.102:6789/0 conn(0x7f117c0c6240 legacy=0x7f117c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.644+0000 7f117be00640 1 -- 172.21.15.102:0/2774686153 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c15a340 con 0x7f117c0c5940 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.646+0000 7f117be00640 1 --2- 172.21.15.102:0/2774686153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c5940 0x7f117c0ca4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f116c0097a0 tx=0x7f116c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d78c8309380a0f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.646+0000 7f117b400640 1 -- 172.21.15.102:0/2774686153 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c031830 con 0x7f117c0c5940 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.646+0000 7f117b400640 1 -- 172.21.15.102:0/2774686153 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c031990 con 0x7f117c0c5940 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.646+0000 7f117b400640 1 -- 172.21.15.102:0/2774686153 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c031d20 con 0x7f117c0c5940 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 -- 172.21.15.102:0/2774686153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c5940 msgr2=0x7f117c0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 --2- 172.21.15.102:0/2774686153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c5940 0x7f117c0ca4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f116c0097a0 tx=0x7f116c02b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 -- 172.21.15.102:0/2774686153 shutdown_connections 2024-03-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 --2- 172.21.15.102:0/2774686153 >> v2:172.21.15.187:3300/0 conn(0x7f117c0c7940 0x7f117c0c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 --2- 172.21.15.102:0/2774686153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c5940 0x7f117c0ca4d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 -- 172.21.15.102:0/2774686153 >> 172.21.15.102:0/2774686153 conn(0x7f117c0728c0 msgr2=0x7f117c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 -- 172.21.15.102:0/2774686153 shutdown_connections 2024-03-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.647+0000 7f1183200640 1 -- 172.21.15.102:0/2774686153 wait complete. 2024-03-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.648+0000 7f1183200640 1 Processor -- start 2024-03-25T05:37:36.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.649+0000 7f1183200640 1 -- start start 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.649+0000 7f1183200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f117c0c5940 0x7f117c1f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.649+0000 7f1183200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f117c0c6240 0x7f117c1efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.649+0000 7f1183200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c7940 0x7f117c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.649+0000 7f1183200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c1ef5e0 con 0x7f117c0c6240 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.649+0000 7f1183200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c1f3aa0 con 0x7f117c0c5940 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.649+0000 7f1183200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c1f0530 con 0x7f117c0c7940 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1173e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f117c0c6240 0x7f117c1efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1181200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c7940 0x7f117c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1173e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f117c0c6240 0x7f117c1efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57668/0 (socket says 172.21.15.102:57668) 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1173e00640 1 -- 172.21.15.102:0/3173690261 learned_addr learned my addr 172.21.15.102:0/3173690261 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f117be00640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f117c0c5940 0x7f117c1f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1181200640 1 -- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f117c0c5940 msgr2=0x7f117c1f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1181200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f117c0c5940 0x7f117c1f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1181200640 1 -- 172.21.15.102:0/3173690261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f117c0c6240 msgr2=0x7f117c1efff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1181200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f117c0c6240 0x7f117c1efff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1181200640 1 -- 172.21.15.102:0/3173690261 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009400 con 0x7f117c0c7940 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1173e00640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f117c0c6240 0x7f117c1efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.650+0000 7f1181200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c7940 0x7f117c0cbfa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f117400eba0 tx=0x7f117400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.651+0000 7f1178c00640 1 -- 172.21.15.102:0/3173690261 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117400ccc0 con 0x7f117c0c7940 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.651+0000 7f1178c00640 1 -- 172.21.15.102:0/3173690261 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117400f040 con 0x7f117c0c7940 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.651+0000 7f1178c00640 1 -- 172.21.15.102:0/3173690261 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740146c0 con 0x7f117c0c7940 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.651+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c1f3200 con 0x7f117c0c7940 2024-03-25T05:37:36.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.651+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c1f37c0 con 0x7f117c0c7940 2024-03-25T05:37:36.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.652+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c067fb0 con 0x7f117c0c7940 2024-03-25T05:37:36.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.653+0000 7f1178c00640 1 -- 172.21.15.102:0/3173690261 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1174014820 con 0x7f117c0c7940 2024-03-25T05:37:36.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.654+0000 7f1178c00640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f115806b840 0x7f115806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:36.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.654+0000 7f1178c00640 1 -- 172.21.15.102:0/3173690261 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f117408b120 con 0x7f117c0c7940 2024-03-25T05:37:36.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.654+0000 7f117be00640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f115806b840 0x7f115806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:36.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.655+0000 7f117be00640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f115806b840 0x7f115806dd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f116c036000 tx=0x7f116c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:36.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.658+0000 7f1178c00640 1 -- 172.21.15.102:0/3173690261 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1174055810 con 0x7f117c0c7940 2024-03-25T05:37:36.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.878+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f117c0cb410 con 0x7f117c0c7940 2024-03-25T05:37:36.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.879+0000 7f1178c00640 1 -- 172.21.15.102:0/3173690261 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6571 (secure 0 0 0) 0x7f1174058ed0 con 0x7f117c0c7940 2024-03-25T05:37:36.873 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:36.873 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:35.897029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-03-25T05:37:36.873 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 7 2024-03-25T05:37:36.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f115806b840 msgr2=0x7f115806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f115806b840 0x7f115806dd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f116c036000 tx=0x7f116c03c040 comp rx=0 tx=0).stop 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c7940 msgr2=0x7f117c0cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c7940 0x7f117c0cbfa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f117400eba0 tx=0x7f117400c490 comp rx=0 tx=0).stop 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 shutdown_connections 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f115806b840 0x7f115806dd00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f117c0c7940 0x7f117c0cbfa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f117c0c6240 0x7f117c1efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 --2- 172.21.15.102:0/3173690261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f117c0c5940 0x7f117c1f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 >> 172.21.15.102:0/3173690261 conn(0x7f117c0728c0 msgr2=0x7f117c0c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 shutdown_connections 2024-03-25T05:37:36.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:36.881+0000 7f1183200640 1 -- 172.21.15.102:0/3173690261 wait complete. 2024-03-25T05:37:36.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:37.021 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:37:37.027+0000 7f9ada000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-25T05:37:37.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.092+0000 7f0b1b800640 1 Processor -- start 2024-03-25T05:37:37.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.092+0000 7f0b1b800640 1 -- start start 2024-03-25T05:37:37.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b1b800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0b14152020 0x7f0b140c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b1b800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b1406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b1b800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140c88b0 con 0x7f0b140c8170 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b1b800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b14152400 con 0x7f0b14152020 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b1b800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14157c70 con 0x7f0b140c3bb0 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b18e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0b14152020 0x7f0b140c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b18e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0b14152020 0x7f0b140c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57682/0 (socket says 172.21.15.102:57682) 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b18e00640 1 -- 172.21.15.102:0/1957053108 learned_addr learned my addr 172.21.15.102:0/1957053108 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b13e00640 1 --2- 172.21.15.102:0/1957053108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b1406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b18e00640 1 -- 172.21.15.102:0/1957053108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 msgr2=0x7f0b1406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b18e00640 1 --2- 172.21.15.102:0/1957053108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b1406f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b18e00640 1 -- 172.21.15.102:0/1957053108 >> v1:172.21.15.187:6789/0 conn(0x7f0b140c8170 legacy=0x7f0b14158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.094+0000 7f0b18e00640 1 -- 172.21.15.102:0/1957053108 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140c92f0 con 0x7f0b14152020 2024-03-25T05:37:37.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.096+0000 7f0b18e00640 1 --2- 172.21.15.102:0/1957053108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b140c2790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009e50 tx=0x7f0b0802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54a8c806d751562 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:37.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b13400640 1 -- 172.21.15.102:0/1957053108 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0802cb90 con 0x7f0b14152020 2024-03-25T05:37:37.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b13400640 1 -- 172.21.15.102:0/1957053108 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0802ccf0 con 0x7f0b14152020 2024-03-25T05:37:37.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b13400640 1 -- 172.21.15.102:0/1957053108 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08034610 con 0x7f0b14152020 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 -- 172.21.15.102:0/1957053108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 msgr2=0x7f0b140c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 --2- 172.21.15.102:0/1957053108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b140c2790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009e50 tx=0x7f0b0802bff0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 -- 172.21.15.102:0/1957053108 shutdown_connections 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 --2- 172.21.15.102:0/1957053108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b1406f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 --2- 172.21.15.102:0/1957053108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b140c2790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 -- 172.21.15.102:0/1957053108 >> 172.21.15.102:0/1957053108 conn(0x7f0b14066ea0 msgr2=0x7f0b14067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 -- 172.21.15.102:0/1957053108 shutdown_connections 2024-03-25T05:37:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.097+0000 7f0b1b800640 1 -- 172.21.15.102:0/1957053108 wait complete. 2024-03-25T05:37:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.099+0000 7f0b1b800640 1 Processor -- start 2024-03-25T05:37:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.099+0000 7f0b1b800640 1 -- start start 2024-03-25T05:37:37.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b1b800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b140cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b1b800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b140c8170 0x7f0b141efa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b1b800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b141eff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b1b800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b141ef600 con 0x7f0b14152020 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b1b800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140c79c0 con 0x7f0b140c8170 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b1b800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140b1340 con 0x7f0b140c3bb0 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b19800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b141eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b19800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b141eff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57692/0 (socket says 172.21.15.102:57692) 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b19800640 1 -- 172.21.15.102:0/3676321318 learned_addr learned my addr 172.21.15.102:0/3676321318 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b13e00640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b140c8170 0x7f0b141efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.100+0000 7f0b18e00640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b140cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b19800640 1 -- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 msgr2=0x7f0b140cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b19800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b140cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b19800640 1 -- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b140c8170 msgr2=0x7f0b141efa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b19800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b140c8170 0x7f0b141efa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b19800640 1 -- 172.21.15.102:0/3676321318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009b30 con 0x7f0b14152020 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b19800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b141eff60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c001eb0 tx=0x7f0b0c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b10c00640 1 -- 172.21.15.102:0/3676321318 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0052d0 con 0x7f0b14152020 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b10c00640 1 -- 172.21.15.102:0/3676321318 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c005430 con 0x7f0b14152020 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b10c00640 1 -- 172.21.15.102:0/3676321318 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c003810 con 0x7f0b14152020 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b140b1620 con 0x7f0b14152020 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.101+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b140b1be0 con 0x7f0b14152020 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.103+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b141ef740 con 0x7f0b14152020 2024-03-25T05:37:37.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.103+0000 7f0b10c00640 1 -- 172.21.15.102:0/3676321318 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b0c003970 con 0x7f0b14152020 2024-03-25T05:37:37.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.105+0000 7f0b10c00640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0af406b810 0x7f0af406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.105+0000 7f0b10c00640 1 -- 172.21.15.102:0/3676321318 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0b0c089ac0 con 0x7f0b14152020 2024-03-25T05:37:37.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.105+0000 7f0b18e00640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0af406b810 0x7f0af406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.106+0000 7f0b18e00640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0af406b810 0x7f0af406dcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b08035000 tx=0x7f0b08030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:37.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.109+0000 7f0b10c00640 1 -- 172.21.15.102:0/3676321318 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0b141ef740 con 0x7f0b14152020 2024-03-25T05:37:37.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.391+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b141ef740 con 0x7f0b14152020 2024-03-25T05:37:37.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.393+0000 7f0b10c00640 1 -- 172.21.15.102:0/3676321318 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18563 (secure 0 0 0) 0x7f0b141ef740 con 0x7f0b14152020 2024-03-25T05:37:37.388 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:37.388 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:35.896606+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0af406b810 msgr2=0x7f0af406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0af406b810 0x7f0af406dcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b08035000 tx=0x7f0b08030000 comp rx=0 tx=0).stop 2024-03-25T05:37:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 msgr2=0x7f0b141eff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b141eff60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c001eb0 tx=0x7f0b0c00c890 comp rx=0 tx=0).stop 2024-03-25T05:37:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 shutdown_connections 2024-03-25T05:37:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0af406b810 0x7f0af406dcd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b14152020 0x7f0b141eff60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b140c8170 0x7f0b141efa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 --2- 172.21.15.102:0/3676321318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b140c3bb0 0x7f0b140cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 >> 172.21.15.102:0/3676321318 conn(0x7f0b14066ea0 msgr2=0x7f0b140715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 shutdown_connections 2024-03-25T05:37:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.397+0000 7f0b1b800640 1 -- 172.21.15.102:0/3676321318 wait complete. 2024-03-25T05:37:37.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:37.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.596+0000 7f9c6e000640 1 Processor -- start 2024-03-25T05:37:37.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.596+0000 7f9c6e000640 1 -- start start 2024-03-25T05:37:37.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c6e000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c680c7700 0x7f9c6815b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c6e000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6806e340 con 0x7f9c68152060 2024-03-25T05:37:37.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c6e000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c680c53b0 con 0x7f9c6815b6d0 2024-03-25T05:37:37.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c6e000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c68152440 con 0x7f9c680c7700 2024-03-25T05:37:37.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c5ea00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c680c7700 0x7f9c6815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c67400640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9c68152060 0x7f9c680c39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37642/0 (socket says 172.21.15.102:37642) 2024-03-25T05:37:37.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c5ea00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c680c7700 0x7f9c6815b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57704/0 (socket says 172.21.15.102:57704) 2024-03-25T05:37:37.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.598+0000 7f9c67400640 1 -- 172.21.15.102:0/998161481 learned_addr learned my addr 172.21.15.102:0/998161481 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.599+0000 7f9c5ea00640 1 -- 172.21.15.102:0/998161481 >> v1:172.21.15.187:6789/0 conn(0x7f9c6815b6d0 legacy=0x7f9c68162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.599+0000 7f9c5ea00640 1 -- 172.21.15.102:0/998161481 >> v1:172.21.15.102:6789/0 conn(0x7f9c68152060 legacy=0x7f9c680c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.599+0000 7f9c5ea00640 1 -- 172.21.15.102:0/998161481 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680c27d0 con 0x7f9c680c7700 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.599+0000 7f9c66a00640 1 -- 172.21.15.102:0/998161481 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686502357 0 0) 0x7f9c6806e340 con 0x7f9c68152060 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.600+0000 7f9c5ea00640 1 --2- 172.21.15.102:0/998161481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c680c7700 0x7f9c6815b190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c500097a0 tx=0x7f9c5002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5431d5b9d700c40 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.600+0000 7f9c66a00640 1 -- 172.21.15.102:0/998161481 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5002f810 con 0x7f9c680c7700 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.600+0000 7f9c66a00640 1 -- 172.21.15.102:0/998161481 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5002f970 con 0x7f9c680c7700 2024-03-25T05:37:37.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.600+0000 7f9c66a00640 1 -- 172.21.15.102:0/998161481 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5002fd00 con 0x7f9c680c7700 2024-03-25T05:37:37.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.600+0000 7f9c6e000640 1 -- 172.21.15.102:0/998161481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c680c7700 msgr2=0x7f9c6815b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.600+0000 7f9c6e000640 1 --2- 172.21.15.102:0/998161481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c680c7700 0x7f9c6815b190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c500097a0 tx=0x7f9c5002b9f0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.601+0000 7f9c6e000640 1 -- 172.21.15.102:0/998161481 shutdown_connections 2024-03-25T05:37:37.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.601+0000 7f9c6e000640 1 --2- 172.21.15.102:0/998161481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c680c7700 0x7f9c6815b190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.601+0000 7f9c6e000640 1 -- 172.21.15.102:0/998161481 >> 172.21.15.102:0/998161481 conn(0x7f9c680c7dd0 msgr2=0x7f9c680c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:37.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.601+0000 7f9c6e000640 1 -- 172.21.15.102:0/998161481 shutdown_connections 2024-03-25T05:37:37.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.601+0000 7f9c6e000640 1 -- 172.21.15.102:0/998161481 wait complete. 2024-03-25T05:37:37.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.602+0000 7f9c6e000640 1 Processor -- start 2024-03-25T05:37:37.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.602+0000 7f9c6e000640 1 -- start start 2024-03-25T05:37:37.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c6e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c680c7700 0x7f9c680c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c6e000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c68152060 0x7f9c680c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c6e000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c6815b6d0 0x7f9c680c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c6e000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c681e2440 con 0x7f9c6815b6d0 2024-03-25T05:37:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c6e000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c681e18a0 con 0x7f9c68152060 2024-03-25T05:37:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c6e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c681e2690 con 0x7f9c680c7700 2024-03-25T05:37:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c67e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c6815b6d0 0x7f9c680c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c67400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c680c7700 0x7f9c680c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c67e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c6815b6d0 0x7f9c680c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57708/0 (socket says 172.21.15.102:57708) 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.603+0000 7f9c67e00640 1 -- 172.21.15.102:0/2500614326 learned_addr learned my addr 172.21.15.102:0/2500614326 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c5ea00640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c68152060 0x7f9c680c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c67e00640 1 -- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c680c7700 msgr2=0x7f9c680c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c67e00640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c680c7700 0x7f9c680c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c67e00640 1 -- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c68152060 msgr2=0x7f9c680c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c67e00640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c68152060 0x7f9c680c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c67e00640 1 -- 172.21.15.102:0/2500614326 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50009400 con 0x7f9c6815b6d0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c67e00640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c6815b6d0 0x7f9c680c9ff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c390 tx=0x7f9c6000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c5fe00640 1 -- 172.21.15.102:0/2500614326 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600052d0 con 0x7f9c6815b6d0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c5fe00640 1 -- 172.21.15.102:0/2500614326 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60005430 con 0x7f9c6815b6d0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c5fe00640 1 -- 172.21.15.102:0/2500614326 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60003810 con 0x7f9c6815b6d0 2024-03-25T05:37:37.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.604+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c681e1b60 con 0x7f9c6815b6d0 2024-03-25T05:37:37.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.605+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6806f050 con 0x7f9c6815b6d0 2024-03-25T05:37:37.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.606+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c681e2080 con 0x7f9c6815b6d0 2024-03-25T05:37:37.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.606+0000 7f9c5fe00640 1 -- 172.21.15.102:0/2500614326 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c60003970 con 0x7f9c6815b6d0 2024-03-25T05:37:37.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.608+0000 7f9c5fe00640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c4406b840 0x7f9c4406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:37.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.608+0000 7f9c5fe00640 1 -- 172.21.15.102:0/2500614326 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9c60089a20 con 0x7f9c6815b6d0 2024-03-25T05:37:37.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.608+0000 7f9c67400640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c4406b840 0x7f9c4406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:37.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.609+0000 7f9c67400640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c4406b840 0x7f9c4406dd00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c58001920 tx=0x7f9c580018b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:37.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.611+0000 7f9c5fe00640 1 -- 172.21.15.102:0/2500614326 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9c681e2080 con 0x7f9c6815b6d0 2024-03-25T05:37:37.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.806+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c681e2080 con 0x7f9c6815b6d0 2024-03-25T05:37:37.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.808+0000 7f9c5fe00640 1 -- 172.21.15.102:0/2500614326 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f9c681e2080 con 0x7f9c6815b6d0 2024-03-25T05:37:37.803 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:37.803 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:37.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c4406b840 msgr2=0x7f9c4406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c4406b840 0x7f9c4406dd00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c58001920 tx=0x7f9c580018b0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c6815b6d0 msgr2=0x7f9c680c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:37.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c6815b6d0 0x7f9c680c9ff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c390 tx=0x7f9c6000c850 comp rx=0 tx=0).stop 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 shutdown_connections 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c4406b840 0x7f9c4406dd00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c6815b6d0 0x7f9c680c9ff0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c68152060 0x7f9c680c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 --2- 172.21.15.102:0/2500614326 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c680c7700 0x7f9c680c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 >> 172.21.15.102:0/2500614326 conn(0x7f9c680c7dd0 msgr2=0x7f9c6806b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 shutdown_connections 2024-03-25T05:37:37.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:37.811+0000 7f9c6e000640 1 -- 172.21.15.102:0/2500614326 wait complete. 2024-03-25T05:37:37.838 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T05:37:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.068+0000 7fce0d600640 1 Processor -- start 2024-03-25T05:37:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.068+0000 7fce0d600640 1 -- start start 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.069+0000 7fce0d600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fce08150c90 0x7fce080c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.069+0000 7fce0d600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fce080726d0 0x7fce080c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.069+0000 7fce0d600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce08159ea0 con 0x7fce0806bcb0 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.069+0000 7fce0d600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce08151070 con 0x7fce08150c90 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.069+0000 7fce0d600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce080c2840 con 0x7fce080726d0 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fce08150c90 0x7fce080c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fce08150c90 0x7fce080c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57724/0 (socket says 172.21.15.102:57724) 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07e00640 1 -- 172.21.15.102:0/2487496329 learned_addr learned my addr 172.21.15.102:0/2487496329 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07400640 1 --2- 172.21.15.102:0/2487496329 >> v2:172.21.15.187:3300/0 conn(0x7fce080726d0 0x7fce080c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07e00640 1 -- 172.21.15.102:0/2487496329 >> v2:172.21.15.187:3300/0 conn(0x7fce080726d0 msgr2=0x7fce080c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07e00640 1 --2- 172.21.15.102:0/2487496329 >> v2:172.21.15.187:3300/0 conn(0x7fce080726d0 0x7fce080c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07e00640 1 -- 172.21.15.102:0/2487496329 >> v1:172.21.15.187:6789/0 conn(0x7fce0806bcb0 legacy=0x7fce08070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.070+0000 7fce07e00640 1 -- 172.21.15.102:0/2487496329 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0815a140 con 0x7fce08150c90 2024-03-25T05:37:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.071+0000 7fce07e00640 1 --2- 172.21.15.102:0/2487496329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce08150c90 0x7fce080c4460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce0806ca60 tx=0x7fcdf802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b001edd45d453ea8 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:38.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.071+0000 7fce06a00640 1 -- 172.21.15.102:0/2487496329 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8030860 con 0x7fce08150c90 2024-03-25T05:37:38.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.071+0000 7fce06a00640 1 -- 172.21.15.102:0/2487496329 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf80309c0 con 0x7fce08150c90 2024-03-25T05:37:38.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.071+0000 7fce06a00640 1 -- 172.21.15.102:0/2487496329 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8030d50 con 0x7fce08150c90 2024-03-25T05:37:38.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 -- 172.21.15.102:0/2487496329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce08150c90 msgr2=0x7fce080c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 --2- 172.21.15.102:0/2487496329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce08150c90 0x7fce080c4460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce0806ca60 tx=0x7fcdf802b9a0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 -- 172.21.15.102:0/2487496329 shutdown_connections 2024-03-25T05:37:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 --2- 172.21.15.102:0/2487496329 >> v2:172.21.15.187:3300/0 conn(0x7fce080726d0 0x7fce080c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 --2- 172.21.15.102:0/2487496329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce08150c90 0x7fce080c4460 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 -- 172.21.15.102:0/2487496329 >> 172.21.15.102:0/2487496329 conn(0x7fce080cb340 msgr2=0x7fce080cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 -- 172.21.15.102:0/2487496329 shutdown_connections 2024-03-25T05:37:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.072+0000 7fce0d600640 1 -- 172.21.15.102:0/2487496329 wait complete. 2024-03-25T05:37:38.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.074+0000 7fce0d600640 1 Processor -- start 2024-03-25T05:37:38.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.074+0000 7fce0d600640 1 -- start start 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.074+0000 7fce0d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce0806bcb0 0x7fce0814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.074+0000 7fce0d600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce080726d0 0x7fce080c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.074+0000 7fce0d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce08150c90 0x7fce080c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce0d600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce080c6b60 con 0x7fce080726d0 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce0d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce080c5c50 con 0x7fce08150c90 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce0d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce081ed800 con 0x7fce0806bcb0 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce080726d0 0x7fce080c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce0806bcb0 0x7fce0814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce080726d0 0x7fce080c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57740/0 (socket says 172.21.15.102:57740) 2024-03-25T05:37:38.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 -- 172.21.15.102:0/1826392803 learned_addr learned my addr 172.21.15.102:0/1826392803 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce0cc00640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce08150c90 0x7fce080c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 -- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce0806bcb0 msgr2=0x7fce0814c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce0806bcb0 0x7fce0814c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 -- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce08150c90 msgr2=0x7fce080c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce08150c90 0x7fce080c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 -- 172.21.15.102:0/1826392803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80094d0 con 0x7fce080726d0 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.075+0000 7fce07400640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce080726d0 0x7fce080c60e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400e890 tx=0x7fcdf400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.076+0000 7fcdffe00640 1 -- 172.21.15.102:0/1826392803 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4004240 con 0x7fce080726d0 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.076+0000 7fcdffe00640 1 -- 172.21.15.102:0/1826392803 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40043a0 con 0x7fce080726d0 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.076+0000 7fcdffe00640 1 -- 172.21.15.102:0/1826392803 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf400c950 con 0x7fce080726d0 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.076+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce081edac0 con 0x7fce080726d0 2024-03-25T05:37:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.076+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce081ee080 con 0x7fce080726d0 2024-03-25T05:37:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.077+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0804f2f0 con 0x7fce080726d0 2024-03-25T05:37:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.078+0000 7fcdffe00640 1 -- 172.21.15.102:0/1826392803 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcdf400cab0 con 0x7fce080726d0 2024-03-25T05:37:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.078+0000 7fcdffe00640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcde806b810 0x7fcde806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.079+0000 7fcdffe00640 1 -- 172.21.15.102:0/1826392803 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcdf408a860 con 0x7fce080726d0 2024-03-25T05:37:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.079+0000 7fce07e00640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcde806b810 0x7fcde806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.079+0000 7fce07e00640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcde806b810 0x7fcde806dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8036000 tx=0x7fcdf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.083+0000 7fcdffe00640 1 -- 172.21.15.102:0/1826392803 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcdf4054f60 con 0x7fce080726d0 2024-03-25T05:37:38.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.304+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce080c5d90 con 0x7fce080726d0 2024-03-25T05:37:38.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.305+0000 7fcdffe00640 1 -- 172.21.15.102:0/1826392803 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6571 (secure 0 0 0) 0x7fcdf4017020 con 0x7fce080726d0 2024-03-25T05:37:38.299 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:38.299 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:35.897029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4291,"qdb_cluster":[4291]},"id":1}]} 2024-03-25T05:37:38.299 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 7 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcde806b810 msgr2=0x7fcde806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcde806b810 0x7fcde806dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8036000 tx=0x7fcdf8008030 comp rx=0 tx=0).stop 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce080726d0 msgr2=0x7fce080c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce080726d0 0x7fce080c60e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400e890 tx=0x7fcdf400ed50 comp rx=0 tx=0).stop 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 shutdown_connections 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcde806b810 0x7fcde806dcd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce08150c90 0x7fce080c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce080726d0 0x7fce080c60e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 --2- 172.21.15.102:0/1826392803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce0806bcb0 0x7fce0814c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.307+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 >> 172.21.15.102:0/1826392803 conn(0x7fce080cb340 msgr2=0x7fce0806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.308+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 shutdown_connections 2024-03-25T05:37:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.308+0000 7fce0d600640 1 -- 172.21.15.102:0/1826392803 wait complete. 2024-03-25T05:37:38.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.509+0000 7f3946c00640 1 Processor -- start 2024-03-25T05:37:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.509+0000 7f3946c00640 1 -- start start 2024-03-25T05:37:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.510+0000 7f3946c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3940154120 0x7f39400cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.510+0000 7f3946c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f39400c67e0 0x7f39400cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.510+0000 7f3946c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c6c10 0x7f39400c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.510+0000 7f3946c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3940154500 con 0x7f3940154120 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.510+0000 7f3946c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394006b250 con 0x7f39400c67e0 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.510+0000 7f3946c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400cbbe0 con 0x7f39400c6c10 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3940154120 0x7f39400cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3940154120 0x7f39400cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57756/0 (socket says 172.21.15.102:57756) 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 -- 172.21.15.102:0/1549336338 learned_addr learned my addr 172.21.15.102:0/1549336338 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3946200640 1 --2- 172.21.15.102:0/1549336338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c6c10 0x7f39400c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3944e00640 1 --2- 172.21.15.102:0/1549336338 >> v2:172.21.15.187:3300/0 conn(0x7f39400c67e0 0x7f39400cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 -- 172.21.15.102:0/1549336338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c6c10 msgr2=0x7f39400c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 --2- 172.21.15.102:0/1549336338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c6c10 0x7f39400c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 -- 172.21.15.102:0/1549336338 >> v2:172.21.15.187:3300/0 conn(0x7f39400c67e0 msgr2=0x7f39400cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 --2- 172.21.15.102:0/1549336338 >> v2:172.21.15.187:3300/0 conn(0x7f39400c67e0 0x7f39400cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.511+0000 7f3945800640 1 -- 172.21.15.102:0/1549336338 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400ca280 con 0x7f3940154120 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.512+0000 7f3945800640 1 --2- 172.21.15.102:0/1549336338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940154120 0x7f39400cb000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f39400ccf30 tx=0x7f393402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d122e7e154fac server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.512+0000 7f393fe00640 1 -- 172.21.15.102:0/1549336338 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934031870 con 0x7f3940154120 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f393fe00640 1 -- 172.21.15.102:0/1549336338 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340319d0 con 0x7f3940154120 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f393fe00640 1 -- 172.21.15.102:0/1549336338 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934031d60 con 0x7f3940154120 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 -- 172.21.15.102:0/1549336338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940154120 msgr2=0x7f39400cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 --2- 172.21.15.102:0/1549336338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940154120 0x7f39400cb000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f39400ccf30 tx=0x7f393402b910 comp rx=0 tx=0).stop 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 -- 172.21.15.102:0/1549336338 shutdown_connections 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 --2- 172.21.15.102:0/1549336338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c6c10 0x7f39400c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 --2- 172.21.15.102:0/1549336338 >> v2:172.21.15.187:3300/0 conn(0x7f39400c67e0 0x7f39400cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 --2- 172.21.15.102:0/1549336338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940154120 0x7f39400cb000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 -- 172.21.15.102:0/1549336338 >> 172.21.15.102:0/1549336338 conn(0x7f39400cf3e0 msgr2=0x7f39400cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 -- 172.21.15.102:0/1549336338 shutdown_connections 2024-03-25T05:37:38.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.513+0000 7f3946c00640 1 -- 172.21.15.102:0/1549336338 wait complete. 2024-03-25T05:37:38.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.515+0000 7f3946c00640 1 Processor -- start 2024-03-25T05:37:38.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.515+0000 7f3946c00640 1 -- start start 2024-03-25T05:37:38.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c67e0 0x7f3940148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39400c6c10 0x7f3940154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3940154120 0x7f3940159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940155070 con 0x7f39400c6c10 2024-03-25T05:37:38.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39401ef110 con 0x7f3940154120 2024-03-25T05:37:38.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39401ef3b0 con 0x7f39400c67e0 2024-03-25T05:37:38.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39400c6c10 0x7f3940154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39400c6c10 0x7f3940154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57758/0 (socket says 172.21.15.102:57758) 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 -- 172.21.15.102:0/3379550094 learned_addr learned my addr 172.21.15.102:0/3379550094 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3945800640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c67e0 0x7f3940148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946200640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3940154120 0x7f3940159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 -- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c67e0 msgr2=0x7f3940148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c67e0 0x7f3940148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 -- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3940154120 msgr2=0x7f3940159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3940154120 0x7f3940159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3944e00640 1 -- 172.21.15.102:0/3379550094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340094d0 con 0x7f39400c6c10 2024-03-25T05:37:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.516+0000 7f3946200640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3940154120 0x7f3940159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.517+0000 7f3944e00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39400c6c10 0x7f3940154b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f392c00d7d0 tx=0x7f392c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.517+0000 7f393d600640 1 -- 172.21.15.102:0/3379550094 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0096a0 con 0x7f39400c6c10 2024-03-25T05:37:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.517+0000 7f393d600640 1 -- 172.21.15.102:0/3379550094 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c009800 con 0x7f39400c6c10 2024-03-25T05:37:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.517+0000 7f393d600640 1 -- 172.21.15.102:0/3379550094 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c009bb0 con 0x7f39400c6c10 2024-03-25T05:37:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.517+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39400c40c0 con 0x7f39400c6c10 2024-03-25T05:37:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.517+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39400c57e0 con 0x7f39400c6c10 2024-03-25T05:37:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.518+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39401ef520 con 0x7f39400c6c10 2024-03-25T05:37:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.519+0000 7f393d600640 1 -- 172.21.15.102:0/3379550094 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f392c009d10 con 0x7f39400c6c10 2024-03-25T05:37:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.520+0000 7f393d600640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f392006b810 0x7f392006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.520+0000 7f393d600640 1 -- 172.21.15.102:0/3379550094 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f392c08a920 con 0x7f39400c6c10 2024-03-25T05:37:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.520+0000 7f3945800640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f392006b810 0x7f392006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.521+0000 7f3945800640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f392006b810 0x7f392006dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3934036000 tx=0x7f393403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.524+0000 7f393d600640 1 -- 172.21.15.102:0/3379550094 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f39401ef520 con 0x7f39400c6c10 2024-03-25T05:37:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.715+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39401ef520 con 0x7f39400c6c10 2024-03-25T05:37:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.717+0000 7f393d600640 1 -- 172.21.15.102:0/3379550094 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f39401ef520 con 0x7f39400c6c10 2024-03-25T05:37:38.712 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:38.712 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f392006b810 msgr2=0x7f392006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f392006b810 0x7f392006dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3934036000 tx=0x7f393403c040 comp rx=0 tx=0).stop 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39400c6c10 msgr2=0x7f3940154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39400c6c10 0x7f3940154b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f392c00d7d0 tx=0x7f392c00dc90 comp rx=0 tx=0).stop 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 shutdown_connections 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f392006b810 0x7f392006dcd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3940154120 0x7f3940159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39400c6c10 0x7f3940154b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 --2- 172.21.15.102:0/3379550094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39400c67e0 0x7f3940148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 >> 172.21.15.102:0/3379550094 conn(0x7f39400cf3e0 msgr2=0x7f39400ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 shutdown_connections 2024-03-25T05:37:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:38.720+0000 7f3946c00640 1 -- 172.21.15.102:0/3379550094 wait complete. 2024-03-25T05:37:39.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-25T05:37:30.879451+0000', 'modified': '2024-03-25T05:37:35.897029+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6835/2568369315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 2568369315}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 2568369315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4291, 'qdb_cluster': [4291]} 2024-03-25T05:37:39.336 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-25T05:37:39.336 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-25T05:37:39.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.574+0000 7f80e1200640 1 Processor -- start 2024-03-25T05:37:39.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.574+0000 7f80e1200640 1 -- start start 2024-03-25T05:37:39.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.575+0000 7f80e1200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.575+0000 7f80e1200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc15a060 con 0x7f80dc0c5940 2024-03-25T05:37:39.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.575+0000 7f80e1200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc15a340 con 0x7f80dc0cfcc0 2024-03-25T05:37:39.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.575+0000 7f80e1200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc15a620 con 0x7f80dc0c6240 2024-03-25T05:37:39.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d9e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f80dc0c5940 0x7f80dc0ca4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37658/0 (socket says 172.21.15.102:37658) 2024-03-25T05:37:39.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d9e00640 1 -- 172.21.15.102:0/2032943263 learned_addr learned my addr 172.21.15.102:0/2032943263 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:39.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d1400640 1 --2- 172.21.15.102:0/2032943263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d9400640 1 -- 172.21.15.102:0/2032943263 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362475266 0 0) 0x7f80dc15a060 con 0x7f80dc0c5940 2024-03-25T05:37:39.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d9400640 1 -- 172.21.15.102:0/2032943263 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c0003520 con 0x7f80dc0c5940 2024-03-25T05:37:39.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d9400640 1 -- 172.21.15.102:0/2032943263 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969114177 0 0) 0x7f80dc15a340 con 0x7f80dc0cfcc0 2024-03-25T05:37:39.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d1400640 1 -- 172.21.15.102:0/2032943263 >> v1:172.21.15.187:6789/0 conn(0x7f80dc0cfcc0 legacy=0x7f80dc0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d1400640 1 -- 172.21.15.102:0/2032943263 >> v1:172.21.15.102:6789/0 conn(0x7f80dc0c5940 legacy=0x7f80dc0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.576+0000 7f80d1400640 1 -- 172.21.15.102:0/2032943263 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc15a900 con 0x7f80dc0c6240 2024-03-25T05:37:39.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.578+0000 7f80d1400640 1 --2- 172.21.15.102:0/2032943263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc0cf780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0097d0 tx=0x7f80cc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2bab4a9946da99b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.578+0000 7f80d9400640 1 -- 172.21.15.102:0/2032943263 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc031890 con 0x7f80dc0c6240 2024-03-25T05:37:39.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.578+0000 7f80d9400640 1 -- 172.21.15.102:0/2032943263 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc0319f0 con 0x7f80dc0c6240 2024-03-25T05:37:39.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.578+0000 7f80d9400640 1 -- 172.21.15.102:0/2032943263 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc031d80 con 0x7f80dc0c6240 2024-03-25T05:37:39.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.579+0000 7f80e1200640 1 -- 172.21.15.102:0/2032943263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 msgr2=0x7f80dc0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.579+0000 7f80e1200640 1 --2- 172.21.15.102:0/2032943263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc0cf780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0097d0 tx=0x7f80cc02b930 comp rx=0 tx=0).stop 2024-03-25T05:37:39.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.579+0000 7f80e1200640 1 -- 172.21.15.102:0/2032943263 shutdown_connections 2024-03-25T05:37:39.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.579+0000 7f80e1200640 1 --2- 172.21.15.102:0/2032943263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc0cf780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.579+0000 7f80e1200640 1 -- 172.21.15.102:0/2032943263 >> 172.21.15.102:0/2032943263 conn(0x7f80dc0728c0 msgr2=0x7f80dc06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:39.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.579+0000 7f80e1200640 1 -- 172.21.15.102:0/2032943263 shutdown_connections 2024-03-25T05:37:39.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.579+0000 7f80e1200640 1 -- 172.21.15.102:0/2032943263 wait complete. 2024-03-25T05:37:39.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.580+0000 7f80e1200640 1 Processor -- start 2024-03-25T05:37:39.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.581+0000 7f80e1200640 1 -- start start 2024-03-25T05:37:39.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.581+0000 7f80e1200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc0c5940 0x7f80dc1f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.581+0000 7f80e1200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc1e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80e1200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80dc0cfcc0 0x7f80dc152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80e1200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1e37a0 con 0x7f80dc0c5940 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80e1200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1e3a80 con 0x7f80dc0cfcc0 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80e1200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1e2070 con 0x7f80dc0c6240 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc0c5940 0x7f80dc1f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc0c5940 0x7f80dc1f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57762/0 (socket says 172.21.15.102:57762) 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 -- 172.21.15.102:0/3575265354 learned_addr learned my addr 172.21.15.102:0/3575265354 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d1400640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc1e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80da800640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80dc0cfcc0 0x7f80dc152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 -- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 msgr2=0x7f80dc1e2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc1e2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 -- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80dc0cfcc0 msgr2=0x7f80dc152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80dc0cfcc0 0x7f80dc152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.582+0000 7f80d9e00640 1 -- 172.21.15.102:0/3575265354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc009400 con 0x7f80dc0c5940 2024-03-25T05:37:39.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.583+0000 7f80d9e00640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc0c5940 0x7f80dc1f0c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c430 tx=0x7f80c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.583+0000 7f80d2a00640 1 -- 172.21.15.102:0/3575265354 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4005ce0 con 0x7f80dc0c5940 2024-03-25T05:37:39.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.583+0000 7f80d2a00640 1 -- 172.21.15.102:0/3575265354 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4005e40 con 0x7f80dc0c5940 2024-03-25T05:37:39.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.583+0000 7f80d2a00640 1 -- 172.21.15.102:0/3575265354 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c40072f0 con 0x7f80dc0c5940 2024-03-25T05:37:39.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.583+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc0c5ea0 con 0x7f80dc0c5940 2024-03-25T05:37:39.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.583+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc1e2630 con 0x7f80dc0c5940 2024-03-25T05:37:39.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.585+0000 7f80d2a00640 1 -- 172.21.15.102:0/3575265354 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80c4007450 con 0x7f80dc0c5940 2024-03-25T05:37:39.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.586+0000 7f80d2a00640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f80b806b810 0x7f80b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.586+0000 7f80d2a00640 1 -- 172.21.15.102:0/3575265354 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f80c4089c00 con 0x7f80dc0c5940 2024-03-25T05:37:39.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.586+0000 7f80d1400640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f80b806b810 0x7f80b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.587+0000 7f80e3e71740 1 Processor -- start 2024-03-25T05:37:39.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.587+0000 7f80e3e71740 1 -- start start 2024-03-25T05:37:39.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.587+0000 7f80d1400640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f80b806b810 0x7f80b806dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80cc036000 tx=0x7f80cc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83780 0x555dcbc43520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc42220 0x555dcbc84140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83b60 0x555dcbc82a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80e3e71740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbbb1fb0 con 0x555dcbc83780 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbbaf4e0 con 0x555dcbc83b60 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcbbaacc0 con 0x555dcbc42220 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83780 0x555dcbc43520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc42220 0x555dcbc84140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80da800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83b60 0x555dcbc82a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83780 0x555dcbc43520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57772/0 (socket says 172.21.15.102:57772) 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 -- 172.21.15.102:0/1108448573 learned_addr learned my addr 172.21.15.102:0/1108448573 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 -- 172.21.15.102:0/1108448573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc42220 msgr2=0x555dcbc84140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc42220 0x555dcbc84140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 -- 172.21.15.102:0/1108448573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83b60 msgr2=0x555dcbc82a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83b60 0x555dcbc82a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80d9e00640 1 -- 172.21.15.102:0/1108448573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dcbb724c0 con 0x555dcbc83780 2024-03-25T05:37:39.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.588+0000 7f80da800640 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83b60 0x555dcbc82a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:39.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.589+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83780 0x555dcbc43520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80c4087cc0 tx=0x7f80c400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322aee2c784a551f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.589+0000 7f80caa00640 1 -- 172.21.15.102:0/1108448573 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c406f070 con 0x555dcbc83780 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.589+0000 7f80caa00640 1 -- 172.21.15.102:0/1108448573 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4007700 con 0x555dcbc83780 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.589+0000 7f80caa00640 1 -- 172.21.15.102:0/1108448573 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c40546c0 con 0x555dcbc83780 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.589+0000 7f80e3e71740 1 -- 172.21.15.102:0/1108448573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83780 msgr2=0x555dcbc43520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.589+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83780 0x555dcbc43520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80c4087cc0 tx=0x7f80c400a000 comp rx=0 tx=0).stop 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.590+0000 7f80e3e71740 1 -- 172.21.15.102:0/1108448573 shutdown_connections 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.590+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83b60 0x555dcbc82a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.590+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc42220 0x555dcbc84140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.590+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1108448573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83780 0x555dcbc43520 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.590+0000 7f80e3e71740 1 -- 172.21.15.102:0/1108448573 >> 172.21.15.102:0/1108448573 conn(0x555dcbc3f390 msgr2=0x555dcbc42b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:39.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.590+0000 7f80e3e71740 1 -- 172.21.15.102:0/1108448573 shutdown_connections 2024-03-25T05:37:39.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.590+0000 7f80e3e71740 1 -- 172.21.15.102:0/1108448573 wait complete. 2024-03-25T05:37:39.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.591+0000 7f80e3e71740 1 -- start start 2024-03-25T05:37:39.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.591+0000 7f80e3e71740 1 Processor -- start 2024-03-25T05:37:39.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbc62f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc61450 0x555dcbc618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80e3e71740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbb4fea0 con 0x555dcbc83b60 2024-03-25T05:37:39.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbb4fb40 con 0x555dcbc83780 2024-03-25T05:37:39.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcb8f2f20 con 0x555dcbc61450 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80e3e71740 10 client.0 _ll_register_callbacks cb 0x555dcb8bbac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbc62f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbc62f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57780/0 (socket says 172.21.15.102:57780) 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 -- 172.21.15.102:0/1298492912 learned_addr learned my addr 172.21.15.102:0/1298492912 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80da800640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc61450 0x555dcbc618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 -- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc61450 msgr2=0x555dcbc618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc61450 0x555dcbc618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 -- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 msgr2=0x555dcbc3cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d1400640 1 -- 172.21.15.102:0/1298492912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc1e2630 con 0x555dcbc83b60 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.593+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80d1400640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbc62f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80cc02bf40 tx=0x7f80cc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3d33f56f4b0981 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80bf400640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80bf400640 1 -- 172.21.15.102:0/1298492912 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc04f070 con 0x555dcbc83b60 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80bf400640 1 -- 172.21.15.102:0/1298492912 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f80cc03a630 con 0x555dcbc83b60 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dcb8aa6c0 con 0x555dcbc83b60 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80bf400640 1 -- 172.21.15.102:0/1298492912 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80cc040040 con 0x555dcbc83b60 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80e3e71740 10 client.4338 fetch_fsmap learned FSMap version 7 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.594+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555dcbba9340 con 0x555dcbc83b60 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80bf400640 1 -- 172.21.15.102:0/1298492912 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc05a070 con 0x555dcbc83b60 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80bf400640 1 -- 172.21.15.102:0/1298492912 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 7) v1 ==== 4472+0+0 (secure 0 0 0) 0x7f80cc03a7f0 con 0x555dcbc83b60 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80e3e71740 10 client.4338 fetch_fsmap finished waiting for FSMap version 7 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80e3e71740 10 client.4338 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80e3e71740 20 client.4338 populate_metadata read hostname 'smithi102' 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc97940 0x555dcbca2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80e3e71740 4 client.4338 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-25T05:37:39.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 --> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dcb8fb270 con 0x555dcbc97940 2024-03-25T05:37:39.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.595+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc97940 0x555dcbca2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.596+0000 7f80bf400640 10 client.4338 ms_handle_connect on v2:172.21.15.102:6834/2568369315 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.596+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc97940 0x555dcbca2480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da69e661d3842edb server_cookie=519af9c1e49bd262 in_seq=0 out_seq=0 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.596+0000 7f80bf400640 1 -- 172.21.15.102:0/1298492912 <== mds.0 v2:172.21.15.102:6834/2568369315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x555dcb8fb270 con 0x555dcbc97940 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.596+0000 7f80bf400640 10 client.4338 handle_command_reply: tid=0 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.596+0000 7f80e3e71740 1 client.4338 shutdown 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 msgr2=0x555dcbc62f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbc62f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80cc02bf40 tx=0x7f80cc02e000 comp rx=0 tx=0).stop 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 shutdown_connections 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc97940 0x555dcbca2480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc61450 0x555dcbc618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbc62f00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1298492912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 >> 172.21.15.102:0/1298492912 conn(0x555dcbc42220 msgr2=0x555dcbc6b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:39.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80bf400640 0 client.4338 ms_handle_reset on v2:172.21.15.102:6834/2568369315 2024-03-25T05:37:39.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 shutdown_connections 2024-03-25T05:37:39.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 1 -- 172.21.15.102:0/1298492912 wait complete. 2024-03-25T05:37:39.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.597+0000 7f80e3e71740 20 client.4338 trim_cache size 0 max 16384 2024-03-25T05:37:39.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.615+0000 7f80e3e71740 1 Processor -- start 2024-03-25T05:37:39.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.615+0000 7f80e3e71740 1 -- start start 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc61450 0x555dcbc3e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83b60 0x555dcbc8bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80e3e71740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbc8dc70 con 0x555dcbc61450 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbb5ebf0 con 0x555dcbc83780 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcbca77e0 con 0x555dcbc83b60 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80d9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc61450 0x555dcbc3e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80d1400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80d9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc61450 0x555dcbc3e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57790/0 (socket says 172.21.15.102:57790) 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80d9e00640 1 -- 172.21.15.102:0/1287521402 learned_addr learned my addr 172.21.15.102:0/1287521402 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80da800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83b60 0x555dcbc8bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80d9e00640 1 -- 172.21.15.102:0/1287521402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83b60 msgr2=0x555dcbc8bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83b60 0x555dcbc8bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.616+0000 7f80d9e00640 1 -- 172.21.15.102:0/1287521402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 msgr2=0x555dcbc3e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.617+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.617+0000 7f80d9e00640 1 -- 172.21.15.102:0/1287521402 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dcbb458b0 con 0x555dcbc61450 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.617+0000 7f80d1400640 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.617+0000 7f80d9e00640 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc61450 0x555dcbc3e130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80c40070a0 tx=0x7f80c4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2c93264a2faa91 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.617+0000 7f80ca000640 1 -- 172.21.15.102:0/1287521402 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4086040 con 0x555dcbc61450 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.617+0000 7f80ca000640 1 -- 172.21.15.102:0/1287521402 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4057e20 con 0x555dcbc61450 2024-03-25T05:37:39.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.617+0000 7f80ca000640 1 -- 172.21.15.102:0/1287521402 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c406f040 con 0x555dcbc61450 2024-03-25T05:37:39.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 -- 172.21.15.102:0/1287521402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc61450 msgr2=0x555dcbc3e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc61450 0x555dcbc3e130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80c40070a0 tx=0x7f80c4014000 comp rx=0 tx=0).stop 2024-03-25T05:37:39.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 -- 172.21.15.102:0/1287521402 shutdown_connections 2024-03-25T05:37:39.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83b60 0x555dcbc8bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc83780 0x555dcbc3e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 --2- 172.21.15.102:0/1287521402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc61450 0x555dcbc3e130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 -- 172.21.15.102:0/1287521402 >> 172.21.15.102:0/1287521402 conn(0x555dcbc42220 msgr2=0x555dcbc62ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:39.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 -- 172.21.15.102:0/1287521402 shutdown_connections 2024-03-25T05:37:39.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 -- 172.21.15.102:0/1287521402 wait complete. 2024-03-25T05:37:39.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.618+0000 7f80e3e71740 1 -- start start 2024-03-25T05:37:39.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.619+0000 7f80e3e71740 1 Processor -- start 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc61450 0x555dcbc41110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83780 0x555dcbc3e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80e3e71740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbcec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80e3e71740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbc41650 con 0x555dcbc83b60 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcbc8be40 con 0x555dcbc61450 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80e3e71740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcbc3f780 con 0x555dcbc83780 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80e3e71740 10 client.0 _ll_register_callbacks cb 0x7f80cc031c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.620+0000 7f80da800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbcec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80d9e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc61450 0x555dcbc41110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbcec7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57800/0 (socket says 172.21.15.102:57800) 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80d1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83780 0x555dcbc3e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 -- 172.21.15.102:0/504997270 learned_addr learned my addr 172.21.15.102:0/504997270 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 -- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83780 msgr2=0x555dcbc3e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83780 0x555dcbc3e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 -- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc61450 msgr2=0x555dcbc41110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc61450 0x555dcbc41110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 -- 172.21.15.102:0/504997270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dcbba9340 con 0x555dcbc83b60 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80d9e00640 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc61450 0x555dcbc41110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80d1400640 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83780 0x555dcbc3e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80da800640 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbcec7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x555dcbc81cc0 tx=0x7f80d4016ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636aafb7d4c35fc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80bf400640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80bf400640 1 -- 172.21.15.102:0/504997270 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d401b070 con 0x555dcbc83b60 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.621+0000 7f80bf400640 1 -- 172.21.15.102:0/504997270 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f80d401dc60 con 0x555dcbc83b60 2024-03-25T05:37:39.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80c4007700 con 0x555dcbc83b60 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80bf400640 1 -- 172.21.15.102:0/504997270 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80d401de20 con 0x555dcbc83b60 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 10 client.4344 fetch_fsmap learned FSMap version 7 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555dcbb724c0 con 0x555dcbc83b60 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80bf400640 1 -- 172.21.15.102:0/504997270 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4007700 con 0x555dcbc83b60 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80bf400640 1 -- 172.21.15.102:0/504997270 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 7) v1 ==== 4472+0+0 (secure 0 0 0) 0x7f80d4012070 con 0x555dcbc83b60 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 10 client.4344 fetch_fsmap finished waiting for FSMap version 7 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 10 client.4344 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 20 client.4344 populate_metadata read hostname 'smithi102' 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc903c0 0x555dcbc907a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 4 client.4344 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 --> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555dcb8e7610 con 0x555dcbc903c0 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.622+0000 7f80d9e00640 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc903c0 0x555dcbc907a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80d9e00640 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc903c0 0x555dcbc907a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09893a83facfc9b server_cookie=14f2bc3a447caf8d in_seq=0 out_seq=0 2024-03-25T05:37:39.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80bf400640 10 client.4344 ms_handle_connect on v2:172.21.15.102:6834/2568369315 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80bf400640 1 -- 172.21.15.102:0/504997270 <== mds.0 v2:172.21.15.102:6834/2568369315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x555dcb8e7610 con 0x555dcbc903c0 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80bf400640 10 client.4344 handle_command_reply: tid=0 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 client.4344 shutdown 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 msgr2=0x555dcbcec7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbcec7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x555dcbc81cc0 tx=0x7f80d4016ea0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 shutdown_connections 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x555dcbc903c0 0x555dcbc907a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555dcbc83b60 0x555dcbcec7e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555dcbc83780 0x555dcbc3e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 --2- 172.21.15.102:0/504997270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dcbc61450 0x555dcbc41110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.623+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 >> 172.21.15.102:0/504997270 conn(0x555dcbc42220 msgr2=0x555dcbc6b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80bf400640 0 client.4344 ms_handle_reset on v2:172.21.15.102:6834/2568369315 2024-03-25T05:37:39.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 shutdown_connections 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e3e71740 1 -- 172.21.15.102:0/504997270 wait complete. 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e3e71740 20 client.4344 trim_cache size 0 max 16384 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "ad358596-5ce1-459c-a1bc-1e91bde83a5b", 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4291, 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-03-25T05:37:39.622 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 8.228568439, 2024-03-25T05:37:39.623 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 7, 2024-03-25T05:37:39.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 25, 2024-03-25T05:37:39.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 23, 2024-03-25T05:37:39.623 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 13.556707837999999 2024-03-25T05:37:39.623 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T05:37:39.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f80b806b810 msgr2=0x7f80b806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f80b806b810 0x7f80b806dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80cc036000 tx=0x7f80cc03d040 comp rx=0 tx=0).stop 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc0c5940 msgr2=0x7f80dc1f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc0c5940 0x7f80dc1f0c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c430 tx=0x7f80c400c8f0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 shutdown_connections 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f80b806b810 0x7f80b806dcd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80dc0cfcc0 0x7f80dc152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80dc0c6240 0x7f80dc1e2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 --2- 172.21.15.102:0/3575265354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc0c5940 0x7f80dc1f0c10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.624+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 >> 172.21.15.102:0/3575265354 conn(0x7f80dc0728c0 msgr2=0x7f80dc1586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.625+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 shutdown_connections 2024-03-25T05:37:39.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.625+0000 7f80e1200640 1 -- 172.21.15.102:0/3575265354 wait complete. 2024-03-25T05:37:39.641 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-25T05:37:39.641 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:39.642 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-25T05:37:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.848+0000 7f43ad800640 1 Processor -- start 2024-03-25T05:37:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.848+0000 7f43ad800640 1 -- start start 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43ad800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f43a80c8590 0x7f43a80cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43ad800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a815a680 0x7f43a81646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43ad800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80c8e60 con 0x7f43a80cd940 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43ad800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80c9f60 con 0x7f43a80c8590 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43ad800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80ce260 con 0x7f43a815a680 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43a7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a815a680 0x7f43a81646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43a6a00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f43a80cd940 0x7f43a8159f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:45770/0 (socket says 172.21.15.102:45770) 2024-03-25T05:37:39.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43a6a00640 1 -- 172.21.15.102:0/148741938 learned_addr learned my addr 172.21.15.102:0/148741938 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.849+0000 7f43a6000640 1 --2- 172.21.15.102:0/148741938 >> v2:172.21.15.102:3300/0 conn(0x7f43a80c8590 0x7f43a80cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.850+0000 7f43a5600640 1 -- 172.21.15.102:0/148741938 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456923751 0 0) 0x7f43a80c8e60 con 0x7f43a80cd940 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.850+0000 7f43a5600640 1 -- 172.21.15.102:0/148741938 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c003520 con 0x7f43a80cd940 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.850+0000 7f43a6000640 1 -- 172.21.15.102:0/148741938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a815a680 msgr2=0x7f43a81646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.850+0000 7f43a6000640 1 --2- 172.21.15.102:0/148741938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a815a680 0x7f43a81646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.850+0000 7f43a6000640 1 -- 172.21.15.102:0/148741938 >> v1:172.21.15.187:6789/0 conn(0x7f43a80cd940 legacy=0x7f43a8159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.850+0000 7f43a6000640 1 -- 172.21.15.102:0/148741938 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a806fe80 con 0x7f43a80c8590 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.850+0000 7f43a7400640 1 --2- 172.21.15.102:0/148741938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a815a680 0x7f43a81646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.851+0000 7f43a6000640 1 --2- 172.21.15.102:0/148741938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a80c8590 0x7f43a80cdd20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43940097a0 tx=0x7f439402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d1f74bc23f700e server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.851+0000 7f43a5600640 1 -- 172.21.15.102:0/148741938 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394030800 con 0x7f43a80c8590 2024-03-25T05:37:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.851+0000 7f43a5600640 1 -- 172.21.15.102:0/148741938 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394030960 con 0x7f43a80c8590 2024-03-25T05:37:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.851+0000 7f43a5600640 1 -- 172.21.15.102:0/148741938 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394030cf0 con 0x7f43a80c8590 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 -- 172.21.15.102:0/148741938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a80c8590 msgr2=0x7f43a80cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 --2- 172.21.15.102:0/148741938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a80c8590 0x7f43a80cdd20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43940097a0 tx=0x7f439402b940 comp rx=0 tx=0).stop 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 -- 172.21.15.102:0/148741938 shutdown_connections 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 --2- 172.21.15.102:0/148741938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a815a680 0x7f43a81646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 --2- 172.21.15.102:0/148741938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a80c8590 0x7f43a80cdd20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 -- 172.21.15.102:0/148741938 >> 172.21.15.102:0/148741938 conn(0x7f43a8066ea0 msgr2=0x7f43a80672b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 -- 172.21.15.102:0/148741938 shutdown_connections 2024-03-25T05:37:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.852+0000 7f43ad800640 1 -- 172.21.15.102:0/148741938 wait complete. 2024-03-25T05:37:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.855+0000 7f43ad800640 1 Processor -- start 2024-03-25T05:37:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.855+0000 7f43ad800640 1 -- start start 2024-03-25T05:37:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.856+0000 7f43ad800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a80c8590 0x7f43a81499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.856+0000 7f43ad800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a80cd940 0x7f43a814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43ad800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a815a680 0x7f43a814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43ad800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8150220 con 0x7f43a815a680 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43ad800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a81f2c60 con 0x7f43a80c8590 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43ad800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80cb5e0 con 0x7f43a80cd940 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a815a680 0x7f43a814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a815a680 0x7f43a814f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57832/0 (socket says 172.21.15.102:57832) 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 -- 172.21.15.102:0/924170522 learned_addr learned my addr 172.21.15.102:0/924170522 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a6000640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a80cd940 0x7f43a814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a6a00640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a80c8590 0x7f43a81499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 -- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a80cd940 msgr2=0x7f43a814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a80cd940 0x7f43a814f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 -- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a80c8590 msgr2=0x7f43a81499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a80c8590 0x7f43a81499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.857+0000 7f43a7400640 1 -- 172.21.15.102:0/924170522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0009a70 con 0x7f43a815a680 2024-03-25T05:37:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.858+0000 7f43a7400640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a815a680 0x7f43a814f970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43a000ef90 tx=0x7f43a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.858+0000 7f439ea00640 1 -- 172.21.15.102:0/924170522 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0009cd0 con 0x7f43a815a680 2024-03-25T05:37:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.858+0000 7f439ea00640 1 -- 172.21.15.102:0/924170522 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000f040 con 0x7f43a815a680 2024-03-25T05:37:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.858+0000 7f439ea00640 1 -- 172.21.15.102:0/924170522 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a00146a0 con 0x7f43a815a680 2024-03-25T05:37:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.858+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4394009400 con 0x7f43a815a680 2024-03-25T05:37:39.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.858+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a80cd020 con 0x7f43a815a680 2024-03-25T05:37:39.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.859+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a81f2dd0 con 0x7f43a815a680 2024-03-25T05:37:39.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.861+0000 7f439ea00640 1 -- 172.21.15.102:0/924170522 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43a0014800 con 0x7f43a815a680 2024-03-25T05:37:39.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.862+0000 7f439ea00640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f438806b840 0x7f438806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:39.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.863+0000 7f439ea00640 1 -- 172.21.15.102:0/924170522 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f43a008b2e0 con 0x7f43a815a680 2024-03-25T05:37:39.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.863+0000 7f43a6a00640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f438806b840 0x7f438806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:39.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.863+0000 7f43a6a00640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f438806b840 0x7f438806dd00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43980011e0 tx=0x7f4398007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:39.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:39.868+0000 7f439ea00640 1 -- 172.21.15.102:0/924170522 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f43a0055a70 con 0x7f43a815a680 2024-03-25T05:37:40.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.102+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43a8067fb0 con 0x7f43a815a680 2024-03-25T05:37:40.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.103+0000 7f439ea00640 1 -- 172.21.15.102:0/924170522 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f43a0059130 con 0x7f43a815a680 2024-03-25T05:37:40.097 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f438806b840 msgr2=0x7f438806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f438806b840 0x7f438806dd00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43980011e0 tx=0x7f4398007d30 comp rx=0 tx=0).stop 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a815a680 msgr2=0x7f43a814f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a815a680 0x7f43a814f970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43a000ef90 tx=0x7f43a000c490 comp rx=0 tx=0).stop 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 shutdown_connections 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f438806b840 0x7f438806dd00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a815a680 0x7f43a814f970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43a80cd940 0x7f43a814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 --2- 172.21.15.102:0/924170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a80c8590 0x7f43a81499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.106+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 >> 172.21.15.102:0/924170522 conn(0x7f43a8066ea0 msgr2=0x7f43a8067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:40.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.107+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 shutdown_connections 2024-03-25T05:37:40.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:40.107+0000 7f43ad800640 1 -- 172.21.15.102:0/924170522 wait complete. 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-25T05:37:40.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-25T05:37:40.123 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-25T05:37:40.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:40.123 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-03-25T05:37:40.168 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-25T05:37:40.168 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-25T05:37:40.168 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-03-25T05:37:40.168 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-03-25T05:37:40.169 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-25T05:37:40.170 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42654sec preferred_lft 42654sec 2024-03-25T05:37:40.170 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-03-25T05:37:40.170 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-03-25T05:37:40.171 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-25T05:37:40.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:40.171 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:37:40.171 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:37:40.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-03-25T05:37:40.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-03-25T05:37:40.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-03-25T05:37:40.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-25T05:37:40.171 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:37:40.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:40.644 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-25T05:37:40.717 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-03-25T05:37:40.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:40.721 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-03-25T05:37:40.781 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-03-25T05:37:40.781 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-25T05:37:40.781 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-25T05:37:40.781 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-25T05:37:40.781 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-25T05:37:40.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:40.782 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:37:40.782 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:37:40.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-25T05:37:40.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-25T05:37:40.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-25T05:37:40.782 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:37:41.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:41.449 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-03-25T05:37:41.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:41.500 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-03-25T05:37:41.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:41.547 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:37:41.547 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:37:41.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:37:41.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-25T05:37:41.547 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:37:41.674 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-25T05:37:41.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-25T05:37:41.675 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:37:41.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:41.962 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:37:41.962 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:37:41.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-03-25T05:37:41.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-03-25T05:37:41.962 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:37:42.117 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-25T05:37:42.117 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-25T05:37:42.117 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:42.163 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-25T05:37:42.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-25T05:37:42.163 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:42.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-03-25T05:37:42.325 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2024-03-25T05:37:42.370 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/selinux 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysctl.service 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/nfs/rpc_pipefs 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2024-03-25T05:37:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2024-03-25T05:37:42.372 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2024-03-25T05:37:42.372 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2024-03-25T05:37:42.372 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2024-03-25T05:37:42.372 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2024-03-25T05:37:42.372 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2024-03-25T05:37:42.372 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:37:42.372 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:37:42.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:42.373 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-03-25T05:37:42.466 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-25T05:37:42.467 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-25T05:37:42.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-03-25T05:37:42.544 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2024-03-25T05:37:42.589 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/selinux 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysctl.service 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/nfs/rpc_pipefs 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2024-03-25T05:37:42.590 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2024-03-25T05:37:42.591 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2024-03-25T05:37:42.591 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2024-03-25T05:37:42.591 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2024-03-25T05:37:42.591 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2024-03-25T05:37:42.591 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2024-03-25T05:37:42.591 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:37:42.591 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:37:42.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:42.592 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-03-25T05:37:42.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi102.stderr:2024-03-25T05:37:42.675+0000 7f677ff67480 -1 init, newargv = 0x55cdef150780 newargc=15 2024-03-25T05:37:42.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi102.stderr:ceph-fuse[42041]: starting ceph client 2024-03-25T05:37:42.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi102.stderr:ceph-fuse[42041]: starting fuse 2024-03-25T05:37:43.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-03-25T05:37:43.876 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2024-03-25T05:37:43.928 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/selinux 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysctl.service 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-25T05:37:43.929 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/nfs/rpc_pipefs 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:37:43.930 INFO:teuthology.orchestra.run.smithi102.stdout:/home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:43.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:43.931 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-03-25T05:37:43.973 INFO:teuthology.orchestra.run.smithi102.stdout:40 2024-03-25T05:37:43.974 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> sudo stdin-killer -- python3 -c ' 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> import re 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> import os 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2024-03-25T05:37:43.974 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> return f 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-25T05:37:43.975 DEBUG:teuthology.orchestra.run.smithi102:> 2024-03-25T05:37:43.976 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.admin")) 2024-03-25T05:37:43.976 DEBUG:teuthology.orchestra.run.smithi102:> ' 2024-03-25T05:37:44.187 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.admin.42041.asok 2024-03-25T05:37:44.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-25T05:37:44.205 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42041.asok 2024-03-25T05:37:44.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:44.205 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42041.asok status 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "f73f1dfd96849300c4322bd7259a3ab37f94c200", 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.0.0-1764-gf73f1dfd (f73f1dfd96849300c4322bd7259a3ab37f94c200) squid (dev)", 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "admin", 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "42041", 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2024-03-25T05:37:44.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4441, 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4441 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1371044491 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-25T05:37:44.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1371044491 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4441 172.21.15.102:0/1371044491", 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/1371044491", 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 7, 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 25, 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2024-03-25T05:37:44.437 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T05:37:44.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:44.449 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2024-03-25T05:37:44.449 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:44.501 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2024-03-25T05:37:44.501 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:44.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:44.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:44.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:44.593 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-25T05:37:44.682 INFO:teuthology.orchestra.run.smithi102.stdout:# file: . 2024-03-25T05:37:44.682 INFO:teuthology.orchestra.run.smithi102.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-25T05:37:44.682 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:44.684 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:44.684 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-25T05:37:44.730 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.984+0000 7ff1d4400640 1 Processor -- start 2024-03-25T05:37:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.984+0000 7ff1d4400640 1 -- start start 2024-03-25T05:37:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.986+0000 7ff1d4400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff1cc152060 0x7ff1cc0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.986+0000 7ff1d4400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.986+0000 7ff1d4400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc06e340 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.986+0000 7ff1d4400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc152440 con 0x7ff1cc152060 2024-03-25T05:37:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.986+0000 7ff1d4400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c53b0 con 0x7ff1cc0c3dc0 2024-03-25T05:37:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.986+0000 7ff1d2400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d1000640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff1cc0c39c0 0x7ff1cc15b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48368/0 (socket says 172.21.15.102:48368) 2024-03-25T05:37:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d2400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc15b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36516/0 (socket says 172.21.15.102:36516) 2024-03-25T05:37:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d1000640 1 -- 172.21.15.102:0/196900621 learned_addr learned my addr 172.21.15.102:0/196900621 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d1a00640 1 --2- 172.21.15.102:0/196900621 >> v2:172.21.15.187:3300/0 conn(0x7ff1cc152060 0x7ff1cc0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d2400640 1 -- 172.21.15.102:0/196900621 >> v2:172.21.15.187:3300/0 conn(0x7ff1cc152060 msgr2=0x7ff1cc0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d2400640 1 --2- 172.21.15.102:0/196900621 >> v2:172.21.15.187:3300/0 conn(0x7ff1cc152060 0x7ff1cc0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d2400640 1 -- 172.21.15.102:0/196900621 >> v1:172.21.15.102:6789/0 conn(0x7ff1cc0c39c0 legacy=0x7ff1cc15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1d2400640 1 -- 172.21.15.102:0/196900621 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0c4270 con 0x7ff1cc0c3dc0 2024-03-25T05:37:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.987+0000 7ff1cbe00640 1 -- 172.21.15.102:0/196900621 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191811130 0 0) 0x7ff1cc06e340 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.988+0000 7ff1d2400640 1 --2- 172.21.15.102:0/196900621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc15b8a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009d90 tx=0x7ff1c402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee2cc440416140f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.988+0000 7ff1cbe00640 1 -- 172.21.15.102:0/196900621 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c402cce0 con 0x7ff1cc0c3dc0 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1cbe00640 1 -- 172.21.15.102:0/196900621 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c402ce40 con 0x7ff1cc0c3dc0 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1cbe00640 1 -- 172.21.15.102:0/196900621 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4034660 con 0x7ff1cc0c3dc0 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 -- 172.21.15.102:0/196900621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 msgr2=0x7ff1cc15b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 --2- 172.21.15.102:0/196900621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc15b8a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009d90 tx=0x7ff1c402bf30 comp rx=0 tx=0).stop 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 -- 172.21.15.102:0/196900621 shutdown_connections 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 --2- 172.21.15.102:0/196900621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc15b8a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 --2- 172.21.15.102:0/196900621 >> v2:172.21.15.187:3300/0 conn(0x7ff1cc152060 0x7ff1cc0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 -- 172.21.15.102:0/196900621 >> 172.21.15.102:0/196900621 conn(0x7ff1cc0c7dd0 msgr2=0x7ff1cc0c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 -- 172.21.15.102:0/196900621 shutdown_connections 2024-03-25T05:37:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.989+0000 7ff1d4400640 1 -- 172.21.15.102:0/196900621 wait complete. 2024-03-25T05:37:44.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.991+0000 7ff1d4400640 1 Processor -- start 2024-03-25T05:37:44.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.991+0000 7ff1d4400640 1 -- start start 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d4400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1cc0c39c0 0x7ff1cc143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d4400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc1f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d4400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1cc152060 0x7ff1cc1f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d4400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1f30b0 con 0x7ff1cc152060 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d4400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1e5860 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d4400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1e2f00 con 0x7ff1cc0c3dc0 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d1a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1cc0c39c0 0x7ff1cc143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d1000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc1f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d2400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1cc152060 0x7ff1cc1f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d1a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1cc0c39c0 0x7ff1cc143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:58076/0 (socket says 172.21.15.102:58076) 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d1a00640 1 -- 172.21.15.102:0/215380536 learned_addr learned my addr 172.21.15.102:0/215380536 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.992+0000 7ff1d1000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc1f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36526/0 (socket says 172.21.15.102:36526) 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1d1a00640 1 -- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 msgr2=0x7ff1cc1f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1d1a00640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc1f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1d1a00640 1 -- 172.21.15.102:0/215380536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1cc152060 msgr2=0x7ff1cc1f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1d1a00640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1cc152060 0x7ff1cc1f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1d1a00640 1 -- 172.21.15.102:0/215380536 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4009a70 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1d1a00640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1cc0c39c0 0x7ff1cc143400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000e870 tx=0x7ff1c000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1c9600640 1 -- 172.21.15.102:0/215380536 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00094f0 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1c9600640 1 -- 172.21.15.102:0/215380536 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000c940 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.993+0000 7ff1c9600640 1 -- 172.21.15.102:0/215380536 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000ccf0 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.994+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc1e31e0 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.994+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc1f3300 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.995+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0c5620 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.996+0000 7ff1c9600640 1 -- 172.21.15.102:0/215380536 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1c0013470 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.996+0000 7ff1c9600640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff1ac06b810 0x7ff1ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:44.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.997+0000 7ff1c9600640 1 -- 172.21.15.102:0/215380536 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff1c008a5b0 con 0x7ff1cc0c39c0 2024-03-25T05:37:44.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.997+0000 7ff1d1000640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff1ac06b810 0x7ff1ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:44.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:44.997+0000 7ff1d1000640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff1ac06b810 0x7ff1ac06dcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc14c020 tx=0x7ff1b8007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.001+0000 7ff1c9600640 1 -- 172.21.15.102:0/215380536 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff1c0054ca0 con 0x7ff1cc0c39c0 2024-03-25T05:37:45.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.218+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1cc067fb0 con 0x7ff1cc0c39c0 2024-03-25T05:37:45.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.220+0000 7ff1c9600640 1 -- 172.21.15.102:0/215380536 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7ff1c0058360 con 0x7ff1cc0c39c0 2024-03-25T05:37:45.214 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:45.214 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff1ac06b810 msgr2=0x7ff1ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff1ac06b810 0x7ff1ac06dcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc14c020 tx=0x7ff1b8007d50 comp rx=0 tx=0).stop 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1cc0c39c0 msgr2=0x7ff1cc143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1cc0c39c0 0x7ff1cc143400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000e870 tx=0x7ff1c000ed30 comp rx=0 tx=0).stop 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 shutdown_connections 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff1ac06b810 0x7ff1ac06dcd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1cc152060 0x7ff1cc1f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1cc0c3dc0 0x7ff1cc1f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 --2- 172.21.15.102:0/215380536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1cc0c39c0 0x7ff1cc143400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 >> 172.21.15.102:0/215380536 conn(0x7ff1cc0c7dd0 msgr2=0x7ff1cc074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 shutdown_connections 2024-03-25T05:37:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.222+0000 7ff1d4400640 1 -- 172.21.15.102:0/215380536 wait complete. 2024-03-25T05:37:45.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T05:37:25.079908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-25T05:37:29.008596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-25T05:37:29.891587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-25T05:37:33.466049+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-25T05:37:45.236 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-25T05:37:45.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.459+0000 7f84baa00640 1 Processor -- start 2024-03-25T05:37:45.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.459+0000 7f84baa00640 1 -- start start 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84baa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84b40c6de0 0x7f84b40c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84baa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f84b406f8e0 0x7f84b406fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84baa00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b406f430 con 0x7f84b4153f50 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84baa00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40c7770 con 0x7f84b40c6de0 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84baa00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b4154330 con 0x7f84b406f8e0 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84b8c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84b40c6de0 0x7f84b40c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84b9600640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f84b4153f50 0x7f84b40c7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48384/0 (socket says 172.21.15.102:48384) 2024-03-25T05:37:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84b9600640 1 -- 172.21.15.102:0/3378453440 learned_addr learned my addr 172.21.15.102:0/3378453440 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.462+0000 7f84ba000640 1 --2- 172.21.15.102:0/3378453440 >> v2:172.21.15.187:3300/0 conn(0x7f84b406f8e0 0x7f84b406fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.463+0000 7f84b8c00640 1 -- 172.21.15.102:0/3378453440 >> v2:172.21.15.187:3300/0 conn(0x7f84b406f8e0 msgr2=0x7f84b406fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.463+0000 7f84b8c00640 1 --2- 172.21.15.102:0/3378453440 >> v2:172.21.15.187:3300/0 conn(0x7f84b406f8e0 0x7f84b406fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.463+0000 7f84b8c00640 1 -- 172.21.15.102:0/3378453440 >> v1:172.21.15.102:6789/0 conn(0x7f84b4153f50 legacy=0x7f84b40c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.463+0000 7f84b8c00640 1 -- 172.21.15.102:0/3378453440 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4159f00 con 0x7f84b40c6de0 2024-03-25T05:37:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.464+0000 7f84b8c00640 1 --2- 172.21.15.102:0/3378453440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c7230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84b40c8dd0 tx=0x7f84a002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f0e913d2eb1397 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:45.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.464+0000 7f84b3e00640 1 -- 172.21.15.102:0/3378453440 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0030610 con 0x7f84b40c6de0 2024-03-25T05:37:45.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.464+0000 7f84b3e00640 1 -- 172.21.15.102:0/3378453440 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a0030770 con 0x7f84b40c6de0 2024-03-25T05:37:45.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.464+0000 7f84b3e00640 1 -- 172.21.15.102:0/3378453440 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0030b00 con 0x7f84b40c6de0 2024-03-25T05:37:45.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.465+0000 7f84baa00640 1 -- 172.21.15.102:0/3378453440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 msgr2=0x7f84b40c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.465+0000 7f84baa00640 1 --2- 172.21.15.102:0/3378453440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c7230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84b40c8dd0 tx=0x7f84a002b960 comp rx=0 tx=0).stop 2024-03-25T05:37:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.465+0000 7f84baa00640 1 -- 172.21.15.102:0/3378453440 shutdown_connections 2024-03-25T05:37:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.465+0000 7f84baa00640 1 --2- 172.21.15.102:0/3378453440 >> v2:172.21.15.187:3300/0 conn(0x7f84b406f8e0 0x7f84b406fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.465+0000 7f84baa00640 1 --2- 172.21.15.102:0/3378453440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c7230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.465+0000 7f84baa00640 1 -- 172.21.15.102:0/3378453440 >> 172.21.15.102:0/3378453440 conn(0x7f84b406de60 msgr2=0x7f84b406e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.465+0000 7f84baa00640 1 -- 172.21.15.102:0/3378453440 shutdown_connections 2024-03-25T05:37:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.466+0000 7f84baa00640 1 -- 172.21.15.102:0/3378453440 wait complete. 2024-03-25T05:37:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.468+0000 7f84baa00640 1 Processor -- start 2024-03-25T05:37:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.468+0000 7f84baa00640 1 -- start start 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84baa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84b406f8e0 0x7f84b414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84baa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84baa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84b4153f50 0x7f84b4145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84baa00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41ef780 con 0x7f84b40c6de0 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84baa00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41f05a0 con 0x7f84b406f8e0 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84baa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41efa20 con 0x7f84b4153f50 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84b8c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84ba000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84b4153f50 0x7f84b4145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84ba000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84b4153f50 0x7f84b4145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36538/0 (socket says 172.21.15.102:36538) 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84b9600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84b406f8e0 0x7f84b414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.470+0000 7f84ba000640 1 -- 172.21.15.102:0/3260924779 learned_addr learned my addr 172.21.15.102:0/3260924779 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84ba000640 1 -- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84b406f8e0 msgr2=0x7f84b414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84ba000640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84b406f8e0 0x7f84b414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84ba000640 1 -- 172.21.15.102:0/3260924779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 msgr2=0x7f84b40c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84ba000640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84ba000640 1 -- 172.21.15.102:0/3260924779 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009400 con 0x7f84b4153f50 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84b9600640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84b406f8e0 0x7f84b414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84b8c00640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84ba000640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84b4153f50 0x7f84b4145a20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00efc0 tx=0x7f84ac00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84b1600640 1 -- 172.21.15.102:0/3260924779 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac014480 con 0x7f84b4153f50 2024-03-25T05:37:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84b1600640 1 -- 172.21.15.102:0/3260924779 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac00f040 con 0x7f84b4153f50 2024-03-25T05:37:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84b1600640 1 -- 172.21.15.102:0/3260924779 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac014820 con 0x7f84b4153f50 2024-03-25T05:37:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.471+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b41efd00 con 0x7f84b4153f50 2024-03-25T05:37:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.472+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b41f02c0 con 0x7f84b4153f50 2024-03-25T05:37:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.473+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b41f0ae0 con 0x7f84b4153f50 2024-03-25T05:37:45.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.475+0000 7f84b1600640 1 -- 172.21.15.102:0/3260924779 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84ac014980 con 0x7f84b4153f50 2024-03-25T05:37:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.475+0000 7f84b1600640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f849406b840 0x7f849406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.476+0000 7f84b1600640 1 -- 172.21.15.102:0/3260924779 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f84ac08afc0 con 0x7f84b4153f50 2024-03-25T05:37:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.476+0000 7f84b9600640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f849406b840 0x7f849406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.476+0000 7f84b9600640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f849406b840 0x7f849406dd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007fd0 tx=0x7f84a8007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.481+0000 7f84b1600640 1 -- 172.21.15.102:0/3260924779 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f84b41f0ae0 con 0x7f84b4153f50 2024-03-25T05:37:45.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.676+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84b41f0ae0 con 0x7f84b4153f50 2024-03-25T05:37:45.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.677+0000 7f84b1600640 1 -- 172.21.15.102:0/3260924779 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84b41f0ae0 con 0x7f84b4153f50 2024-03-25T05:37:45.672 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-03-25T05:37:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f849406b840 msgr2=0x7f849406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f849406b840 0x7f849406dd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007fd0 tx=0x7f84a8007e80 comp rx=0 tx=0).stop 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84b4153f50 msgr2=0x7f84b4145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84b4153f50 0x7f84b4145a20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00efc0 tx=0x7f84ac00c490 comp rx=0 tx=0).stop 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 shutdown_connections 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f849406b840 0x7f849406dd00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84b4153f50 0x7f84b4145a20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b40c6de0 0x7f84b40c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 --2- 172.21.15.102:0/3260924779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84b406f8e0 0x7f84b414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 >> 172.21.15.102:0/3260924779 conn(0x7f84b406de60 msgr2=0x7f84b40c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 shutdown_connections 2024-03-25T05:37:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.680+0000 7f84baa00640 1 -- 172.21.15.102:0/3260924779 wait complete. 2024-03-25T05:37:45.692 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-25T05:37:45.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.895+0000 7fe544400640 1 Processor -- start 2024-03-25T05:37:45.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.896+0000 7fe544400640 1 -- start start 2024-03-25T05:37:45.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.897+0000 7fe544400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe53c0c5a50 0x7fe53c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.897+0000 7fe544400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe53c0ca630 0x7fe53c164700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.897+0000 7fe544400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53c0c4e20 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.897+0000 7fe544400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53c15e120 con 0x7fe53c0c5a50 2024-03-25T05:37:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.897+0000 7fe544400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53c0b28d0 con 0x7fe53c0ca630 2024-03-25T05:37:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe541a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe53c0cb1e0 0x7fe53c0c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48386/0 (socket says 172.21.15.102:48386) 2024-03-25T05:37:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe541a00640 1 -- 172.21.15.102:0/4047081812 learned_addr learned my addr 172.21.15.102:0/4047081812 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe541000640 1 --2- 172.21.15.102:0/4047081812 >> v2:172.21.15.102:3300/0 conn(0x7fe53c0c5a50 0x7fe53c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe542400640 1 --2- 172.21.15.102:0/4047081812 >> v2:172.21.15.187:3300/0 conn(0x7fe53c0ca630 0x7fe53c164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe53be00640 1 -- 172.21.15.102:0/4047081812 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336669220 0 0) 0x7fe53c0c4e20 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe53be00640 1 -- 172.21.15.102:0/4047081812 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe524003520 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe541000640 1 -- 172.21.15.102:0/4047081812 >> v2:172.21.15.187:3300/0 conn(0x7fe53c0ca630 msgr2=0x7fe53c164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe541000640 1 --2- 172.21.15.102:0/4047081812 >> v2:172.21.15.187:3300/0 conn(0x7fe53c0ca630 0x7fe53c164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe541000640 1 -- 172.21.15.102:0/4047081812 >> v1:172.21.15.102:6789/0 conn(0x7fe53c0cb1e0 legacy=0x7fe53c0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.898+0000 7fe541000640 1 -- 172.21.15.102:0/4047081812 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c15d4a0 con 0x7fe53c0c5a50 2024-03-25T05:37:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.899+0000 7fe541000640 1 --2- 172.21.15.102:0/4047081812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0c5a50 0x7fe53c0cb5c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0cc290 tx=0x7fe52802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f895973068de5a server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe53be00640 1 -- 172.21.15.102:0/4047081812 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52802e070 con 0x7fe53c0c5a50 2024-03-25T05:37:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe53be00640 1 -- 172.21.15.102:0/4047081812 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5280315a0 con 0x7fe53c0c5a50 2024-03-25T05:37:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe53be00640 1 -- 172.21.15.102:0/4047081812 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528031910 con 0x7fe53c0c5a50 2024-03-25T05:37:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 -- 172.21.15.102:0/4047081812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0c5a50 msgr2=0x7fe53c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 --2- 172.21.15.102:0/4047081812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0c5a50 0x7fe53c0cb5c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0cc290 tx=0x7fe52802b840 comp rx=0 tx=0).stop 2024-03-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 -- 172.21.15.102:0/4047081812 shutdown_connections 2024-03-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 --2- 172.21.15.102:0/4047081812 >> v2:172.21.15.187:3300/0 conn(0x7fe53c0ca630 0x7fe53c164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 --2- 172.21.15.102:0/4047081812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0c5a50 0x7fe53c0cb5c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 -- 172.21.15.102:0/4047081812 >> 172.21.15.102:0/4047081812 conn(0x7fe53c066cc0 msgr2=0x7fe53c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 -- 172.21.15.102:0/4047081812 shutdown_connections 2024-03-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.900+0000 7fe544400640 1 -- 172.21.15.102:0/4047081812 wait complete. 2024-03-25T05:37:45.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.903+0000 7fe544400640 1 Processor -- start 2024-03-25T05:37:45.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.903+0000 7fe544400640 1 -- start start 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe544400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe53c0c5a50 0x7fe53c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe544400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe53c0ca630 0x7fe53c0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe544400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0cb1e0 0x7fe53c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe544400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c0c7120 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe544400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c151830 con 0x7fe53c0ca630 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe544400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c1f0220 con 0x7fe53c0c5a50 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0cb1e0 0x7fe53c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe541a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe53c0c5a50 0x7fe53c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe541000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe53c0ca630 0x7fe53c0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0cb1e0 0x7fe53c0c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47858/0 (socket says 172.21.15.102:47858) 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe541a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe53c0c5a50 0x7fe53c149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36554/0 (socket says 172.21.15.102:36554) 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 -- 172.21.15.102:0/513469621 learned_addr learned my addr 172.21.15.102:0/513469621 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 -- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe53c0c5a50 msgr2=0x7fe53c149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe53c0c5a50 0x7fe53c149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 -- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe53c0ca630 msgr2=0x7fe53c0c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:45.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe53c0ca630 0x7fe53c0c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:45.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.905+0000 7fe542400640 1 -- 172.21.15.102:0/513469621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe528009400 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.906+0000 7fe542400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0cb1e0 0x7fe53c0c94d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe53400efc0 tx=0x7fe53400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:45.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.906+0000 7fe539600640 1 -- 172.21.15.102:0/513469621 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534014480 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.906+0000 7fe539600640 1 -- 172.21.15.102:0/513469621 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53400f040 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.906+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53c1f04c0 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.906+0000 7fe539600640 1 -- 172.21.15.102:0/513469621 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534014820 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.906+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53c0ced10 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.908+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53c0cafc0 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.908+0000 7fe539600640 1 -- 172.21.15.102:0/513469621 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe534014980 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.910+0000 7fe539600640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe51c06b810 0x7fe51c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.910+0000 7fe539600640 1 -- 172.21.15.102:0/513469621 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe53408b090 con 0x7fe53c0cb1e0 2024-03-25T05:37:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.910+0000 7fe541a00640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe51c06b810 0x7fe51c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.911+0000 7fe541a00640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe51c06b810 0x7fe51c06dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe530005880 tx=0x7fe530009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:45.914+0000 7fe539600640 1 -- 172.21.15.102:0/513469621 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe5340556f0 con 0x7fe53c0cb1e0 2024-03-25T05:37:46.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.195+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe53c0c4fe0 con 0x7fe53c0cb1e0 2024-03-25T05:37:46.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.196+0000 7fe539600640 1 -- 172.21.15.102:0/513469621 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5340180a0 con 0x7fe53c0cb1e0 2024-03-25T05:37:46.190 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.198+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe51c06b810 msgr2=0x7fe51c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.198+0000 7fe544400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe51c06b810 0x7fe51c06dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe530005880 tx=0x7fe530009040 comp rx=0 tx=0).stop 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.198+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0cb1e0 msgr2=0x7fe53c0c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.198+0000 7fe544400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0cb1e0 0x7fe53c0c94d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe53400efc0 tx=0x7fe53400c490 comp rx=0 tx=0).stop 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 shutdown_connections 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe51c06b810 0x7fe51c06dcd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe53c0cb1e0 0x7fe53c0c94d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe53c0ca630 0x7fe53c0c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 --2- 172.21.15.102:0/513469621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe53c0c5a50 0x7fe53c149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 >> 172.21.15.102:0/513469621 conn(0x7fe53c066cc0 msgr2=0x7fe53c0c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:46.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 shutdown_connections 2024-03-25T05:37:46.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.199+0000 7fe544400640 1 -- 172.21.15.102:0/513469621 wait complete. 2024-03-25T05:37:46.212 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-25T05:37:46.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.427+0000 7fe26d600640 1 Processor -- start 2024-03-25T05:37:46.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.428+0000 7fe26d600640 1 -- start start 2024-03-25T05:37:46.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.429+0000 7fe26d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe2680c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.429+0000 7fe26d600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2680c8220 con 0x7fe2680cb7f0 2024-03-25T05:37:46.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.429+0000 7fe26d600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2680c8500 con 0x7fe268154260 2024-03-25T05:37:46.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.429+0000 7fe26d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2680ca320 con 0x7fe268153e80 2024-03-25T05:37:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.429+0000 7fe26cc00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe2680cb7f0 0x7fe2680c7460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48398/0 (socket says 172.21.15.102:48398) 2024-03-25T05:37:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.429+0000 7fe26cc00640 1 -- 172.21.15.102:0/3576591421 learned_addr learned my addr 172.21.15.102:0/3576591421 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.429+0000 7fe267e00640 1 --2- 172.21.15.102:0/3576591421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe2680c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.430+0000 7fe266a00640 1 -- 172.21.15.102:0/3576591421 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24886507 0 0) 0x7fe2680c8500 con 0x7fe268154260 2024-03-25T05:37:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.430+0000 7fe267e00640 1 -- 172.21.15.102:0/3576591421 >> v1:172.21.15.187:6789/0 conn(0x7fe268154260 legacy=0x7fe2680cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.430+0000 7fe267e00640 1 -- 172.21.15.102:0/3576591421 >> v1:172.21.15.102:6789/0 conn(0x7fe2680cb7f0 legacy=0x7fe2680c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.430+0000 7fe267e00640 1 -- 172.21.15.102:0/3576591421 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2680ca600 con 0x7fe268153e80 2024-03-25T05:37:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.431+0000 7fe267e00640 1 --2- 172.21.15.102:0/3576591421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe2680c6770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2580097d0 tx=0x7fe25802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e9747aae191f9e server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.431+0000 7fe266a00640 1 -- 172.21.15.102:0/3576591421 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258030710 con 0x7fe268153e80 2024-03-25T05:37:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.431+0000 7fe266a00640 1 -- 172.21.15.102:0/3576591421 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25802e050 con 0x7fe268153e80 2024-03-25T05:37:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.431+0000 7fe266a00640 1 -- 172.21.15.102:0/3576591421 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258030a90 con 0x7fe268153e80 2024-03-25T05:37:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.432+0000 7fe26d600640 1 -- 172.21.15.102:0/3576591421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 msgr2=0x7fe2680c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.432+0000 7fe26d600640 1 --2- 172.21.15.102:0/3576591421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe2680c6770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2580097d0 tx=0x7fe25802b800 comp rx=0 tx=0).stop 2024-03-25T05:37:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.432+0000 7fe26d600640 1 -- 172.21.15.102:0/3576591421 shutdown_connections 2024-03-25T05:37:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.432+0000 7fe26d600640 1 --2- 172.21.15.102:0/3576591421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe2680c6770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.432+0000 7fe26d600640 1 -- 172.21.15.102:0/3576591421 >> 172.21.15.102:0/3576591421 conn(0x7fe2680cf370 msgr2=0x7fe2680cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.432+0000 7fe26d600640 1 -- 172.21.15.102:0/3576591421 shutdown_connections 2024-03-25T05:37:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.432+0000 7fe26d600640 1 -- 172.21.15.102:0/3576591421 wait complete. 2024-03-25T05:37:46.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.434+0000 7fe26d600640 1 Processor -- start 2024-03-25T05:37:46.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.434+0000 7fe26d600640 1 -- start start 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.435+0000 7fe26d600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2680cb7f0 0x7fe268157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.435+0000 7fe26d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe268158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.435+0000 7fe26d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2681e2770 0x7fe2680cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.435+0000 7fe26d600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe268159590 con 0x7fe2680cb7f0 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.435+0000 7fe26d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe268159940 con 0x7fe2681e2770 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.435+0000 7fe26d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26815a650 con 0x7fe268153e80 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2680cb7f0 0x7fe268157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2680cb7f0 0x7fe268157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47866/0 (socket says 172.21.15.102:47866) 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 -- 172.21.15.102:0/3989584534 learned_addr learned my addr 172.21.15.102:0/3989584534 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267400640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe268158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe26cc00640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2681e2770 0x7fe2680cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 -- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 msgr2=0x7fe268158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe268158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 -- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2681e2770 msgr2=0x7fe2680cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2681e2770 0x7fe2680cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 -- 172.21.15.102:0/3989584534 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258009400 con 0x7fe2680cb7f0 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.436+0000 7fe267e00640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2680cb7f0 0x7fe268157dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2580097d0 tx=0x7fe2580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.437+0000 7fe25fe00640 1 -- 172.21.15.102:0/3989584534 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258032910 con 0x7fe2680cb7f0 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.437+0000 7fe25fe00640 1 -- 172.21.15.102:0/3989584534 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe258032a90 con 0x7fe2680cb7f0 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.437+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2681e4e30 con 0x7fe2680cb7f0 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.437+0000 7fe25fe00640 1 -- 172.21.15.102:0/3989584534 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258032e40 con 0x7fe2680cb7f0 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.437+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2680cd3f0 con 0x7fe2680cb7f0 2024-03-25T05:37:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.438+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26804f2f0 con 0x7fe2680cb7f0 2024-03-25T05:37:46.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.439+0000 7fe25fe00640 1 -- 172.21.15.102:0/3989584534 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe258039040 con 0x7fe2680cb7f0 2024-03-25T05:37:46.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.440+0000 7fe25fe00640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe24806b840 0x7fe24806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.440+0000 7fe25fe00640 1 -- 172.21.15.102:0/3989584534 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe2580ac260 con 0x7fe2680cb7f0 2024-03-25T05:37:46.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.441+0000 7fe267400640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe24806b840 0x7fe24806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.441+0000 7fe267400640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe24806b840 0x7fe24806dd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2680c75b0 tx=0x7fe254009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:46.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.450+0000 7fe25fe00640 1 -- 172.21.15.102:0/3989584534 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe258076950 con 0x7fe2680cb7f0 2024-03-25T05:37:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.646+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2681e55a0 con 0x7fe2680cb7f0 2024-03-25T05:37:46.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.647+0000 7fe25fe00640 1 -- 172.21.15.102:0/3989584534 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe25807a010 con 0x7fe2680cb7f0 2024-03-25T05:37:46.641 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe24806b840 msgr2=0x7fe24806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe24806b840 0x7fe24806dd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2680c75b0 tx=0x7fe254009040 comp rx=0 tx=0).stop 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2680cb7f0 msgr2=0x7fe268157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2680cb7f0 0x7fe268157dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2580097d0 tx=0x7fe2580046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 shutdown_connections 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe24806b840 0x7fe24806dd00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2681e2770 0x7fe2680cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.649+0000 7fe26d600640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe268153e80 0x7fe268158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.650+0000 7fe26d600640 1 --2- 172.21.15.102:0/3989584534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2680cb7f0 0x7fe268157dc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.650+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 >> 172.21.15.102:0/3989584534 conn(0x7fe2680cf370 msgr2=0x7fe2680cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.650+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 shutdown_connections 2024-03-25T05:37:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.650+0000 7fe26d600640 1 -- 172.21.15.102:0/3989584534 wait complete. 2024-03-25T05:37:46.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-25T05:37:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.874+0000 7eff8fe00640 1 Processor -- start 2024-03-25T05:37:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.874+0000 7eff8fe00640 1 -- start start 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7eff880c5a50 0x7eff880cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880ca630 0x7eff88164700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8fe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff880c4e20 con 0x7eff880cb1e0 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8fe00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8815e120 con 0x7eff880c5a50 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff880b28d0 con 0x7eff880ca630 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880ca630 0x7eff88164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8ca00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7eff880c5a50 0x7eff880cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8d400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7eff880cb1e0 0x7eff880c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:37926/0 (socket says 172.21.15.102:37926) 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880ca630 0x7eff88164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36572/0 (socket says 172.21.15.102:36572) 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8d400640 1 -- 172.21.15.102:0/1478722716 learned_addr learned my addr 172.21.15.102:0/1478722716 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.876+0000 7eff8ca00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7eff880c5a50 0x7eff880cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:58100/0 (socket says 172.21.15.102:58100) 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.877+0000 7eff87e00640 1 -- 172.21.15.102:0/1478722716 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714392237 0 0) 0x7eff880c4e20 con 0x7eff880cb1e0 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.877+0000 7eff87e00640 1 -- 172.21.15.102:0/1478722716 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff70003520 con 0x7eff880cb1e0 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.877+0000 7eff8ca00640 1 -- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880ca630 msgr2=0x7eff88164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.877+0000 7eff8ca00640 1 --2- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880ca630 0x7eff88164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.877+0000 7eff8ca00640 1 -- 172.21.15.102:0/1478722716 >> v1:172.21.15.187:6789/0 conn(0x7eff880cb1e0 legacy=0x7eff880c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.877+0000 7eff8ca00640 1 -- 172.21.15.102:0/1478722716 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8815d4a0 con 0x7eff880c5a50 2024-03-25T05:37:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.877+0000 7eff8de00640 1 --2- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880ca630 0x7eff88164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.878+0000 7eff8ca00640 1 --2- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880c5a50 0x7eff880cb5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff740097a0 tx=0x7eff7402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6446f2f14b0eeeb server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.878+0000 7eff87e00640 1 -- 172.21.15.102:0/1478722716 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74031780 con 0x7eff880c5a50 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.878+0000 7eff87e00640 1 -- 172.21.15.102:0/1478722716 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740318e0 con 0x7eff880c5a50 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff87e00640 1 -- 172.21.15.102:0/1478722716 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74031c70 con 0x7eff880c5a50 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 -- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880c5a50 msgr2=0x7eff880cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 --2- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880c5a50 0x7eff880cb5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff740097a0 tx=0x7eff7402b820 comp rx=0 tx=0).stop 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 -- 172.21.15.102:0/1478722716 shutdown_connections 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 --2- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880ca630 0x7eff88164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 --2- 172.21.15.102:0/1478722716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880c5a50 0x7eff880cb5c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 -- 172.21.15.102:0/1478722716 >> 172.21.15.102:0/1478722716 conn(0x7eff88066cc0 msgr2=0x7eff880670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 -- 172.21.15.102:0/1478722716 shutdown_connections 2024-03-25T05:37:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.879+0000 7eff8fe00640 1 -- 172.21.15.102:0/1478722716 wait complete. 2024-03-25T05:37:46.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.881+0000 7eff8fe00640 1 Processor -- start 2024-03-25T05:37:46.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.881+0000 7eff8fe00640 1 -- start start 2024-03-25T05:37:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff880c5a50 0x7eff881f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880ca630 0x7eff88144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880cb1e0 0x7eff88152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8fe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff881e3a80 con 0x7eff880c5a50 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8fe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff881f3c50 con 0x7eff880ca630 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff880c7410 con 0x7eff880cb1e0 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8d400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff880c5a50 0x7eff881f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8d400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff880c5a50 0x7eff881f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47870/0 (socket says 172.21.15.102:47870) 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8d400640 1 -- 172.21.15.102:0/4232813454 learned_addr learned my addr 172.21.15.102:0/4232813454 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8de00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880cb1e0 0x7eff88152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.882+0000 7eff8ca00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880ca630 0x7eff88144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8d400640 1 -- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880cb1e0 msgr2=0x7eff88152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8d400640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880cb1e0 0x7eff88152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8d400640 1 -- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880ca630 msgr2=0x7eff88144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8d400640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880ca630 0x7eff88144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8d400640 1 -- 172.21.15.102:0/4232813454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80009a70 con 0x7eff880c5a50 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8de00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880cb1e0 0x7eff88152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8d400640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff880c5a50 0x7eff881f3710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0010e0 tx=0x7eff7c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff85600640 1 -- 172.21.15.102:0/4232813454 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c005ce0 con 0x7eff880c5a50 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff85600640 1 -- 172.21.15.102:0/4232813454 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c005e60 con 0x7eff880c5a50 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff74009400 con 0x7eff880c5a50 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff85600640 1 -- 172.21.15.102:0/4232813454 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c007310 con 0x7eff880c5a50 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.883+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff881ef930 con 0x7eff880c5a50 2024-03-25T05:37:46.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.885+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff88067fb0 con 0x7eff880c5a50 2024-03-25T05:37:46.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.885+0000 7eff85600640 1 -- 172.21.15.102:0/4232813454 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff7c007470 con 0x7eff880c5a50 2024-03-25T05:37:46.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.886+0000 7eff85600640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7eff6806b810 0x7eff6806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:46.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.886+0000 7eff85600640 1 -- 172.21.15.102:0/4232813454 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7eff7c089ad0 con 0x7eff880c5a50 2024-03-25T05:37:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.887+0000 7eff8ca00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7eff6806b810 0x7eff6806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.887+0000 7eff8ca00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7eff6806b810 0x7eff6806dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff74036000 tx=0x7eff7403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:46.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:46.891+0000 7eff85600640 1 -- 172.21.15.102:0/4232813454 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7eff7c054130 con 0x7eff880c5a50 2024-03-25T05:37:47.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.088+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7eff880cafc0 con 0x7eff880c5a50 2024-03-25T05:37:47.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.088+0000 7eff85600640 1 -- 172.21.15.102:0/4232813454 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7eff7c017020 con 0x7eff880c5a50 2024-03-25T05:37:47.083 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.091+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7eff6806b810 msgr2=0x7eff6806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.091+0000 7eff8fe00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7eff6806b810 0x7eff6806dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff74036000 tx=0x7eff7403d040 comp rx=0 tx=0).stop 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.091+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff880c5a50 msgr2=0x7eff881f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.091+0000 7eff8fe00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff880c5a50 0x7eff881f3710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0010e0 tx=0x7eff7c00c7d0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.091+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 shutdown_connections 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.091+0000 7eff8fe00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7eff6806b810 0x7eff6806dcd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.091+0000 7eff8fe00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff880cb1e0 0x7eff88152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.092+0000 7eff8fe00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff880ca630 0x7eff88144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.092+0000 7eff8fe00640 1 --2- 172.21.15.102:0/4232813454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff880c5a50 0x7eff881f3710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.092+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 >> 172.21.15.102:0/4232813454 conn(0x7eff88066cc0 msgr2=0x7eff880c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:47.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.092+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 shutdown_connections 2024-03-25T05:37:47.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.092+0000 7eff8fe00640 1 -- 172.21.15.102:0/4232813454 wait complete. 2024-03-25T05:37:47.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-25T05:37:47.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.316+0000 7f127d600640 1 Processor -- start 2024-03-25T05:37:47.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.316+0000 7f127d600640 1 -- start start 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.318+0000 7f127d600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f127806f700 0x7f12780c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.318+0000 7f127d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12780c2d10 0x7f127815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.318+0000 7f127d600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12780733b0 con 0x7f1278150db0 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f127d600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12780c37a0 con 0x7f127806f700 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f127d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12780c3170 con 0x7f12780c2d10 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1276a00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f1278150db0 0x7f1278071c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:37936/0 (socket says 172.21.15.102:37936) 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1276a00640 1 -- 172.21.15.102:0/4213020144 learned_addr learned my addr 172.21.15.102:0/4213020144 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1277400640 1 --2- 172.21.15.102:0/4213020144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12780c2d10 0x7f127815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f126e000640 1 --2- 172.21.15.102:0/4213020144 >> v2:172.21.15.102:3300/0 conn(0x7f127806f700 0x7f12780c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1276000640 1 -- 172.21.15.102:0/4213020144 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26550781 0 0) 0x7f12780733b0 con 0x7f1278150db0 2024-03-25T05:37:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1276000640 1 -- 172.21.15.102:0/4213020144 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f125c003520 con 0x7f1278150db0 2024-03-25T05:37:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1277400640 1 -- 172.21.15.102:0/4213020144 >> v2:172.21.15.102:3300/0 conn(0x7f127806f700 msgr2=0x7f12780c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1277400640 1 --2- 172.21.15.102:0/4213020144 >> v2:172.21.15.102:3300/0 conn(0x7f127806f700 0x7f12780c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1277400640 1 -- 172.21.15.102:0/4213020144 >> v1:172.21.15.187:6789/0 conn(0x7f1278150db0 legacy=0x7f1278071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.319+0000 7f1277400640 1 -- 172.21.15.102:0/4213020144 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278072830 con 0x7f12780c2d10 2024-03-25T05:37:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.321+0000 7f1277400640 1 --2- 172.21.15.102:0/4213020144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12780c2d10 0x7f127815a6a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f12700097a0 tx=0x7f127002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d393790ba345c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.321+0000 7f1276000640 1 -- 172.21.15.102:0/4213020144 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127002e070 con 0x7f12780c2d10 2024-03-25T05:37:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.321+0000 7f1276000640 1 -- 172.21.15.102:0/4213020144 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12700315a0 con 0x7f12780c2d10 2024-03-25T05:37:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.321+0000 7f1276000640 1 -- 172.21.15.102:0/4213020144 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270031930 con 0x7f12780c2d10 2024-03-25T05:37:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 -- 172.21.15.102:0/4213020144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12780c2d10 msgr2=0x7f127815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 --2- 172.21.15.102:0/4213020144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12780c2d10 0x7f127815a6a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f12700097a0 tx=0x7f127002b840 comp rx=0 tx=0).stop 2024-03-25T05:37:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 -- 172.21.15.102:0/4213020144 shutdown_connections 2024-03-25T05:37:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 --2- 172.21.15.102:0/4213020144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12780c2d10 0x7f127815a6a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 --2- 172.21.15.102:0/4213020144 >> v2:172.21.15.102:3300/0 conn(0x7f127806f700 0x7f12780c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 -- 172.21.15.102:0/4213020144 >> 172.21.15.102:0/4213020144 conn(0x7f12780c7dd0 msgr2=0x7f12780c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 -- 172.21.15.102:0/4213020144 shutdown_connections 2024-03-25T05:37:47.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.322+0000 7f127d600640 1 -- 172.21.15.102:0/4213020144 wait complete. 2024-03-25T05:37:47.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.325+0000 7f127d600640 1 Processor -- start 2024-03-25T05:37:47.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.326+0000 7f127d600640 1 -- start start 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.327+0000 7f127d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f127806f700 0x7f1278158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f127d600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12780c2d10 0x7f127814d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f127d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1278150db0 0x7f12781ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f127d600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781f02c0 con 0x7f12780c2d10 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f127d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781f0b60 con 0x7f1278150db0 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f127d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1278159320 con 0x7f127806f700 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f126e000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12780c2d10 0x7f127814d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f127806f700 0x7f1278158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f127806f700 0x7f1278158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36590/0 (socket says 172.21.15.102:36590) 2024-03-25T05:37:47.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f126e000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12780c2d10 0x7f127814d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47888/0 (socket says 172.21.15.102:47888) 2024-03-25T05:37:47.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 -- 172.21.15.102:0/39860441 learned_addr learned my addr 172.21.15.102:0/39860441 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:47.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1277400640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1278150db0 0x7f12781ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 -- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1278150db0 msgr2=0x7f12781ecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1278150db0 0x7f12781ecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 -- 172.21.15.102:0/39860441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12780c2d10 msgr2=0x7f127814d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12780c2d10 0x7f127814d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1276a00640 1 -- 172.21.15.102:0/39860441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270009400 con 0x7f127806f700 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.328+0000 7f1277400640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1278150db0 0x7f12781ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.329+0000 7f1276a00640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f127806f700 0x7f1278158c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f126800cbc0 tx=0x7f126800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.329+0000 7f126f400640 1 -- 172.21.15.102:0/39860441 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800ad40 con 0x7f127806f700 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.329+0000 7f126f400640 1 -- 172.21.15.102:0/39860441 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268012400 con 0x7f127806f700 2024-03-25T05:37:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.329+0000 7f126f400640 1 -- 172.21.15.102:0/39860441 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800aea0 con 0x7f127806f700 2024-03-25T05:37:47.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.329+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1278159600 con 0x7f127806f700 2024-03-25T05:37:47.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.329+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12781f07f0 con 0x7f127806f700 2024-03-25T05:37:47.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.330+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12781f0980 con 0x7f127806f700 2024-03-25T05:37:47.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.331+0000 7f126f400640 1 -- 172.21.15.102:0/39860441 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1268007070 con 0x7f127806f700 2024-03-25T05:37:47.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.332+0000 7f126f400640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f125406b810 0x7f125406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.332+0000 7f126f400640 1 -- 172.21.15.102:0/39860441 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f126808a4d0 con 0x7f127806f700 2024-03-25T05:37:47.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.332+0000 7f126e000640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f125406b810 0x7f125406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.333+0000 7f126e000640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f125406b810 0x7f125406dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f127814fe90 tx=0x7f1260009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:47.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.337+0000 7f126f400640 1 -- 172.21.15.102:0/39860441 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1268054c50 con 0x7f127806f700 2024-03-25T05:37:47.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.551+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1278067fb0 con 0x7f127806f700 2024-03-25T05:37:47.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.552+0000 7f126f400640 1 -- 172.21.15.102:0/39860441 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1268058310 con 0x7f127806f700 2024-03-25T05:37:47.546 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2024-03-25T05:37:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f125406b810 msgr2=0x7f125406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f125406b810 0x7f125406dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f127814fe90 tx=0x7f1260009190 comp rx=0 tx=0).stop 2024-03-25T05:37:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f127806f700 msgr2=0x7f1278158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f127806f700 0x7f1278158c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f126800cbc0 tx=0x7f126800a430 comp rx=0 tx=0).stop 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 shutdown_connections 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f125406b810 0x7f125406dcd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1278150db0 0x7f12781ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12780c2d10 0x7f127814d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 --2- 172.21.15.102:0/39860441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f127806f700 0x7f1278158c90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.555+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 >> 172.21.15.102:0/39860441 conn(0x7f12780c7dd0 msgr2=0x7f1278146f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.556+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 shutdown_connections 2024-03-25T05:37:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.556+0000 7f127d600640 1 -- 172.21.15.102:0/39860441 wait complete. 2024-03-25T05:37:47.569 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:37:47.569 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-25T05:37:47.616 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:47.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.867+0000 7fb8a3e00640 1 Processor -- start 2024-03-25T05:37:47.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.868+0000 7fb8a3e00640 1 -- start start 2024-03-25T05:37:47.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.870+0000 7fb8a3e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb89c0c5940 0x7fb89c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.870+0000 7fb8a3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c0c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.870+0000 7fb8a3e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c0c8310 con 0x7fb89c0c6240 2024-03-25T05:37:47.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.870+0000 7fb8a3e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0caa10 con 0x7fb89c0c5940 2024-03-25T05:37:47.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.870+0000 7fb8a3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c15a060 con 0x7fb89c0c7940 2024-03-25T05:37:47.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a0a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb89c0c6240 0x7fb89c0cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48410/0 (socket says 172.21.15.102:48410) 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a1400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb89c0c5940 0x7fb89c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a0a00640 1 -- 172.21.15.102:0/1425459537 learned_addr learned my addr 172.21.15.102:0/1425459537 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a1e00640 1 --2- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c0c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a1400640 1 -- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 msgr2=0x7fb89c0c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a1400640 1 --2- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c0c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb89be00640 1 -- 172.21.15.102:0/1425459537 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675364425 0 0) 0x7fb89c0c8310 con 0x7fb89c0c6240 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a1400640 1 -- 172.21.15.102:0/1425459537 >> v1:172.21.15.102:6789/0 conn(0x7fb89c0c6240 legacy=0x7fb89c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a1400640 1 -- 172.21.15.102:0/1425459537 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c15a340 con 0x7fb89c0c5940 2024-03-25T05:37:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.871+0000 7fb8a1e00640 1 --2- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c0c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:47.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.872+0000 7fb8a1400640 1 --2- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c5940 0x7fb89c0ca4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8900097a0 tx=0x7fb89002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31984d5dc59e2d58 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:47.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb89be00640 1 -- 172.21.15.102:0/1425459537 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89002d040 con 0x7fb89c0c5940 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb89be00640 1 -- 172.21.15.102:0/1425459537 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb890031810 con 0x7fb89c0c5940 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb89be00640 1 -- 172.21.15.102:0/1425459537 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb890031ba0 con 0x7fb89c0c5940 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 -- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c5940 msgr2=0x7fb89c0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c5940 0x7fb89c0ca4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8900097a0 tx=0x7fb89002b8b0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 -- 172.21.15.102:0/1425459537 shutdown_connections 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c0c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/1425459537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c5940 0x7fb89c0ca4d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 -- 172.21.15.102:0/1425459537 >> 172.21.15.102:0/1425459537 conn(0x7fb89c0728c0 msgr2=0x7fb89c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 -- 172.21.15.102:0/1425459537 shutdown_connections 2024-03-25T05:37:47.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.873+0000 7fb8a3e00640 1 -- 172.21.15.102:0/1425459537 wait complete. 2024-03-25T05:37:47.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.875+0000 7fb8a3e00640 1 Processor -- start 2024-03-25T05:37:47.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.875+0000 7fb8a3e00640 1 -- start start 2024-03-25T05:37:47.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a3e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb89c0c5940 0x7fb89c1f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c6240 0x7fb89c1f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c1f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a3e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0ca7b0 con 0x7fb89c0c5940 2024-03-25T05:37:47.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c1f0ba0 con 0x7fb89c0c6240 2024-03-25T05:37:47.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c1e25f0 con 0x7fb89c0c7940 2024-03-25T05:37:47.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a1400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb89c0c5940 0x7fb89c1f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c1f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.876+0000 7fb8a1400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb89c0c5940 0x7fb89c1f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47900/0 (socket says 172.21.15.102:47900) 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a0a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c6240 0x7fb89c1f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1400640 1 -- 172.21.15.102:0/375411638 learned_addr learned my addr 172.21.15.102:0/375411638 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1e00640 1 -- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c6240 msgr2=0x7fb89c1f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c6240 0x7fb89c1f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1e00640 1 -- 172.21.15.102:0/375411638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb89c0c5940 msgr2=0x7fb89c1f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb89c0c5940 0x7fb89c1f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1e00640 1 -- 172.21.15.102:0/375411638 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009a70 con 0x7fb89c0c7940 2024-03-25T05:37:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb8a1e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c1f15f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb89400efc0 tx=0x7fb89400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:47.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.877+0000 7fb899600640 1 -- 172.21.15.102:0/375411638 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400cd30 con 0x7fb89c0c7940 2024-03-25T05:37:47.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.878+0000 7fb899600640 1 -- 172.21.15.102:0/375411638 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89400f040 con 0x7fb89c0c7940 2024-03-25T05:37:47.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.878+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb890009400 con 0x7fb89c0c7940 2024-03-25T05:37:47.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.878+0000 7fb899600640 1 -- 172.21.15.102:0/375411638 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894003bd0 con 0x7fb89c0c7940 2024-03-25T05:37:47.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.878+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c1f0df0 con 0x7fb89c0c7940 2024-03-25T05:37:47.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.879+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c0c6c30 con 0x7fb89c0c7940 2024-03-25T05:37:47.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.880+0000 7fb899600640 1 -- 172.21.15.102:0/375411638 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb894014480 con 0x7fb89c0c7940 2024-03-25T05:37:47.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.880+0000 7fb899600640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb87c06b810 0x7fb87c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:47.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.881+0000 7fb899600640 1 -- 172.21.15.102:0/375411638 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb89408af80 con 0x7fb89c0c7940 2024-03-25T05:37:47.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.881+0000 7fb8a1400640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb87c06b810 0x7fb87c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:47.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.881+0000 7fb8a1400640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb87c06b810 0x7fb87c06dcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb89002b8f0 tx=0x7fb89003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:47.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:47.885+0000 7fb899600640 1 -- 172.21.15.102:0/375411638 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb894055670 con 0x7fb89c0c7940 2024-03-25T05:37:48.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.073+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb89c067fb0 con 0x7fb89c0c7940 2024-03-25T05:37:48.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.075+0000 7fb899600640 1 -- 172.21.15.102:0/375411638 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7fb894058d30 con 0x7fb89c0c7940 2024-03-25T05:37:48.069 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:48.070 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb87c06b810 msgr2=0x7fb87c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb87c06b810 0x7fb87c06dcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb89002b8f0 tx=0x7fb89003c040 comp rx=0 tx=0).stop 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 msgr2=0x7fb89c1f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c1f15f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb89400efc0 tx=0x7fb89400c490 comp rx=0 tx=0).stop 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 shutdown_connections 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb87c06b810 0x7fb87c06dcd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb89c0c7940 0x7fb89c1f15f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb89c0c6240 0x7fb89c1f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 --2- 172.21.15.102:0/375411638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb89c0c5940 0x7fb89c1f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 >> 172.21.15.102:0/375411638 conn(0x7fb89c0728c0 msgr2=0x7fb89c0b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 shutdown_connections 2024-03-25T05:37:48.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.078+0000 7fb8a3e00640 1 -- 172.21.15.102:0/375411638 wait complete. 2024-03-25T05:37:48.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T05:37:25.079908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-25T05:37:29.008596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-25T05:37:29.891587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-25T05:37:33.466049+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-25T05:37:48.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-25T05:37:48.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.301+0000 7f3990200640 1 Processor -- start 2024-03-25T05:37:48.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.301+0000 7f3990200640 1 -- start start 2024-03-25T05:37:48.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.303+0000 7f3990200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f39881545c0 0x7f398815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.303+0000 7f3990200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398806c960 con 0x7f39880ca280 2024-03-25T05:37:48.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.303+0000 7f3990200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398806cc20 con 0x7f39880ca660 2024-03-25T05:37:48.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.303+0000 7f3990200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398806cf00 con 0x7f39881545c0 2024-03-25T05:37:48.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.303+0000 7f398d800640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f39880ca280 0x7f39880c7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48422/0 (socket says 172.21.15.102:48422) 2024-03-25T05:37:48.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.303+0000 7f398d800640 1 -- 172.21.15.102:0/4043097033 learned_addr learned my addr 172.21.15.102:0/4043097033 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:48.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.304+0000 7f398e200640 1 --2- 172.21.15.102:0/4043097033 >> v2:172.21.15.187:3300/0 conn(0x7f39881545c0 0x7f398815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.304+0000 7f3987e00640 1 -- 172.21.15.102:0/4043097033 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997599095 0 0) 0x7f398806c960 con 0x7f39880ca280 2024-03-25T05:37:48.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.304+0000 7f3987e00640 1 -- 172.21.15.102:0/4043097033 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3970003520 con 0x7f39880ca280 2024-03-25T05:37:48.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.304+0000 7f398e200640 1 -- 172.21.15.102:0/4043097033 >> v1:172.21.15.187:6789/0 conn(0x7f39880ca660 legacy=0x7f3988153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.304+0000 7f398e200640 1 -- 172.21.15.102:0/4043097033 >> v1:172.21.15.102:6789/0 conn(0x7f39880ca280 legacy=0x7f39880c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.304+0000 7f398e200640 1 -- 172.21.15.102:0/4043097033 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398806d1e0 con 0x7f39881545c0 2024-03-25T05:37:48.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.305+0000 7f398e200640 1 --2- 172.21.15.102:0/4043097033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 0x7f398815d950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3980009d90 tx=0x7f398002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df0973144ea692c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.305+0000 7f3987e00640 1 -- 172.21.15.102:0/4043097033 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398002cd00 con 0x7f39881545c0 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3987e00640 1 -- 172.21.15.102:0/4043097033 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398002ce60 con 0x7f39881545c0 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3987e00640 1 -- 172.21.15.102:0/4043097033 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980034640 con 0x7f39881545c0 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3990200640 1 -- 172.21.15.102:0/4043097033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 msgr2=0x7f398815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3990200640 1 --2- 172.21.15.102:0/4043097033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 0x7f398815d950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3980009d90 tx=0x7f398002bf50 comp rx=0 tx=0).stop 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3990200640 1 -- 172.21.15.102:0/4043097033 shutdown_connections 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3990200640 1 --2- 172.21.15.102:0/4043097033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 0x7f398815d950 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3990200640 1 -- 172.21.15.102:0/4043097033 >> 172.21.15.102:0/4043097033 conn(0x7f39880672f0 msgr2=0x7f3988070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3990200640 1 -- 172.21.15.102:0/4043097033 shutdown_connections 2024-03-25T05:37:48.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.306+0000 7f3990200640 1 -- 172.21.15.102:0/4043097033 wait complete. 2024-03-25T05:37:48.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.308+0000 7f3990200640 1 Processor -- start 2024-03-25T05:37:48.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.308+0000 7f3990200640 1 -- start start 2024-03-25T05:37:48.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f3990200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39880ca280 0x7f3988155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f3990200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39880ca660 0x7f398814df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f3990200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 0x7f3988156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f3990200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988156290 con 0x7f39880ca660 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f3990200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988155f90 con 0x7f39881545c0 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f3990200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988150840 con 0x7f39880ca280 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f398ce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39880ca660 0x7f398814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f398ce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39880ca660 0x7f398814df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47912/0 (socket says 172.21.15.102:47912) 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f398ce00640 1 -- 172.21.15.102:0/2712973219 learned_addr learned my addr 172.21.15.102:0/2712973219 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f398e200640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 0x7f3988156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.309+0000 7f398d800640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39880ca280 0x7f3988155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f398ce00640 1 -- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39880ca280 msgr2=0x7f3988155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f398ce00640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39880ca280 0x7f3988155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f398ce00640 1 -- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 msgr2=0x7f3988156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f398ce00640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 0x7f3988156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f398ce00640 1 -- 172.21.15.102:0/2712973219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009a70 con 0x7f39880ca660 2024-03-25T05:37:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f398ce00640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39880ca660 0x7f398814df50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f397400c400 tx=0x7f397400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f3985600640 1 -- 172.21.15.102:0/2712973219 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740052d0 con 0x7f39880ca660 2024-03-25T05:37:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f3985600640 1 -- 172.21.15.102:0/2712973219 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974005450 con 0x7f39880ca660 2024-03-25T05:37:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39880ccbb0 con 0x7f39880ca660 2024-03-25T05:37:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.310+0000 7f3985600640 1 -- 172.21.15.102:0/2712973219 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974007260 con 0x7f39880ca660 2024-03-25T05:37:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.311+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39881f0590 con 0x7f39880ca660 2024-03-25T05:37:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.312+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39881f0750 con 0x7f39880ca660 2024-03-25T05:37:48.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.314+0000 7f3985600640 1 -- 172.21.15.102:0/2712973219 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39740073c0 con 0x7f39880ca660 2024-03-25T05:37:48.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.314+0000 7f3985600640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f396806b840 0x7f396806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.314+0000 7f3985600640 1 -- 172.21.15.102:0/2712973219 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3974089870 con 0x7f39880ca660 2024-03-25T05:37:48.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.315+0000 7f398d800640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f396806b840 0x7f396806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.315+0000 7f398d800640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f396806b840 0x7f396806dd00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f397c0011e0 tx=0x7f397c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:48.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.319+0000 7f3985600640 1 -- 172.21.15.102:0/2712973219 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f39881f0750 con 0x7f39880ca660 2024-03-25T05:37:48.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.620+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39881f0750 con 0x7f39880ca660 2024-03-25T05:37:48.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.621+0000 7f3985600640 1 -- 172.21.15.102:0/2712973219 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39881f0750 con 0x7f39880ca660 2024-03-25T05:37:48.615 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-03-25T05:37:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f396806b840 msgr2=0x7f396806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f396806b840 0x7f396806dd00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f397c0011e0 tx=0x7f397c007d30 comp rx=0 tx=0).stop 2024-03-25T05:37:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39880ca660 msgr2=0x7f398814df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39880ca660 0x7f398814df50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f397400c400 tx=0x7f397400c8c0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 shutdown_connections 2024-03-25T05:37:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f396806b840 0x7f396806dd00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39881545c0 0x7f3988156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39880ca660 0x7f398814df50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 --2- 172.21.15.102:0/2712973219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39880ca280 0x7f3988155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 >> 172.21.15.102:0/2712973219 conn(0x7f39880672f0 msgr2=0x7f39880afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:48.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 shutdown_connections 2024-03-25T05:37:48.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.623+0000 7f3990200640 1 -- 172.21.15.102:0/2712973219 wait complete. 2024-03-25T05:37:48.635 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-25T05:37:48.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.850+0000 7f28c2000640 1 Processor -- start 2024-03-25T05:37:48.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.851+0000 7f28c2000640 1 -- start start 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.852+0000 7f28c2000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f28bc154330 0x7f28bc070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.852+0000 7f28c2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.852+0000 7f28c2000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc15ab40 con 0x7f28bc06fd20 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.852+0000 7f28c2000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0c7900 con 0x7f28bc154330 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.852+0000 7f28c2000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0c7be0 con 0x7f28bc15a190 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.852+0000 7f28bb400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f28bc154330 0x7f28bc070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.853+0000 7f28bb400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f28bc154330 0x7f28bc070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47924/0 (socket says 172.21.15.102:47924) 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.853+0000 7f28bb400640 1 -- 172.21.15.102:0/1756143185 learned_addr learned my addr 172.21.15.102:0/1756143185 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:48.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.853+0000 7f28bbe00640 1 --2- 172.21.15.102:0/1756143185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.853+0000 7f28bb400640 1 -- 172.21.15.102:0/1756143185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 msgr2=0x7f28bc15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:48.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.853+0000 7f28bb400640 1 --2- 172.21.15.102:0/1756143185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.853+0000 7f28bb400640 1 -- 172.21.15.102:0/1756143185 >> v1:172.21.15.187:6789/0 conn(0x7f28bc06fd20 legacy=0x7f28bc0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.853+0000 7f28bb400640 1 -- 172.21.15.102:0/1756143185 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0c7ec0 con 0x7f28bc154330 2024-03-25T05:37:48.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.854+0000 7f28bb400640 1 --2- 172.21.15.102:0/1756143185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc154330 0x7f28bc070490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009870 tx=0x7f28ac02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665ecfed1bd012c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:48.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.854+0000 7f28ba000640 1 -- 172.21.15.102:0/1756143185 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac02f830 con 0x7f28bc154330 2024-03-25T05:37:48.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.854+0000 7f28ba000640 1 -- 172.21.15.102:0/1756143185 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac02f990 con 0x7f28bc154330 2024-03-25T05:37:48.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.854+0000 7f28ba000640 1 -- 172.21.15.102:0/1756143185 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac02fd20 con 0x7f28bc154330 2024-03-25T05:37:48.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 -- 172.21.15.102:0/1756143185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc154330 msgr2=0x7f28bc070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 --2- 172.21.15.102:0/1756143185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc154330 0x7f28bc070490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009870 tx=0x7f28ac02ba10 comp rx=0 tx=0).stop 2024-03-25T05:37:48.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 -- 172.21.15.102:0/1756143185 shutdown_connections 2024-03-25T05:37:48.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 --2- 172.21.15.102:0/1756143185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 --2- 172.21.15.102:0/1756143185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc154330 0x7f28bc070490 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 -- 172.21.15.102:0/1756143185 >> 172.21.15.102:0/1756143185 conn(0x7f28bc066cc0 msgr2=0x7f28bc0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:48.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 -- 172.21.15.102:0/1756143185 shutdown_connections 2024-03-25T05:37:48.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.855+0000 7f28c2000640 1 -- 172.21.15.102:0/1756143185 wait complete. 2024-03-25T05:37:48.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.858+0000 7f28c2000640 1 Processor -- start 2024-03-25T05:37:48.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.858+0000 7f28c2000640 1 -- start start 2024-03-25T05:37:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28c2000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc06fd20 0x7f28bc14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28c2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc1e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28c2000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc14cd80 0x7f28bc150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28c2000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc1f4350 con 0x7f28bc14cd80 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28c2000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc14f6e0 con 0x7f28bc06fd20 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28c2000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc1e0640 con 0x7f28bc15a190 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc14cd80 0x7f28bc150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc14cd80 0x7f28bc150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47926/0 (socket says 172.21.15.102:47926) 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 -- 172.21.15.102:0/3460296671 learned_addr learned my addr 172.21.15.102:0/3460296671 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28baa00640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc1e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bb400640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc06fd20 0x7f28bc14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 -- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 msgr2=0x7f28bc1e16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc1e16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 -- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc06fd20 msgr2=0x7f28bc14c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc06fd20 0x7f28bc14c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.860+0000 7f28bbe00640 1 -- 172.21.15.102:0/3460296671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0094d0 con 0x7f28bc14cd80 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.861+0000 7f28bbe00640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc14cd80 0x7f28bc150db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e930 tx=0x7f28b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.861+0000 7f28b3400640 1 -- 172.21.15.102:0/3460296671 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4009690 con 0x7f28bc14cd80 2024-03-25T05:37:48.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.861+0000 7f28b3400640 1 -- 172.21.15.102:0/3460296671 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b400c980 con 0x7f28bc14cd80 2024-03-25T05:37:48.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.861+0000 7f28b3400640 1 -- 172.21.15.102:0/3460296671 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400cd30 con 0x7f28bc14cd80 2024-03-25T05:37:48.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.861+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc1e0920 con 0x7f28bc14cd80 2024-03-25T05:37:48.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.861+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc1e0ee0 con 0x7f28bc14cd80 2024-03-25T05:37:48.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.863+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc157a10 con 0x7f28bc14cd80 2024-03-25T05:37:48.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.864+0000 7f28b3400640 1 -- 172.21.15.102:0/3460296671 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f28b4013470 con 0x7f28bc14cd80 2024-03-25T05:37:48.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.865+0000 7f28b3400640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f289806b810 0x7f289806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:48.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.865+0000 7f28b3400640 1 -- 172.21.15.102:0/3460296671 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f28b408aa10 con 0x7f28bc14cd80 2024-03-25T05:37:48.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.865+0000 7f28bb400640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f289806b810 0x7f289806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:48.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.866+0000 7f28bb400640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f289806b810 0x7f289806dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28ac036000 tx=0x7f28ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:48.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:48.869+0000 7f28b3400640 1 -- 172.21.15.102:0/3460296671 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f28b4055260 con 0x7f28bc14cd80 2024-03-25T05:37:49.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.065+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28bc0c8810 con 0x7f28bc14cd80 2024-03-25T05:37:49.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.066+0000 7f28b3400640 1 -- 172.21.15.102:0/3460296671 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28b4058920 con 0x7f28bc14cd80 2024-03-25T05:37:49.060 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.068+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f289806b810 msgr2=0x7f289806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.068+0000 7f28c2000640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f289806b810 0x7f289806dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28ac036000 tx=0x7f28ac008030 comp rx=0 tx=0).stop 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.068+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc14cd80 msgr2=0x7f28bc150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc14cd80 0x7f28bc150db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e930 tx=0x7f28b400edf0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 shutdown_connections 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f289806b810 0x7f289806dcd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc14cd80 0x7f28bc150db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc15a190 0x7f28bc1e16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 --2- 172.21.15.102:0/3460296671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc06fd20 0x7f28bc14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 >> 172.21.15.102:0/3460296671 conn(0x7f28bc066cc0 msgr2=0x7f28bc153640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:49.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 shutdown_connections 2024-03-25T05:37:49.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.069+0000 7f28c2000640 1 -- 172.21.15.102:0/3460296671 wait complete. 2024-03-25T05:37:49.081 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-25T05:37:49.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.310+0000 7fe714600640 1 Processor -- start 2024-03-25T05:37:49.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.310+0000 7fe714600640 1 -- start start 2024-03-25T05:37:49.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.312+0000 7fe714600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0c5a50 0x7fe70c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.312+0000 7fe714600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe70c0ca630 0x7fe70c164700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.312+0000 7fe714600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c0c4e20 con 0x7fe70c0cb1e0 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.312+0000 7fe714600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c15e120 con 0x7fe70c0ca630 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.312+0000 7fe714600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b28d0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.312+0000 7fe711c00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe70c0cb1e0 0x7fe70c0c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48432/0 (socket says 172.21.15.102:48432) 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.312+0000 7fe711c00640 1 -- 172.21.15.102:0/3818801435 learned_addr learned my addr 172.21.15.102:0/3818801435 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe711200640 1 --2- 172.21.15.102:0/3818801435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0c5a50 0x7fe70c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe712600640 1 --2- 172.21.15.102:0/3818801435 >> v2:172.21.15.187:3300/0 conn(0x7fe70c0ca630 0x7fe70c164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe70be00640 1 -- 172.21.15.102:0/3818801435 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447471929 0 0) 0x7fe70c0c4e20 con 0x7fe70c0cb1e0 2024-03-25T05:37:49.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe70be00640 1 -- 172.21.15.102:0/3818801435 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f4003520 con 0x7fe70c0cb1e0 2024-03-25T05:37:49.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe711200640 1 -- 172.21.15.102:0/3818801435 >> v2:172.21.15.187:3300/0 conn(0x7fe70c0ca630 msgr2=0x7fe70c164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:49.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe711200640 1 --2- 172.21.15.102:0/3818801435 >> v2:172.21.15.187:3300/0 conn(0x7fe70c0ca630 0x7fe70c164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe711200640 1 -- 172.21.15.102:0/3818801435 >> v1:172.21.15.102:6789/0 conn(0x7fe70c0cb1e0 legacy=0x7fe70c0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.313+0000 7fe711200640 1 -- 172.21.15.102:0/3818801435 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c15d4a0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.315+0000 7fe711200640 1 --2- 172.21.15.102:0/3818801435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0c5a50 0x7fe70c0cb5c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097a0 tx=0x7fe6f802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6091d9e20ca94ca1 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:49.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.315+0000 7fe70be00640 1 -- 172.21.15.102:0/3818801435 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031780 con 0x7fe70c0c5a50 2024-03-25T05:37:49.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.315+0000 7fe70be00640 1 -- 172.21.15.102:0/3818801435 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f80318e0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.315+0000 7fe70be00640 1 -- 172.21.15.102:0/3818801435 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031c50 con 0x7fe70c0c5a50 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 -- 172.21.15.102:0/3818801435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0c5a50 msgr2=0x7fe70c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 --2- 172.21.15.102:0/3818801435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0c5a50 0x7fe70c0cb5c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097a0 tx=0x7fe6f802b820 comp rx=0 tx=0).stop 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 -- 172.21.15.102:0/3818801435 shutdown_connections 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 --2- 172.21.15.102:0/3818801435 >> v2:172.21.15.187:3300/0 conn(0x7fe70c0ca630 0x7fe70c164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 --2- 172.21.15.102:0/3818801435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0c5a50 0x7fe70c0cb5c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 -- 172.21.15.102:0/3818801435 >> 172.21.15.102:0/3818801435 conn(0x7fe70c066cc0 msgr2=0x7fe70c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 -- 172.21.15.102:0/3818801435 shutdown_connections 2024-03-25T05:37:49.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.316+0000 7fe714600640 1 -- 172.21.15.102:0/3818801435 wait complete. 2024-03-25T05:37:49.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.317+0000 7fe714600640 1 Processor -- start 2024-03-25T05:37:49.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.318+0000 7fe714600640 1 -- start start 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.318+0000 7fe714600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe70c0c5a50 0x7fe70c1e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.318+0000 7fe714600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe70c0ca630 0x7fe70c0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.318+0000 7fe714600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0cb1e0 0x7fe70c152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.318+0000 7fe714600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b3690 con 0x7fe70c0ca630 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.318+0000 7fe714600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b55d0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.318+0000 7fe714600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b5050 con 0x7fe70c0cb1e0 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe70c0ca630 0x7fe70c0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe712600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0cb1e0 0x7fe70c152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe712600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0cb1e0 0x7fe70c152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36644/0 (socket says 172.21.15.102:36644) 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe712600640 1 -- 172.21.15.102:0/1341675576 learned_addr learned my addr 172.21.15.102:0/1341675576 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:49.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711c00640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe70c0c5a50 0x7fe70c1e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711c00640 1 -- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0cb1e0 msgr2=0x7fe70c152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711c00640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0cb1e0 0x7fe70c152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711c00640 1 -- 172.21.15.102:0/1341675576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe70c0ca630 msgr2=0x7fe70c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711c00640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe70c0ca630 0x7fe70c0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711c00640 1 -- 172.21.15.102:0/1341675576 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8009400 con 0x7fe70c0c5a50 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe712600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0cb1e0 0x7fe70c152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.319+0000 7fe711c00640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe70c0c5a50 0x7fe70c1e4cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c390 tx=0x7fe700001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.320+0000 7fe709600640 1 -- 172.21.15.102:0/1341675576 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700005ce0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.320+0000 7fe709600640 1 -- 172.21.15.102:0/1341675576 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700005e40 con 0x7fe70c0c5a50 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.320+0000 7fe709600640 1 -- 172.21.15.102:0/1341675576 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000072f0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.320+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c1f4120 con 0x7fe70c0c5a50 2024-03-25T05:37:49.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.320+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c1f4400 con 0x7fe70c0c5a50 2024-03-25T05:37:49.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.321+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c0c9f20 con 0x7fe70c0c5a50 2024-03-25T05:37:49.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.322+0000 7fe709600640 1 -- 172.21.15.102:0/1341675576 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe700007510 con 0x7fe70c0c5a50 2024-03-25T05:37:49.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.323+0000 7fe709600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe6ec06b810 0x7fe6ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.323+0000 7fe709600640 1 -- 172.21.15.102:0/1341675576 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe700089950 con 0x7fe70c0c5a50 2024-03-25T05:37:49.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.323+0000 7fe711200640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe6ec06b810 0x7fe6ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.324+0000 7fe711200640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe6ec06b810 0x7fe6ec06dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8036000 tx=0x7fe6f803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:49.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.327+0000 7fe709600640 1 -- 172.21.15.102:0/1341675576 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe7000540d0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.525+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe70c067fb0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.527+0000 7fe709600640 1 -- 172.21.15.102:0/1341675576 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7000170a0 con 0x7fe70c0c5a50 2024-03-25T05:37:49.520 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-03-25T05:37:49.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.528+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe6ec06b810 msgr2=0x7fe6ec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.528+0000 7fe714600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe6ec06b810 0x7fe6ec06dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8036000 tx=0x7fe6f803d040 comp rx=0 tx=0).stop 2024-03-25T05:37:49.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.528+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe70c0c5a50 msgr2=0x7fe70c1e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.528+0000 7fe714600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe70c0c5a50 0x7fe70c1e4cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c390 tx=0x7fe700001e70 comp rx=0 tx=0).stop 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 shutdown_connections 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe6ec06b810 0x7fe6ec06dcd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe70c0cb1e0 0x7fe70c152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe70c0ca630 0x7fe70c0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 --2- 172.21.15.102:0/1341675576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe70c0c5a50 0x7fe70c1e4cb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 >> 172.21.15.102:0/1341675576 conn(0x7fe70c066cc0 msgr2=0x7fe70c153390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 shutdown_connections 2024-03-25T05:37:49.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.529+0000 7fe714600640 1 -- 172.21.15.102:0/1341675576 wait complete. 2024-03-25T05:37:49.541 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-25T05:37:49.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.759+0000 7f7183200640 1 Processor -- start 2024-03-25T05:37:49.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.759+0000 7f7183200640 1 -- start start 2024-03-25T05:37:49.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.760+0000 7f7183200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f71840cb7f0 0x7f71840c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.760+0000 7f7183200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840c8220 con 0x7f7184153e80 2024-03-25T05:37:49.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7183200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840c8500 con 0x7f7184154260 2024-03-25T05:37:49.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7183200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71840ca320 con 0x7f71840cb7f0 2024-03-25T05:37:49.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7181e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7184153e80 0x7f71840c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48444/0 (socket says 172.21.15.102:48444) 2024-03-25T05:37:49.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7181e00640 1 -- 172.21.15.102:0/3518422678 learned_addr learned my addr 172.21.15.102:0/3518422678 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:49.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7182800640 1 --2- 172.21.15.102:0/3518422678 >> v2:172.21.15.102:3300/0 conn(0x7f71840cb7f0 0x7f71840c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7180a00640 1 -- 172.21.15.102:0/3518422678 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869553257 0 0) 0x7f71840c8220 con 0x7f7184153e80 2024-03-25T05:37:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7180a00640 1 -- 172.21.15.102:0/3518422678 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7168003520 con 0x7f7184153e80 2024-03-25T05:37:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7180a00640 1 -- 172.21.15.102:0/3518422678 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562256889 0 0) 0x7f71840c8500 con 0x7f7184154260 2024-03-25T05:37:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7180a00640 1 -- 172.21.15.102:0/3518422678 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71840c8220 con 0x7f7184154260 2024-03-25T05:37:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7182800640 1 -- 172.21.15.102:0/3518422678 >> v1:172.21.15.187:6789/0 conn(0x7f7184154260 legacy=0x7f71840cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7182800640 1 -- 172.21.15.102:0/3518422678 >> v1:172.21.15.102:6789/0 conn(0x7f7184153e80 legacy=0x7f71840c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.761+0000 7f7182800640 1 -- 172.21.15.102:0/3518422678 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840ca600 con 0x7f71840cb7f0 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7182800640 1 --2- 172.21.15.102:0/3518422678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71840cb7f0 0x7f71840c7460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f717c009d90 tx=0x7f717c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4543c951b874b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7180a00640 1 -- 172.21.15.102:0/3518422678 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c02cd80 con 0x7f71840cb7f0 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7180a00640 1 -- 172.21.15.102:0/3518422678 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c034440 con 0x7f71840cb7f0 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7180a00640 1 -- 172.21.15.102:0/3518422678 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0347d0 con 0x7f71840cb7f0 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7183200640 1 -- 172.21.15.102:0/3518422678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71840cb7f0 msgr2=0x7f71840c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7183200640 1 --2- 172.21.15.102:0/3518422678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71840cb7f0 0x7f71840c7460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f717c009d90 tx=0x7f717c02bfd0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7183200640 1 -- 172.21.15.102:0/3518422678 shutdown_connections 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.763+0000 7f7183200640 1 --2- 172.21.15.102:0/3518422678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71840cb7f0 0x7f71840c7460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.764+0000 7f7183200640 1 -- 172.21.15.102:0/3518422678 >> 172.21.15.102:0/3518422678 conn(0x7f71840cf370 msgr2=0x7f71840cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:49.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.764+0000 7f7183200640 1 -- 172.21.15.102:0/3518422678 shutdown_connections 2024-03-25T05:37:49.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.764+0000 7f7183200640 1 -- 172.21.15.102:0/3518422678 wait complete. 2024-03-25T05:37:49.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.765+0000 7f7183200640 1 Processor -- start 2024-03-25T05:37:49.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.765+0000 7f7183200640 1 -- start start 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7183200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71840cb7f0 0x7f71841ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7183200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184153e80 0x7f71841f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7183200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71841571a0 0x7f71841518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7183200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7184150dc0 con 0x7f7184153e80 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7183200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71841f28f0 con 0x7f71841571a0 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7183200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7184156140 con 0x7f71840cb7f0 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7181400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184153e80 0x7f71841f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.766+0000 7f7181400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184153e80 0x7f71841f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47946/0 (socket says 172.21.15.102:47946) 2024-03-25T05:37:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181400640 1 -- 172.21.15.102:0/1305851536 learned_addr learned my addr 172.21.15.102:0/1305851536 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7182800640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71841571a0 0x7f71841518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181e00640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71840cb7f0 0x7f71841ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181400640 1 -- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71840cb7f0 msgr2=0x7f71841ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181400640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71840cb7f0 0x7f71841ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181400640 1 -- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71841571a0 msgr2=0x7f71841518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181400640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71841571a0 0x7f71841518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181400640 1 -- 172.21.15.102:0/1305851536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c009a70 con 0x7f7184153e80 2024-03-25T05:37:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f7181400640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184153e80 0x7f71841f3390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f717000c3c0 tx=0x7f717000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.767+0000 7f717a000640 1 -- 172.21.15.102:0/1305851536 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700052d0 con 0x7f7184153e80 2024-03-25T05:37:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.768+0000 7f717a000640 1 -- 172.21.15.102:0/1305851536 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7170005450 con 0x7f7184153e80 2024-03-25T05:37:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.768+0000 7f717a000640 1 -- 172.21.15.102:0/1305851536 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170003830 con 0x7f7184153e80 2024-03-25T05:37:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.768+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7184156420 con 0x7f7184153e80 2024-03-25T05:37:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.768+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71841569e0 con 0x7f7184153e80 2024-03-25T05:37:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.769+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718404f2f0 con 0x7f7184153e80 2024-03-25T05:37:49.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.770+0000 7f717a000640 1 -- 172.21.15.102:0/1305851536 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7170003990 con 0x7f7184153e80 2024-03-25T05:37:49.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.771+0000 7f717a000640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f716406b840 0x7f716406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:49.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.771+0000 7f717a000640 1 -- 172.21.15.102:0/1305851536 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f71700899e0 con 0x7f7184153e80 2024-03-25T05:37:49.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.771+0000 7f7181e00640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f716406b840 0x7f716406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:49.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.772+0000 7f7181e00640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f716406b840 0x7f716406dd00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71740011e0 tx=0x7f7174007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:49.776+0000 7f717a000640 1 -- 172.21.15.102:0/1305851536 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7170054230 con 0x7f7184153e80 2024-03-25T05:37:50.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.029+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f71840c7120 con 0x7f7184153e80 2024-03-25T05:37:50.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.029+0000 7f717a000640 1 -- 172.21.15.102:0/1305851536 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7170017020 con 0x7f7184153e80 2024-03-25T05:37:50.023 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:37:50.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f716406b840 msgr2=0x7f716406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f716406b840 0x7f716406dd00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71740011e0 tx=0x7f7174007d30 comp rx=0 tx=0).stop 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184153e80 msgr2=0x7f71841f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184153e80 0x7f71841f3390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f717000c3c0 tx=0x7f717000c880 comp rx=0 tx=0).stop 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 shutdown_connections 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f716406b840 0x7f716406dd00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71841571a0 0x7f71841518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184153e80 0x7f71841f3390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 --2- 172.21.15.102:0/1305851536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71840cb7f0 0x7f71841ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 >> 172.21.15.102:0/1305851536 conn(0x7f71840cf370 msgr2=0x7f71841e5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 shutdown_connections 2024-03-25T05:37:50.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.033+0000 7f7183200640 1 -- 172.21.15.102:0/1305851536 wait complete. 2024-03-25T05:37:50.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-25T05:37:50.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.249+0000 7fa64de00640 1 Processor -- start 2024-03-25T05:37:50.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.249+0000 7fa64de00640 1 -- start start 2024-03-25T05:37:50.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa64de00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6480c6240 0x7fa6480cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa64de00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64815a060 con 0x7fa6480c5940 2024-03-25T05:37:50.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa64de00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64815a340 con 0x7fa6480cfcc0 2024-03-25T05:37:50.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa64de00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64815a620 con 0x7fa6480c6240 2024-03-25T05:37:50.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa646000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6480c6240 0x7fa6480cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa646a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa6480c5940 0x7fa6480ca4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48452/0 (socket says 172.21.15.102:48452) 2024-03-25T05:37:50.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa646a00640 1 -- 172.21.15.102:0/1872728785 learned_addr learned my addr 172.21.15.102:0/1872728785 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:50.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.252+0000 7fa646000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6480c6240 0x7fa6480cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47960/0 (socket says 172.21.15.102:47960) 2024-03-25T05:37:50.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.253+0000 7fa646000640 1 -- 172.21.15.102:0/1872728785 >> v1:172.21.15.187:6789/0 conn(0x7fa6480cfcc0 legacy=0x7fa6480c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.253+0000 7fa646000640 1 -- 172.21.15.102:0/1872728785 >> v1:172.21.15.102:6789/0 conn(0x7fa6480c5940 legacy=0x7fa6480ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.253+0000 7fa646000640 1 -- 172.21.15.102:0/1872728785 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64815a900 con 0x7fa6480c6240 2024-03-25T05:37:50.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.253+0000 7fa645600640 1 -- 172.21.15.102:0/1872728785 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596970326 0 0) 0x7fa64815a060 con 0x7fa6480c5940 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.254+0000 7fa646000640 1 --2- 172.21.15.102:0/1872728785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480c6240 0x7fa6480cf780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6340097a0 tx=0x7fa63402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e85ea5319a1475 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.254+0000 7fa645600640 1 -- 172.21.15.102:0/1872728785 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634030610 con 0x7fa6480c6240 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.254+0000 7fa645600640 1 -- 172.21.15.102:0/1872728785 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634030770 con 0x7fa6480c6240 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.254+0000 7fa645600640 1 -- 172.21.15.102:0/1872728785 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634030b00 con 0x7fa6480c6240 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.255+0000 7fa64de00640 1 -- 172.21.15.102:0/1872728785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480c6240 msgr2=0x7fa6480cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.255+0000 7fa64de00640 1 --2- 172.21.15.102:0/1872728785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480c6240 0x7fa6480cf780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6340097a0 tx=0x7fa63402b960 comp rx=0 tx=0).stop 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.255+0000 7fa64de00640 1 -- 172.21.15.102:0/1872728785 shutdown_connections 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.255+0000 7fa64de00640 1 --2- 172.21.15.102:0/1872728785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480c6240 0x7fa6480cf780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.255+0000 7fa64de00640 1 -- 172.21.15.102:0/1872728785 >> 172.21.15.102:0/1872728785 conn(0x7fa6480728c0 msgr2=0x7fa64806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.255+0000 7fa64de00640 1 -- 172.21.15.102:0/1872728785 shutdown_connections 2024-03-25T05:37:50.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.255+0000 7fa64de00640 1 -- 172.21.15.102:0/1872728785 wait complete. 2024-03-25T05:37:50.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.256+0000 7fa64de00640 1 Processor -- start 2024-03-25T05:37:50.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.257+0000 7fa64de00640 1 -- start start 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.257+0000 7fa64de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6480c5940 0x7fa6481588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.257+0000 7fa64de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6480c6240 0x7fa6481e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.257+0000 7fa64de00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480cfcc0 0x7fa6481f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.257+0000 7fa64de00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6481f0400 con 0x7fa6480cfcc0 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.257+0000 7fa64de00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6481ef810 con 0x7fa6480c6240 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.257+0000 7fa64de00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64814d640 con 0x7fa6480c5940 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480cfcc0 0x7fa6481f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480cfcc0 0x7fa6481f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47972/0 (socket says 172.21.15.102:47972) 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 -- 172.21.15.102:0/3092819225 learned_addr learned my addr 172.21.15.102:0/3092819225 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:50.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa646000640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6480c6240 0x7fa6481e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa646a00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6480c5940 0x7fa6481588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 -- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6480c5940 msgr2=0x7fa6481588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6480c5940 0x7fa6481588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 -- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6480c6240 msgr2=0x7fa6481e07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6480c6240 0x7fa6481e07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.258+0000 7fa647400640 1 -- 172.21.15.102:0/3092819225 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634009400 con 0x7fa6480cfcc0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.259+0000 7fa647400640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480cfcc0 0x7fa6481f2d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c6b0 tx=0x7fa64000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.259+0000 7fa63f400640 1 -- 172.21.15.102:0/3092819225 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640003b70 con 0x7fa6480cfcc0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.259+0000 7fa63f400640 1 -- 172.21.15.102:0/3092819225 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640003cf0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.259+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6480c5ea0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.259+0000 7fa63f400640 1 -- 172.21.15.102:0/3092819225 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640003ea0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.259+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6481efad0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.260+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6481f05b0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.261+0000 7fa63f400640 1 -- 172.21.15.102:0/3092819225 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa640005310 con 0x7fa6480cfcc0 2024-03-25T05:37:50.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.262+0000 7fa63f400640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa62806b840 0x7fa62806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.262+0000 7fa63f400640 1 -- 172.21.15.102:0/3092819225 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa64008a140 con 0x7fa6480cfcc0 2024-03-25T05:37:50.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.262+0000 7fa646a00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa62806b840 0x7fa62806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.263+0000 7fa646a00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa62806b840 0x7fa62806dd00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa638007f70 tx=0x7fa638007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:50.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.266+0000 7fa63f400640 1 -- 172.21.15.102:0/3092819225 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa6481f05b0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.478+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6481f05b0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.478+0000 7fa63f400640 1 -- 172.21.15.102:0/3092819225 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6481f05b0 con 0x7fa6480cfcc0 2024-03-25T05:37:50.472 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2024-03-25T05:37:50.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa62806b840 msgr2=0x7fa62806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa62806b840 0x7fa62806dd00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa638007f70 tx=0x7fa638007f00 comp rx=0 tx=0).stop 2024-03-25T05:37:50.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480cfcc0 msgr2=0x7fa6481f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480cfcc0 0x7fa6481f2d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c6b0 tx=0x7fa64000cb70 comp rx=0 tx=0).stop 2024-03-25T05:37:50.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 shutdown_connections 2024-03-25T05:37:50.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa62806b840 0x7fa62806dd00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6480cfcc0 0x7fa6481f2d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6480c6240 0x7fa6481e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 --2- 172.21.15.102:0/3092819225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6480c5940 0x7fa6481588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 >> 172.21.15.102:0/3092819225 conn(0x7fa6480728c0 msgr2=0x7fa6480cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:50.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 shutdown_connections 2024-03-25T05:37:50.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.481+0000 7fa64de00640 1 -- 172.21.15.102:0/3092819225 wait complete. 2024-03-25T05:37:50.493 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2024-03-25T05:37:50.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:50.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-25T05:37:50.571 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi102.stderr:ceph-fuse[42041]: fuse finished with error 0 and tester_r 0 2024-03-25T05:37:50.575 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T05:37:50.668 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T05:37:50.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:37:50.668 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-25T05:37:50.732 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.942+0000 7fad8da00640 1 Processor -- start 2024-03-25T05:37:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.942+0000 7fad8da00640 1 -- start start 2024-03-25T05:37:50.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad8da00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b3f0 0x7fad880c6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad8da00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fad880c6560 0x7fad88151b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad8da00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fad8806b7d0 0x7fad881520b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad8da00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad88157d30 con 0x7fad8806b7d0 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad8da00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad88072930 con 0x7fad880c6560 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad8da00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad88072c10 con 0x7fad8806b3f0 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad86a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b3f0 0x7fad880c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad86a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b3f0 0x7fad880c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36680/0 (socket says 172.21.15.102:36680) 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad7fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fad880c6560 0x7fad88151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad86a00640 1 -- 172.21.15.102:0/583129881 learned_addr learned my addr 172.21.15.102:0/583129881 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:50.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.944+0000 7fad87400640 1 --2- 172.21.15.102:0/583129881 >> v2:172.21.15.102:3300/0 conn(0x7fad8806b7d0 0x7fad881520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.945+0000 7fad86a00640 1 -- 172.21.15.102:0/583129881 >> v2:172.21.15.187:3300/0 conn(0x7fad880c6560 msgr2=0x7fad88151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:50.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.945+0000 7fad86a00640 1 --2- 172.21.15.102:0/583129881 >> v2:172.21.15.187:3300/0 conn(0x7fad880c6560 0x7fad88151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.945+0000 7fad86a00640 1 -- 172.21.15.102:0/583129881 >> v2:172.21.15.102:3300/0 conn(0x7fad8806b7d0 msgr2=0x7fad881520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:50.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.945+0000 7fad86a00640 1 --2- 172.21.15.102:0/583129881 >> v2:172.21.15.102:3300/0 conn(0x7fad8806b7d0 0x7fad881520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.945+0000 7fad86a00640 1 -- 172.21.15.102:0/583129881 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88072ef0 con 0x7fad8806b3f0 2024-03-25T05:37:50.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.946+0000 7fad86a00640 1 --2- 172.21.15.102:0/583129881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b3f0 0x7fad880c6020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad8806eca0 tx=0x7fad7802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd2911f9f2529bf server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.946+0000 7fad86000640 1 -- 172.21.15.102:0/583129881 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78031870 con 0x7fad8806b3f0 2024-03-25T05:37:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.946+0000 7fad86000640 1 -- 172.21.15.102:0/583129881 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad780319d0 con 0x7fad8806b3f0 2024-03-25T05:37:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad86000640 1 -- 172.21.15.102:0/583129881 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78031d60 con 0x7fad8806b3f0 2024-03-25T05:37:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 -- 172.21.15.102:0/583129881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b3f0 msgr2=0x7fad880c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 --2- 172.21.15.102:0/583129881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b3f0 0x7fad880c6020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad8806eca0 tx=0x7fad7802b910 comp rx=0 tx=0).stop 2024-03-25T05:37:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 -- 172.21.15.102:0/583129881 shutdown_connections 2024-03-25T05:37:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 --2- 172.21.15.102:0/583129881 >> v2:172.21.15.102:3300/0 conn(0x7fad8806b7d0 0x7fad881520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 --2- 172.21.15.102:0/583129881 >> v2:172.21.15.187:3300/0 conn(0x7fad880c6560 0x7fad88151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 --2- 172.21.15.102:0/583129881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b3f0 0x7fad880c6020 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 -- 172.21.15.102:0/583129881 >> 172.21.15.102:0/583129881 conn(0x7fad880cc350 msgr2=0x7fad880cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 -- 172.21.15.102:0/583129881 shutdown_connections 2024-03-25T05:37:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.947+0000 7fad8da00640 1 -- 172.21.15.102:0/583129881 wait complete. 2024-03-25T05:37:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.949+0000 7fad8da00640 1 Processor -- start 2024-03-25T05:37:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.949+0000 7fad8da00640 1 -- start start 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.950+0000 7fad8da00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad8806b3f0 0x7fad88158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.950+0000 7fad8da00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b7d0 0x7fad880c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.950+0000 7fad8da00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad880c6560 0x7fad8814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.950+0000 7fad8da00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad880c3ed0 con 0x7fad880c6560 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.950+0000 7fad8da00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88153570 con 0x7fad8806b3f0 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.950+0000 7fad8da00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad880c4830 con 0x7fad8806b7d0 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad7fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b7d0 0x7fad880c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad87400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad880c6560 0x7fad8814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad86a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad8806b3f0 0x7fad88158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad87400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad880c6560 0x7fad8814fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47994/0 (socket says 172.21.15.102:47994) 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad7fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b7d0 0x7fad880c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36692/0 (socket says 172.21.15.102:36692) 2024-03-25T05:37:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad87400640 1 -- 172.21.15.102:0/2846101159 learned_addr learned my addr 172.21.15.102:0/2846101159 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad86a00640 1 -- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b7d0 msgr2=0x7fad880c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad86a00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b7d0 0x7fad880c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad86a00640 1 -- 172.21.15.102:0/2846101159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad880c6560 msgr2=0x7fad8814fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad86a00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad880c6560 0x7fad8814fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad86a00640 1 -- 172.21.15.102:0/2846101159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780094d0 con 0x7fad8806b3f0 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.951+0000 7fad86a00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad8806b3f0 0x7fad88158e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad88072d50 tx=0x7fad780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.952+0000 7fad7ea00640 1 -- 172.21.15.102:0/2846101159 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7803ac60 con 0x7fad8806b3f0 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.952+0000 7fad7ea00640 1 -- 172.21.15.102:0/2846101159 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7803adc0 con 0x7fad8806b3f0 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.952+0000 7fad7ea00640 1 -- 172.21.15.102:0/2846101159 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78044630 con 0x7fad8806b3f0 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.952+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad880c3850 con 0x7fad8806b3f0 2024-03-25T05:37:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.952+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad88150440 con 0x7fad8806b3f0 2024-03-25T05:37:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.953+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad880c90e0 con 0x7fad8806b3f0 2024-03-25T05:37:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.955+0000 7fad7ea00640 1 -- 172.21.15.102:0/2846101159 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad78044790 con 0x7fad8806b3f0 2024-03-25T05:37:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.956+0000 7fad7ea00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fad6406b810 0x7fad6406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.956+0000 7fad7ea00640 1 -- 172.21.15.102:0/2846101159 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fad7802d040 con 0x7fad8806b3f0 2024-03-25T05:37:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.956+0000 7fad7fe00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fad6406b810 0x7fad6406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:50.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.957+0000 7fad7fe00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fad6406b810 0x7fad6406dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad881593d0 tx=0x7fad70009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:50.958+0000 7fad7ea00640 1 -- 172.21.15.102:0/2846101159 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fad780774c0 con 0x7fad8806b3f0 2024-03-25T05:37:51.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.157+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad881eff60 con 0x7fad8806b3f0 2024-03-25T05:37:51.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.159+0000 7fad7ea00640 1 -- 172.21.15.102:0/2846101159 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7fad7807ab80 con 0x7fad8806b3f0 2024-03-25T05:37:51.153 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:51.153 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fad6406b810 msgr2=0x7fad6406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fad6406b810 0x7fad6406dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad881593d0 tx=0x7fad70009190 comp rx=0 tx=0).stop 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad8806b3f0 msgr2=0x7fad88158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad8806b3f0 0x7fad88158e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad88072d50 tx=0x7fad780046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 shutdown_connections 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fad6406b810 0x7fad6406dcd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad880c6560 0x7fad8814fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad8806b7d0 0x7fad880c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 --2- 172.21.15.102:0/2846101159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad8806b3f0 0x7fad88158e90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.161+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 >> 172.21.15.102:0/2846101159 conn(0x7fad880cc350 msgr2=0x7fad881567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.162+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 shutdown_connections 2024-03-25T05:37:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.162+0000 7fad8da00640 1 -- 172.21.15.102:0/2846101159 wait complete. 2024-03-25T05:37:51.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.377+0000 7f903fe00640 1 Processor -- start 2024-03-25T05:37:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.377+0000 7f903fe00640 1 -- start start 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903fe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f90400c6c10 0x7f9040165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903fe00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90400cbbe0 con 0x7f90400c67e0 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903fe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90400ca280 con 0x7f9040154120 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903fe00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9040154500 con 0x7f90400c6c10 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903f400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f90400c6c10 0x7f9040165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903e000640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f90400c67e0 0x7f90400c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48458/0 (socket says 172.21.15.102:48458) 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903ea00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9040154120 0x7f90400cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:37960/0 (socket says 172.21.15.102:37960) 2024-03-25T05:37:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903e000640 1 -- 172.21.15.102:0/120722953 learned_addr learned my addr 172.21.15.102:0/120722953 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903d600640 1 -- 172.21.15.102:0/120722953 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115492535 0 0) 0x7f90400ca280 con 0x7f9040154120 2024-03-25T05:37:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903f400640 1 -- 172.21.15.102:0/120722953 >> v1:172.21.15.187:6789/0 conn(0x7f9040154120 legacy=0x7f90400cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903f400640 1 -- 172.21.15.102:0/120722953 >> v1:172.21.15.102:6789/0 conn(0x7f90400c67e0 legacy=0x7f90400c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.379+0000 7f903f400640 1 -- 172.21.15.102:0/120722953 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904015aac0 con 0x7f90400c6c10 2024-03-25T05:37:51.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.381+0000 7f903f400640 1 --2- 172.21.15.102:0/120722953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90400c6c10 0x7f9040165590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9038009d90 tx=0x7f903802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0538609d5bef103 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:51.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.381+0000 7f903d600640 1 -- 172.21.15.102:0/120722953 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903802cab0 con 0x7f90400c6c10 2024-03-25T05:37:51.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.381+0000 7f903d600640 1 -- 172.21.15.102:0/120722953 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903802cc10 con 0x7f90400c6c10 2024-03-25T05:37:51.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.381+0000 7f903d600640 1 -- 172.21.15.102:0/120722953 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9038034440 con 0x7f90400c6c10 2024-03-25T05:37:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.381+0000 7f903fe00640 1 -- 172.21.15.102:0/120722953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90400c6c10 msgr2=0x7f9040165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.381+0000 7f903fe00640 1 --2- 172.21.15.102:0/120722953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90400c6c10 0x7f9040165590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9038009d90 tx=0x7f903802bd80 comp rx=0 tx=0).stop 2024-03-25T05:37:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.382+0000 7f903fe00640 1 -- 172.21.15.102:0/120722953 shutdown_connections 2024-03-25T05:37:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.382+0000 7f903fe00640 1 --2- 172.21.15.102:0/120722953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90400c6c10 0x7f9040165590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.382+0000 7f903fe00640 1 -- 172.21.15.102:0/120722953 >> 172.21.15.102:0/120722953 conn(0x7f90400cf3e0 msgr2=0x7f90400cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.382+0000 7f903fe00640 1 -- 172.21.15.102:0/120722953 shutdown_connections 2024-03-25T05:37:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.382+0000 7f903fe00640 1 -- 172.21.15.102:0/120722953 wait complete. 2024-03-25T05:37:51.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.383+0000 7f903fe00640 1 Processor -- start 2024-03-25T05:37:51.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.383+0000 7f903fe00640 1 -- start start 2024-03-25T05:37:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.384+0000 7f903fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90400c67e0 0x7f90401f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.384+0000 7f903fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400c6c10 0x7f90400c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.384+0000 7f903fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040154120 0x7f90401ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.384+0000 7f903fe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90401f3830 con 0x7f9040154120 2024-03-25T05:37:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.384+0000 7f903fe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040154650 con 0x7f90400c6c10 2024-03-25T05:37:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.384+0000 7f903fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90401ef510 con 0x7f90400c67e0 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040154120 0x7f90401ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040154120 0x7f90401ef9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48000/0 (socket says 172.21.15.102:48000) 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 -- 172.21.15.102:0/2142013916 learned_addr learned my addr 172.21.15.102:0/2142013916 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903ea00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90400c67e0 0x7f90401f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903e000640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400c6c10 0x7f90400c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 -- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90400c67e0 msgr2=0x7f90401f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90400c67e0 0x7f90401f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 -- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400c6c10 msgr2=0x7f90400c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400c6c10 0x7f90400c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.385+0000 7f903f400640 1 -- 172.21.15.102:0/2142013916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9038009a70 con 0x7f9040154120 2024-03-25T05:37:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.386+0000 7f903f400640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040154120 0x7f90401ef9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9038037040 tx=0x7f9038004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.386+0000 7f9036a00640 1 -- 172.21.15.102:0/2142013916 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903803e610 con 0x7f9040154120 2024-03-25T05:37:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.386+0000 7f9036a00640 1 -- 172.21.15.102:0/2142013916 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903803e770 con 0x7f9040154120 2024-03-25T05:37:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.386+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90401572f0 con 0x7f9040154120 2024-03-25T05:37:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.386+0000 7f9036a00640 1 -- 172.21.15.102:0/2142013916 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903803eb20 con 0x7f9040154120 2024-03-25T05:37:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.386+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9040159bf0 con 0x7f9040154120 2024-03-25T05:37:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.387+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904004f2f0 con 0x7f9040154120 2024-03-25T05:37:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.388+0000 7f9036a00640 1 -- 172.21.15.102:0/2142013916 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f903803b050 con 0x7f9040154120 2024-03-25T05:37:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.389+0000 7f9036a00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f902006b840 0x7f902006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.389+0000 7f9036a00640 1 -- 172.21.15.102:0/2142013916 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f90380ac8c0 con 0x7f9040154120 2024-03-25T05:37:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.389+0000 7f903ea00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f902006b840 0x7f902006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.390+0000 7f903ea00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f902006b840 0x7f902006dd00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9030000f60 tx=0x7f9030007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.393+0000 7f9036a00640 1 -- 172.21.15.102:0/2142013916 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9038076f20 con 0x7f9040154120 2024-03-25T05:37:51.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.605+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90401ef650 con 0x7f9040154120 2024-03-25T05:37:51.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.608+0000 7f9036a00640 1 -- 172.21.15.102:0/2142013916 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f9038039090 con 0x7f9040154120 2024-03-25T05:37:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:51.601 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f902006b840 msgr2=0x7f902006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f902006b840 0x7f902006dd00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9030000f60 tx=0x7f9030007e40 comp rx=0 tx=0).stop 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040154120 msgr2=0x7f90401ef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040154120 0x7f90401ef9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9038037040 tx=0x7f9038004a40 comp rx=0 tx=0).stop 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 shutdown_connections 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f902006b840 0x7f902006dd00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040154120 0x7f90401ef9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400c6c10 0x7f90400c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 --2- 172.21.15.102:0/2142013916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90400c67e0 0x7f90401f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.611+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 >> 172.21.15.102:0/2142013916 conn(0x7f90400cf3e0 msgr2=0x7f90400cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.612+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 shutdown_connections 2024-03-25T05:37:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.612+0000 7f903fe00640 1 -- 172.21.15.102:0/2142013916 wait complete. 2024-03-25T05:37:51.624 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-25T05:37:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.840+0000 7efc4f600640 1 Processor -- start 2024-03-25T05:37:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.840+0000 7efc4f600640 1 -- start start 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4f600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efc48154330 0x7efc48070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4f600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efc4806fd20 0x7efc480cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4f600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480c7900 con 0x7efc480cc8f0 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4f600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc480c7be0 con 0x7efc48154330 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4f600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc480c7ec0 con 0x7efc4806fd20 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4cc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efc48154330 0x7efc48070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4d600640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efc480cc8f0 0x7efc4815a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48466/0 (socket says 172.21.15.102:48466) 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc4d600640 1 -- 172.21.15.102:0/4101946058 learned_addr learned my addr 172.21.15.102:0/4101946058 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.842+0000 7efc47e00640 1 --2- 172.21.15.102:0/4101946058 >> v2:172.21.15.187:3300/0 conn(0x7efc4806fd20 0x7efc480cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.843+0000 7efc47e00640 1 -- 172.21.15.102:0/4101946058 >> v2:172.21.15.102:3300/0 conn(0x7efc48154330 msgr2=0x7efc48070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.843+0000 7efc47e00640 1 --2- 172.21.15.102:0/4101946058 >> v2:172.21.15.102:3300/0 conn(0x7efc48154330 0x7efc48070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.843+0000 7efc47e00640 1 -- 172.21.15.102:0/4101946058 >> v1:172.21.15.102:6789/0 conn(0x7efc480cc8f0 legacy=0x7efc4815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.843+0000 7efc47e00640 1 -- 172.21.15.102:0/4101946058 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc480c81a0 con 0x7efc4806fd20 2024-03-25T05:37:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.844+0000 7efc47e00640 1 --2- 172.21.15.102:0/4101946058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc4806fd20 0x7efc480cc3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc480cd450 tx=0x7efc3402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7311dad366577d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.844+0000 7efc47400640 1 -- 172.21.15.102:0/4101946058 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34030610 con 0x7efc4806fd20 2024-03-25T05:37:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc47400640 1 -- 172.21.15.102:0/4101946058 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc34030770 con 0x7efc4806fd20 2024-03-25T05:37:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc47400640 1 -- 172.21.15.102:0/4101946058 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34030b00 con 0x7efc4806fd20 2024-03-25T05:37:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc4f600640 1 -- 172.21.15.102:0/4101946058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc4806fd20 msgr2=0x7efc480cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc4f600640 1 --2- 172.21.15.102:0/4101946058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc4806fd20 0x7efc480cc3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc480cd450 tx=0x7efc3402b960 comp rx=0 tx=0).stop 2024-03-25T05:37:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc4f600640 1 -- 172.21.15.102:0/4101946058 shutdown_connections 2024-03-25T05:37:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc4f600640 1 --2- 172.21.15.102:0/4101946058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc4806fd20 0x7efc480cc3b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc4f600640 1 --2- 172.21.15.102:0/4101946058 >> v2:172.21.15.102:3300/0 conn(0x7efc48154330 0x7efc48070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc4f600640 1 -- 172.21.15.102:0/4101946058 >> 172.21.15.102:0/4101946058 conn(0x7efc48066cc0 msgr2=0x7efc480670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.845+0000 7efc4f600640 1 -- 172.21.15.102:0/4101946058 shutdown_connections 2024-03-25T05:37:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.846+0000 7efc4f600640 1 -- 172.21.15.102:0/4101946058 wait complete. 2024-03-25T05:37:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.847+0000 7efc4f600640 1 Processor -- start 2024-03-25T05:37:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.848+0000 7efc4f600640 1 -- start start 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.848+0000 7efc4f600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4806fd20 0x7efc4814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.848+0000 7efc4f600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc480cc8f0 0x7efc48154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.848+0000 7efc4f600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc48154c60 0x7efc480cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.848+0000 7efc4f600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481555f0 con 0x7efc4806fd20 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.848+0000 7efc4f600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48149900 con 0x7efc480cc8f0 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.848+0000 7efc4f600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc48149ba0 con 0x7efc48154c60 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4806fd20 0x7efc4814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4806fd20 0x7efc4814aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48016/0 (socket says 172.21.15.102:48016) 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 -- 172.21.15.102:0/3681801859 learned_addr learned my addr 172.21.15.102:0/3681801859 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4d600640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc48154c60 0x7efc480cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc47e00640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc480cc8f0 0x7efc48154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 -- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc48154c60 msgr2=0x7efc480cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc48154c60 0x7efc480cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 -- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc480cc8f0 msgr2=0x7efc48154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc480cc8f0 0x7efc48154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 -- 172.21.15.102:0/3681801859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34009400 con 0x7efc4806fd20 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.849+0000 7efc4cc00640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4806fd20 0x7efc4814aab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00e870 tx=0x7efc3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.850+0000 7efc44c00640 1 -- 172.21.15.102:0/3681801859 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0094f0 con 0x7efc4806fd20 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.850+0000 7efc44c00640 1 -- 172.21.15.102:0/3681801859 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c00c940 con 0x7efc4806fd20 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.850+0000 7efc44c00640 1 -- 172.21.15.102:0/3681801859 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00ccf0 con 0x7efc4806fd20 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.850+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc48149e80 con 0x7efc4806fd20 2024-03-25T05:37:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.850+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4814a440 con 0x7efc4806fd20 2024-03-25T05:37:51.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.851+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc480cb2a0 con 0x7efc4806fd20 2024-03-25T05:37:51.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.852+0000 7efc44c00640 1 -- 172.21.15.102:0/3681801859 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc3c013470 con 0x7efc4806fd20 2024-03-25T05:37:51.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.853+0000 7efc44c00640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7efc2806b810 0x7efc2806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:51.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.853+0000 7efc44c00640 1 -- 172.21.15.102:0/3681801859 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efc3c08a6e0 con 0x7efc4806fd20 2024-03-25T05:37:51.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.854+0000 7efc47e00640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7efc2806b810 0x7efc2806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:51.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.854+0000 7efc47e00640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7efc2806b810 0x7efc2806dcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc34036000 tx=0x7efc34008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:51.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:51.858+0000 7efc44c00640 1 -- 172.21.15.102:0/3681801859 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efc3c054d40 con 0x7efc4806fd20 2024-03-25T05:37:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.150+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc480686c0 con 0x7efc4806fd20 2024-03-25T05:37:52.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.500+0000 7efc44c00640 1 -- 172.21.15.102:0/3681801859 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc3c058400 con 0x7efc4806fd20 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7efc2806b810 msgr2=0x7efc2806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7efc2806b810 0x7efc2806dcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc34036000 tx=0x7efc34008030 comp rx=0 tx=0).stop 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4806fd20 msgr2=0x7efc4814aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4806fd20 0x7efc4814aab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00e870 tx=0x7efc3c00ed30 comp rx=0 tx=0).stop 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 shutdown_connections 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7efc2806b810 0x7efc2806dcd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc48154c60 0x7efc480cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc480cc8f0 0x7efc48154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 --2- 172.21.15.102:0/3681801859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4806fd20 0x7efc4814aab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 >> 172.21.15.102:0/3681801859 conn(0x7efc48066cc0 msgr2=0x7efc480c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.504+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 shutdown_connections 2024-03-25T05:37:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.505+0000 7efc4f600640 1 -- 172.21.15.102:0/3681801859 wait complete. 2024-03-25T05:37:52.519 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-03-25T05:37:52.519 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-25T05:37:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.735+0000 7f4c5ec00640 1 Processor -- start 2024-03-25T05:37:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.735+0000 7f4c5ec00640 1 -- start start 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.736+0000 7f4c5ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c580c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.736+0000 7f4c5ec00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c580c6460 0x7f4c580c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.736+0000 7f4c5ec00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580c27d0 con 0x7f4c580c5e60 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.736+0000 7f4c5ec00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c580c2d00 con 0x7f4c580c6460 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.736+0000 7f4c5ec00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58152360 con 0x7f4c58151f80 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c57e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c580c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c57400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4c580c5e60 0x7f4c5806ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:37968/0 (socket says 172.21.15.102:37968) 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c57400640 1 -- 172.21.15.102:0/3813854404 learned_addr learned my addr 172.21.15.102:0/3813854404 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c5cc00640 1 --2- 172.21.15.102:0/3813854404 >> v2:172.21.15.102:3300/0 conn(0x7f4c580c6460 0x7f4c580c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c57e00640 1 -- 172.21.15.102:0/3813854404 >> v2:172.21.15.102:3300/0 conn(0x7f4c580c6460 msgr2=0x7f4c580c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c57e00640 1 --2- 172.21.15.102:0/3813854404 >> v2:172.21.15.102:3300/0 conn(0x7f4c580c6460 0x7f4c580c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c57e00640 1 -- 172.21.15.102:0/3813854404 >> v1:172.21.15.187:6789/0 conn(0x7f4c580c5e60 legacy=0x7f4c5806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c57e00640 1 -- 172.21.15.102:0/3813854404 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580c2a20 con 0x7f4c58151f80 2024-03-25T05:37:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.737+0000 7f4c56a00640 1 -- 172.21.15.102:0/3813854404 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594988715 0 0) 0x7f4c580c27d0 con 0x7f4c580c5e60 2024-03-25T05:37:52.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.738+0000 7f4c57e00640 1 --2- 172.21.15.102:0/3813854404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c580c35a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c480097a0 tx=0x7f4c4802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9e9e195cc11cd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:52.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c56a00640 1 -- 172.21.15.102:0/3813854404 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4802d040 con 0x7f4c58151f80 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c56a00640 1 -- 172.21.15.102:0/3813854404 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48031810 con 0x7f4c58151f80 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c56a00640 1 -- 172.21.15.102:0/3813854404 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48031ba0 con 0x7f4c58151f80 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c5ec00640 1 -- 172.21.15.102:0/3813854404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 msgr2=0x7f4c580c35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/3813854404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c580c35a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c480097a0 tx=0x7f4c4802b8b0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c5ec00640 1 -- 172.21.15.102:0/3813854404 shutdown_connections 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/3813854404 >> v2:172.21.15.102:3300/0 conn(0x7f4c580c6460 0x7f4c580c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/3813854404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c580c35a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c5ec00640 1 -- 172.21.15.102:0/3813854404 >> 172.21.15.102:0/3813854404 conn(0x7f4c5806afb0 msgr2=0x7f4c5806b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.739+0000 7f4c5ec00640 1 -- 172.21.15.102:0/3813854404 shutdown_connections 2024-03-25T05:37:52.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.740+0000 7f4c5ec00640 1 -- 172.21.15.102:0/3813854404 wait complete. 2024-03-25T05:37:52.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.741+0000 7f4c5ec00640 1 Processor -- start 2024-03-25T05:37:52.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.741+0000 7f4c5ec00640 1 -- start start 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5ec00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c580c5e60 0x7f4c58158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5ec00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580c6460 0x7f4c581ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c581ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5ec00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581f21e0 con 0x7f4c580c6460 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5ec00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581496b0 con 0x7f4c580c5e60 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5ec00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581f1030 con 0x7f4c58151f80 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c581ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:52.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c57e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c580c5e60 0x7f4c58158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c5cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c581ed640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:36722/0 (socket says 172.21.15.102:36722) 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c57e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c580c5e60 0x7f4c58158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:58248/0 (socket says 172.21.15.102:58248) 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c57e00640 1 -- 172.21.15.102:0/1827241299 learned_addr learned my addr 172.21.15.102:0/1827241299 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.742+0000 7f4c57400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580c6460 0x7f4c581ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c5cc00640 1 -- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c580c5e60 msgr2=0x7f4c58158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c5cc00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c580c5e60 0x7f4c58158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c5cc00640 1 -- 172.21.15.102:0/1827241299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580c6460 msgr2=0x7f4c581ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c5cc00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580c6460 0x7f4c581ed100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c5cc00640 1 -- 172.21.15.102:0/1827241299 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009400 con 0x7f4c58151f80 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c57e00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c580c5e60 0x7f4c58158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c5cc00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c581ed640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000d530 tx=0x7f4c5000d9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c4fe00640 1 -- 172.21.15.102:0/1827241299 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500125f0 con 0x7f4c58151f80 2024-03-25T05:37:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c4fe00640 1 -- 172.21.15.102:0/1827241299 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50012750 con 0x7f4c58151f80 2024-03-25T05:37:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.743+0000 7f4c4fe00640 1 -- 172.21.15.102:0/1827241299 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50012ae0 con 0x7f4c58151f80 2024-03-25T05:37:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.744+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c581f1280 con 0x7f4c58151f80 2024-03-25T05:37:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.744+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c581f1840 con 0x7f4c58151f80 2024-03-25T05:37:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.745+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c581f2320 con 0x7f4c58151f80 2024-03-25T05:37:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.746+0000 7f4c4fe00640 1 -- 172.21.15.102:0/1827241299 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c50012c40 con 0x7f4c58151f80 2024-03-25T05:37:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.746+0000 7f4c4fe00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4c3406b840 0x7f4c3406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.747+0000 7f4c4fe00640 1 -- 172.21.15.102:0/1827241299 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4c5008a880 con 0x7f4c58151f80 2024-03-25T05:37:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.747+0000 7f4c57e00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4c3406b840 0x7f4c3406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.747+0000 7f4c57e00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4c3406b840 0x7f4c3406dd00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c480097a0 tx=0x7f4c4803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.751+0000 7f4c4fe00640 1 -- 172.21.15.102:0/1827241299 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4c581f2320 con 0x7f4c58151f80 2024-03-25T05:37:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:52.990+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f4c581f2320 con 0x7f4c58151f80 2024-03-25T05:37:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.505+0000 7f4c4fe00640 1 -- 172.21.15.102:0/1827241299 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4c581f2320 con 0x7f4c58151f80 2024-03-25T05:37:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4c3406b840 msgr2=0x7f4c3406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4c3406b840 0x7f4c3406dd00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c480097a0 tx=0x7f4c4803c040 comp rx=0 tx=0).stop 2024-03-25T05:37:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 msgr2=0x7f4c581ed640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c581ed640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000d530 tx=0x7f4c5000d9f0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 shutdown_connections 2024-03-25T05:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4c3406b840 0x7f4c3406dd00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c58151f80 0x7f4c581ed640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580c6460 0x7f4c581ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 --2- 172.21.15.102:0/1827241299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c580c5e60 0x7f4c58158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 >> 172.21.15.102:0/1827241299 conn(0x7f4c5806afb0 msgr2=0x7f4c58150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 shutdown_connections 2024-03-25T05:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.510+0000 7f4c5ec00640 1 -- 172.21.15.102:0/1827241299 wait complete. 2024-03-25T05:37:53.531 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-25T05:37:53.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.730+0000 7f0449000640 1 Processor -- start 2024-03-25T05:37:53.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.730+0000 7f0449000640 1 -- start start 2024-03-25T05:37:53.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0449000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0444151e40 0x7f04440c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0449000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f04441586d0 0x7f04440c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0449000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04440c92d0 0x7f04440cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0449000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0444152220 con 0x7f04440c92d0 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0449000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440c8640 con 0x7f04441586d0 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0449000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0444070530 con 0x7f0444151e40 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0441400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f04441586d0 0x7f04440c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0442800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04440c92d0 0x7f04440cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.733+0000 7f0441e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0444151e40 0x7f04440c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:53.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0441e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0444151e40 0x7f04440c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57842/0 (socket says 172.21.15.102:57842) 2024-03-25T05:37:53.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0441e00640 1 -- 172.21.15.102:0/1869644117 learned_addr learned my addr 172.21.15.102:0/1869644117 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0441400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f04441586d0 0x7f04440c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48176/0 (socket says 172.21.15.102:48176) 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0442800640 1 -- 172.21.15.102:0/1869644117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0444151e40 msgr2=0x7f04440c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0442800640 1 --2- 172.21.15.102:0/1869644117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0444151e40 0x7f04440c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0442800640 1 -- 172.21.15.102:0/1869644117 >> v2:172.21.15.187:3300/0 conn(0x7f04441586d0 msgr2=0x7f04440c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0442800640 1 --2- 172.21.15.102:0/1869644117 >> v2:172.21.15.187:3300/0 conn(0x7f04441586d0 0x7f04440c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.734+0000 7f0442800640 1 -- 172.21.15.102:0/1869644117 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044406ff70 con 0x7f04440c92d0 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.735+0000 7f0442800640 1 --2- 172.21.15.102:0/1869644117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04440c92d0 0x7f04440cda10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f044406bb30 tx=0x7f043c02be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e748d06d1dcb019 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.735+0000 7f0440a00640 1 -- 172.21.15.102:0/1869644117 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c02cbe0 con 0x7f04440c92d0 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.735+0000 7f0440a00640 1 -- 172.21.15.102:0/1869644117 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c02cd40 con 0x7f04440c92d0 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.735+0000 7f0440a00640 1 -- 172.21.15.102:0/1869644117 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c034660 con 0x7f04440c92d0 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 -- 172.21.15.102:0/1869644117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04440c92d0 msgr2=0x7f04440cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 --2- 172.21.15.102:0/1869644117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04440c92d0 0x7f04440cda10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f044406bb30 tx=0x7f043c02be30 comp rx=0 tx=0).stop 2024-03-25T05:37:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 -- 172.21.15.102:0/1869644117 shutdown_connections 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 --2- 172.21.15.102:0/1869644117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04440c92d0 0x7f04440cda10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 --2- 172.21.15.102:0/1869644117 >> v2:172.21.15.187:3300/0 conn(0x7f04441586d0 0x7f04440c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 --2- 172.21.15.102:0/1869644117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0444151e40 0x7f04440c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 -- 172.21.15.102:0/1869644117 >> 172.21.15.102:0/1869644117 conn(0x7f0444066ea0 msgr2=0x7f04440672b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 -- 172.21.15.102:0/1869644117 shutdown_connections 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.736+0000 7f0449000640 1 -- 172.21.15.102:0/1869644117 wait complete. 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.738+0000 7f0449000640 1 Processor -- start 2024-03-25T05:37:53.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.738+0000 7f0449000640 1 -- start start 2024-03-25T05:37:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0449000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04440c92d0 0x7f04441f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0449000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0444151e40 0x7f04440aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0449000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04441586d0 0x7f04440cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0449000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04441f0bc0 con 0x7f0444151e40 2024-03-25T05:37:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0449000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044406cb90 con 0x7f04440c92d0 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0449000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044406c8b0 con 0x7f04441586d0 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0441400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0444151e40 0x7f04440aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0441400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0444151e40 0x7f04440aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56256/0 (socket says 172.21.15.102:56256) 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0441400640 1 -- 172.21.15.102:0/1798214535 learned_addr learned my addr 172.21.15.102:0/1798214535 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0441e00640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04440c92d0 0x7f04441f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.739+0000 7f0442800640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04441586d0 0x7f04440cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0441400640 1 -- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04441586d0 msgr2=0x7f04440cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0441400640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04441586d0 0x7f04440cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0441400640 1 -- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04440c92d0 msgr2=0x7f04441f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0441400640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04440c92d0 0x7f04441f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0441400640 1 -- 172.21.15.102:0/1798214535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c009a70 con 0x7f0444151e40 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0441400640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0444151e40 0x7f04440aeca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f043000e870 tx=0x7f043000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f043a000640 1 -- 172.21.15.102:0/1798214535 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04300094f0 con 0x7f0444151e40 2024-03-25T05:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f043a000640 1 -- 172.21.15.102:0/1798214535 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043000c940 con 0x7f0444151e40 2024-03-25T05:37:53.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044406cf90 con 0x7f0444151e40 2024-03-25T05:37:53.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f043a000640 1 -- 172.21.15.102:0/1798214535 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000ccf0 con 0x7f0444151e40 2024-03-25T05:37:53.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.740+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044406d550 con 0x7f0444151e40 2024-03-25T05:37:53.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.742+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04440686c0 con 0x7f0444151e40 2024-03-25T05:37:53.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.743+0000 7f043a000640 1 -- 172.21.15.102:0/1798214535 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0430013470 con 0x7f0444151e40 2024-03-25T05:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.744+0000 7f043a000640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f042406b810 0x7f042406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.744+0000 7f043a000640 1 -- 172.21.15.102:0/1798214535 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f043008ad60 con 0x7f0444151e40 2024-03-25T05:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.744+0000 7f0441e00640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f042406b810 0x7f042406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.745+0000 7f0441e00640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f042406b810 0x7f042406dcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0434006cc0 tx=0x7f0434009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:53.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.748+0000 7f043a000640 1 -- 172.21.15.102:0/1798214535 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f04300554d0 con 0x7f0444151e40 2024-03-25T05:37:53.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:53.986+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f044414be90 con 0x7f0444151e40 2024-03-25T05:37:54.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.513+0000 7f043a000640 1 -- 172.21.15.102:0/1798214535 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04300170c0 con 0x7f0444151e40 2024-03-25T05:37:54.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f042406b810 msgr2=0x7f042406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:54.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f042406b810 0x7f042406dcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0434006cc0 tx=0x7f0434009240 comp rx=0 tx=0).stop 2024-03-25T05:37:54.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0444151e40 msgr2=0x7f04440aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:54.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0444151e40 0x7f04440aeca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f043000e870 tx=0x7f043000ed30 comp rx=0 tx=0).stop 2024-03-25T05:37:54.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 shutdown_connections 2024-03-25T05:37:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f042406b810 0x7f042406dcd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04441586d0 0x7f04440cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0444151e40 0x7f04440aeca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 --2- 172.21.15.102:0/1798214535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04440c92d0 0x7f04441f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.517+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 >> 172.21.15.102:0/1798214535 conn(0x7f0444066ea0 msgr2=0x7f0444067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.518+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 shutdown_connections 2024-03-25T05:37:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.518+0000 7f0449000640 1 -- 172.21.15.102:0/1798214535 wait complete. 2024-03-25T05:37:54.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-25T05:37:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.729+0000 7f9f6d800640 1 Processor -- start 2024-03-25T05:37:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.729+0000 7f9f6d800640 1 -- start start 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f6d800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9f680cc2f0 0x7f9f680c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f6d800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9f6815a540 0x7f9f6815a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f6d800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6815ae90 con 0x7f9f680cc6d0 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f6d800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f680c8a70 con 0x7f9f680cc2f0 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f6d800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6806be30 con 0x7f9f6815a540 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f66a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9f680cc2f0 0x7f9f680c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f67400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9f6815a540 0x7f9f6815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f5e000640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9f680cc6d0 0x7f9f68072ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34442/0 (socket says 172.21.15.102:34442) 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.731+0000 7f9f5e000640 1 -- 172.21.15.102:0/289407331 learned_addr learned my addr 172.21.15.102:0/289407331 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.732+0000 7f9f66000640 1 -- 172.21.15.102:0/289407331 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819298676 0 0) 0x7f9f6815ae90 con 0x7f9f680cc6d0 2024-03-25T05:37:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.732+0000 7f9f66000640 1 -- 172.21.15.102:0/289407331 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4c003520 con 0x7f9f680cc6d0 2024-03-25T05:37:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.732+0000 7f9f67400640 1 -- 172.21.15.102:0/289407331 >> v2:172.21.15.102:3300/0 conn(0x7f9f680cc2f0 msgr2=0x7f9f680c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.732+0000 7f9f67400640 1 --2- 172.21.15.102:0/289407331 >> v2:172.21.15.102:3300/0 conn(0x7f9f680cc2f0 0x7f9f680c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.732+0000 7f9f67400640 1 -- 172.21.15.102:0/289407331 >> v1:172.21.15.187:6789/0 conn(0x7f9f680cc6d0 legacy=0x7f9f68072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.732+0000 7f9f67400640 1 -- 172.21.15.102:0/289407331 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6806bb50 con 0x7f9f6815a540 2024-03-25T05:37:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.733+0000 7f9f67400640 1 --2- 172.21.15.102:0/289407331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f6815a540 0x7f9f6815a950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f6806b4f0 tx=0x7f9f6002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dfc7e4c9f9eac24 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.733+0000 7f9f66000640 1 -- 172.21.15.102:0/289407331 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6002cc70 con 0x7f9f6815a540 2024-03-25T05:37:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.733+0000 7f9f66000640 1 -- 172.21.15.102:0/289407331 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6002cdd0 con 0x7f9f6815a540 2024-03-25T05:37:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.733+0000 7f9f66000640 1 -- 172.21.15.102:0/289407331 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60034660 con 0x7f9f6815a540 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 -- 172.21.15.102:0/289407331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f6815a540 msgr2=0x7f9f6815a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 --2- 172.21.15.102:0/289407331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f6815a540 0x7f9f6815a950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f6806b4f0 tx=0x7f9f6002bec0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 -- 172.21.15.102:0/289407331 shutdown_connections 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 --2- 172.21.15.102:0/289407331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f6815a540 0x7f9f6815a950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 --2- 172.21.15.102:0/289407331 >> v2:172.21.15.102:3300/0 conn(0x7f9f680cc2f0 0x7f9f680c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 -- 172.21.15.102:0/289407331 >> 172.21.15.102:0/289407331 conn(0x7f9f6806c0c0 msgr2=0x7f9f6806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 -- 172.21.15.102:0/289407331 shutdown_connections 2024-03-25T05:37:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.734+0000 7f9f6d800640 1 -- 172.21.15.102:0/289407331 wait complete. 2024-03-25T05:37:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.737+0000 7f9f6d800640 1 Processor -- start 2024-03-25T05:37:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.737+0000 7f9f6d800640 1 -- start start 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.738+0000 7f9f6d800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f680cc2f0 0x7f9f6814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.738+0000 7f9f6d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f680cc6d0 0x7f9f68148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.738+0000 7f9f6d800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f6815a540 0x7f9f68157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.738+0000 7f9f6d800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f68159eb0 con 0x7f9f6815a540 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.738+0000 7f9f6d800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f68159bd0 con 0x7f9f680cc2f0 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.738+0000 7f9f6d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f680c5fb0 con 0x7f9f680cc6d0 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f680cc6d0 0x7f9f68148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f66a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f680cc2f0 0x7f9f6814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f680cc6d0 0x7f9f68148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57866/0 (socket says 172.21.15.102:57866) 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f66a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f680cc2f0 0x7f9f6814dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48204/0 (socket says 172.21.15.102:48204) 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 -- 172.21.15.102:0/1782957559 learned_addr learned my addr 172.21.15.102:0/1782957559 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f67400640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f6815a540 0x7f9f68157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 -- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f680cc2f0 msgr2=0x7f9f6814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f680cc2f0 0x7f9f6814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 -- 172.21.15.102:0/1782957559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f6815a540 msgr2=0x7f9f68157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f6815a540 0x7f9f68157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 -- 172.21.15.102:0/1782957559 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009a70 con 0x7f9f680cc6d0 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f66a00640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f680cc2f0 0x7f9f6814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.739+0000 7f9f5e000640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f680cc6d0 0x7f9f68148300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c430 tx=0x7f9f5000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.740+0000 7f9f5f400640 1 -- 172.21.15.102:0/1782957559 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50005ce0 con 0x7f9f680cc6d0 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.740+0000 7f9f5f400640 1 -- 172.21.15.102:0/1782957559 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50005e40 con 0x7f9f680cc6d0 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.740+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f680c6290 con 0x7f9f680cc6d0 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.740+0000 7f9f5f400640 1 -- 172.21.15.102:0/1782957559 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500072f0 con 0x7f9f680cc6d0 2024-03-25T05:37:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.740+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f68153080 con 0x7f9f680cc6d0 2024-03-25T05:37:54.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.741+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f680c4a00 con 0x7f9f680cc6d0 2024-03-25T05:37:54.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.743+0000 7f9f5f400640 1 -- 172.21.15.102:0/1782957559 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f50007450 con 0x7f9f680cc6d0 2024-03-25T05:37:54.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.743+0000 7f9f5f400640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9f4406b840 0x7f9f4406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:54.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.744+0000 7f9f5f400640 1 -- 172.21.15.102:0/1782957559 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9f50089b50 con 0x7f9f680cc6d0 2024-03-25T05:37:54.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.744+0000 7f9f66a00640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9f4406b840 0x7f9f4406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:54.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.744+0000 7f9f66a00640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9f4406b840 0x7f9f4406dd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009f30 tx=0x7f9f58009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:54.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.748+0000 7f9f5f400640 1 -- 172.21.15.102:0/1782957559 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9f680c4a00 con 0x7f9f680cc6d0 2024-03-25T05:37:54.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:54.990+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f9f680c4de0 con 0x7f9f680cc6d0 2024-03-25T05:37:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.532+0000 7f9f5f400640 1 -- 172.21.15.102:0/1782957559 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f9f680c4de0 con 0x7f9f680cc6d0 2024-03-25T05:37:55.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9f4406b840 msgr2=0x7f9f4406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9f4406b840 0x7f9f4406dd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009f30 tx=0x7f9f58009190 comp rx=0 tx=0).stop 2024-03-25T05:37:55.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f680cc6d0 msgr2=0x7f9f68148300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f680cc6d0 0x7f9f68148300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c430 tx=0x7f9f5000c8f0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 shutdown_connections 2024-03-25T05:37:55.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9f4406b840 0x7f9f4406dd00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f6815a540 0x7f9f68157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f680cc6d0 0x7f9f68148300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 --2- 172.21.15.102:0/1782957559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f680cc2f0 0x7f9f6814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 >> 172.21.15.102:0/1782957559 conn(0x7f9f6806c0c0 msgr2=0x7f9f681569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:55.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 shutdown_connections 2024-03-25T05:37:55.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.536+0000 7f9f6d800640 1 -- 172.21.15.102:0/1782957559 wait complete. 2024-03-25T05:37:55.557 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-25T05:37:55.557 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T05:37:55.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.739+0000 7ffaa1200640 1 Processor -- start 2024-03-25T05:37:55.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.739+0000 7ffaa1200640 1 -- start start 2024-03-25T05:37:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.740+0000 7ffaa1200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffa9c0c7940 0x7ffa9c0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.740+0000 7ffaa1200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c0c82d0 con 0x7ffa9c0c6240 2024-03-25T05:37:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.740+0000 7ffaa1200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c15a060 con 0x7ffa9c0c5940 2024-03-25T05:37:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.740+0000 7ffaa1200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c15a340 con 0x7ffa9c0c7940 2024-03-25T05:37:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa99e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ffa9c0c5940 0x7ffa9c0ca4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34454/0 (socket says 172.21.15.102:34454) 2024-03-25T05:37:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa99e00640 1 -- 172.21.15.102:0/830268521 learned_addr learned my addr 172.21.15.102:0/830268521 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:55.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa9a800640 1 --2- 172.21.15.102:0/830268521 >> v2:172.21.15.102:3300/0 conn(0x7ffa9c0c7940 0x7ffa9c0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:55.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa98a00640 1 -- 172.21.15.102:0/830268521 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660796996 0 0) 0x7ffa9c15a060 con 0x7ffa9c0c5940 2024-03-25T05:37:55.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa98a00640 1 -- 172.21.15.102:0/830268521 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa80003520 con 0x7ffa9c0c5940 2024-03-25T05:37:55.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa9a800640 1 -- 172.21.15.102:0/830268521 >> v1:172.21.15.187:6789/0 conn(0x7ffa9c0c5940 legacy=0x7ffa9c0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa9a800640 1 -- 172.21.15.102:0/830268521 >> v1:172.21.15.102:6789/0 conn(0x7ffa9c0c6240 legacy=0x7ffa9c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.741+0000 7ffa9a800640 1 -- 172.21.15.102:0/830268521 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c15a620 con 0x7ffa9c0c7940 2024-03-25T05:37:55.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.742+0000 7ffa9a800640 1 --2- 172.21.15.102:0/830268521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c0c7d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009d90 tx=0x7ffa9402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef325821e7aaa752 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:55.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.742+0000 7ffa98a00640 1 -- 172.21.15.102:0/830268521 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9402ccf0 con 0x7ffa9c0c7940 2024-03-25T05:37:55.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.742+0000 7ffa98a00640 1 -- 172.21.15.102:0/830268521 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9402ce50 con 0x7ffa9c0c7940 2024-03-25T05:37:55.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.742+0000 7ffa98a00640 1 -- 172.21.15.102:0/830268521 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94034660 con 0x7ffa9c0c7940 2024-03-25T05:37:55.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.743+0000 7ffaa1200640 1 -- 172.21.15.102:0/830268521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c7940 msgr2=0x7ffa9c0c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.743+0000 7ffaa1200640 1 --2- 172.21.15.102:0/830268521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c0c7d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009d90 tx=0x7ffa9402bf40 comp rx=0 tx=0).stop 2024-03-25T05:37:55.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.743+0000 7ffaa1200640 1 -- 172.21.15.102:0/830268521 shutdown_connections 2024-03-25T05:37:55.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.743+0000 7ffaa1200640 1 --2- 172.21.15.102:0/830268521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c0c7d90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.743+0000 7ffaa1200640 1 -- 172.21.15.102:0/830268521 >> 172.21.15.102:0/830268521 conn(0x7ffa9c0728c0 msgr2=0x7ffa9c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:55.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.743+0000 7ffaa1200640 1 -- 172.21.15.102:0/830268521 shutdown_connections 2024-03-25T05:37:55.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.743+0000 7ffaa1200640 1 -- 172.21.15.102:0/830268521 wait complete. 2024-03-25T05:37:55.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 Processor -- start 2024-03-25T05:37:55.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 -- start start 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa9c0c5940 0x7ffa9c1f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c6240 0x7ffa9c1f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c1f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c1f3b60 con 0x7ffa9c0c6240 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0aaf90 con 0x7ffa9c0c7940 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.745+0000 7ffaa1200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c1e3d50 con 0x7ffa9c0c5940 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa9c0c5940 0x7ffa9c1f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa9c0c5940 0x7ffa9c1f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57876/0 (socket says 172.21.15.102:57876) 2024-03-25T05:37:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 -- 172.21.15.102:0/3881336332 learned_addr learned my addr 172.21.15.102:0/3881336332 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa9a800640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c1f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99400640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c6240 0x7ffa9c1f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 -- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa9c0c7940 msgr2=0x7ffa9c1f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c1f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 -- 172.21.15.102:0/3881336332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c6240 msgr2=0x7ffa9c1f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c6240 0x7ffa9c1f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 -- 172.21.15.102:0/3881336332 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa94009a70 con 0x7ffa9c0c5940 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa9a800640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c1f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.746+0000 7ffa99e00640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa9c0c5940 0x7ffa9c1f2e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c530 tx=0x7ffa8c00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.747+0000 7ffa92000640 1 -- 172.21.15.102:0/3881336332 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c005ce0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.747+0000 7ffa92000640 1 -- 172.21.15.102:0/3881336332 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c005e40 con 0x7ffa9c0c5940 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.747+0000 7ffa92000640 1 -- 172.21.15.102:0/3881336332 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0072b0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.747+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c0c5ea0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.747+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c1f0c60 con 0x7ffa9c0c5940 2024-03-25T05:37:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.748+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c067fb0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.749+0000 7ffa92000640 1 -- 172.21.15.102:0/3881336332 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa8c007410 con 0x7ffa9c0c5940 2024-03-25T05:37:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.750+0000 7ffa92000640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ffa7c06b840 0x7ffa7c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.750+0000 7ffa92000640 1 -- 172.21.15.102:0/3881336332 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffa8c089ac0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.750+0000 7ffa99400640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ffa7c06b840 0x7ffa7c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.750+0000 7ffa99400640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ffa7c06b840 0x7ffa7c06dd00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c157fb0 tx=0x7ffa88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.754+0000 7ffa92000640 1 -- 172.21.15.102:0/3881336332 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ffa8c0542f0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.987+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa9c0c60a0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.988+0000 7ffa92000640 1 -- 172.21.15.102:0/3881336332 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6631 (secure 0 0 0) 0x7ffa9c0c60a0 con 0x7ffa9c0c5940 2024-03-25T05:37:55.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:55.981 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:55.535417+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3],"up":{"mds_0":4291,"mds_1":4273,"mds_2":4270,"mds_3":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"c","rank":3,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4270":{"gid":4270,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4291,4273,4270]},"id":1}]} 2024-03-25T05:37:55.982 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 14 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.990+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ffa7c06b840 msgr2=0x7ffa7c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.990+0000 7ffaa1200640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ffa7c06b840 0x7ffa7c06dd00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c157fb0 tx=0x7ffa88009040 comp rx=0 tx=0).stop 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.990+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa9c0c5940 msgr2=0x7ffa9c1f2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.990+0000 7ffaa1200640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa9c0c5940 0x7ffa9c1f2e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c530 tx=0x7ffa8c00c9f0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 shutdown_connections 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ffa7c06b840 0x7ffa7c06dd00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa9c0c7940 0x7ffa9c1f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa9c0c6240 0x7ffa9c1f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 --2- 172.21.15.102:0/3881336332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa9c0c5940 0x7ffa9c1f2e30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 >> 172.21.15.102:0/3881336332 conn(0x7ffa9c0728c0 msgr2=0x7ffa9c0b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 shutdown_connections 2024-03-25T05:37:55.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:55.991+0000 7ffaa1200640 1 -- 172.21.15.102:0/3881336332 wait complete. 2024-03-25T05:37:56.001 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.206+0000 7f2894200640 1 Processor -- start 2024-03-25T05:37:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.206+0000 7f2894200640 1 -- start start 2024-03-25T05:37:56.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.207+0000 7f2894200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.207+0000 7f2894200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f288c0cfcc0 0x7f288c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2894200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c15a060 con 0x7f288c0c5940 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2894200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c15a340 con 0x7f288c0cfcc0 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2894200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c15a620 con 0x7f288c0c6240 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2891800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f288c0c5940 0x7f288c0ca4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34458/0 (socket says 172.21.15.102:34458) 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2891800640 1 -- 172.21.15.102:0/2999237269 learned_addr learned my addr 172.21.15.102:0/2999237269 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2892200640 1 --2- 172.21.15.102:0/2999237269 >> v2:172.21.15.187:3300/0 conn(0x7f288c0cfcc0 0x7f288c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2890e00640 1 --2- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f288be00640 1 -- 172.21.15.102:0/2999237269 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764886740 0 0) 0x7f288c15a060 con 0x7f288c0c5940 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f288be00640 1 -- 172.21.15.102:0/2999237269 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2874003520 con 0x7f288c0c5940 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2892200640 1 -- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 msgr2=0x7f288c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2892200640 1 --2- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2892200640 1 -- 172.21.15.102:0/2999237269 >> v1:172.21.15.187:6789/0 conn(0x7f288c0c5940 legacy=0x7f288c0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.208+0000 7f2892200640 1 -- 172.21.15.102:0/2999237269 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c15a900 con 0x7f288c0cfcc0 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.209+0000 7f2892200640 1 --2- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0cfcc0 0x7f288c0c7940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2884009d90 tx=0x7f288402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65377396a22f1d12 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.209+0000 7f288be00640 1 -- 172.21.15.102:0/2999237269 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288402cc50 con 0x7f288c0cfcc0 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.209+0000 7f288be00640 1 -- 172.21.15.102:0/2999237269 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288402cdb0 con 0x7f288c0cfcc0 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.209+0000 7f288be00640 1 -- 172.21.15.102:0/2999237269 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884034660 con 0x7f288c0cfcc0 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 -- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0cfcc0 msgr2=0x7f288c0c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 --2- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0cfcc0 0x7f288c0c7940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2884009d90 tx=0x7f288402bea0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 -- 172.21.15.102:0/2999237269 shutdown_connections 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 --2- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0cfcc0 0x7f288c0c7940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 --2- 172.21.15.102:0/2999237269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 -- 172.21.15.102:0/2999237269 >> 172.21.15.102:0/2999237269 conn(0x7f288c0728c0 msgr2=0x7f288c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 -- 172.21.15.102:0/2999237269 shutdown_connections 2024-03-25T05:37:56.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.210+0000 7f2894200640 1 -- 172.21.15.102:0/2999237269 wait complete. 2024-03-25T05:37:56.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.212+0000 7f2894200640 1 Processor -- start 2024-03-25T05:37:56.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.212+0000 7f2894200640 1 -- start start 2024-03-25T05:37:56.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.212+0000 7f2894200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0c5940 0x7f288c1ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2894200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2894200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c0cfcc0 0x7f288c0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2894200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0af9a0 con 0x7f288c0cfcc0 2024-03-25T05:37:56.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2894200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0ae830 con 0x7f288c0c5940 2024-03-25T05:37:56.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2894200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0ab250 con 0x7f288c0c6240 2024-03-25T05:37:56.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2891800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0c5940 0x7f288c1ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57904/0 (socket says 172.21.15.102:57904) 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 -- 172.21.15.102:0/1439754647 learned_addr learned my addr 172.21.15.102:0/1439754647 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2892200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c0cfcc0 0x7f288c0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 -- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0c5940 msgr2=0x7f288c1ef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0c5940 0x7f288c1ef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 -- 172.21.15.102:0/1439754647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c0cfcc0 msgr2=0x7f288c0abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c0cfcc0 0x7f288c0abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2890e00640 1 -- 172.21.15.102:0/1439754647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884009a70 con 0x7f288c0c6240 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2891800640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0c5940 0x7f288c1ef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.213+0000 7f2892200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c0cfcc0 0x7f288c0abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.214+0000 7f2890e00640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0ab6e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f287800e9b0 tx=0x7f287800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.214+0000 7f2889600640 1 -- 172.21.15.102:0/1439754647 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878009670 con 0x7f288c0c6240 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.214+0000 7f2889600640 1 -- 172.21.15.102:0/1439754647 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800c9a0 con 0x7f288c0c6240 2024-03-25T05:37:56.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.214+0000 7f2889600640 1 -- 172.21.15.102:0/1439754647 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800cd50 con 0x7f288c0c6240 2024-03-25T05:37:56.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.214+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c0c5ea0 con 0x7f288c0c6240 2024-03-25T05:37:56.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.214+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c0adf90 con 0x7f288c0c6240 2024-03-25T05:37:56.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.215+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c067fb0 con 0x7f288c0c6240 2024-03-25T05:37:56.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.217+0000 7f2889600640 1 -- 172.21.15.102:0/1439754647 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2878013470 con 0x7f288c0c6240 2024-03-25T05:37:56.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.217+0000 7f2889600640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f286c06b840 0x7f286c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.218+0000 7f2889600640 1 -- 172.21.15.102:0/1439754647 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f287808a650 con 0x7f288c0c6240 2024-03-25T05:37:56.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.218+0000 7f2891800640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f286c06b840 0x7f286c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.218+0000 7f2891800640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f286c06b840 0x7f286c06dd00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28800011e0 tx=0x7f2880007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:56.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.222+0000 7f2889600640 1 -- 172.21.15.102:0/1439754647 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2878054dd0 con 0x7f288c0c6240 2024-03-25T05:37:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.410+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f288c0cf490 con 0x7f288c0c6240 2024-03-25T05:37:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.411+0000 7f2889600640 1 -- 172.21.15.102:0/1439754647 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f2878058490 con 0x7f288c0c6240 2024-03-25T05:37:56.404 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:56.405 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f286c06b840 msgr2=0x7f286c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f286c06b840 0x7f286c06dd00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28800011e0 tx=0x7f2880007d30 comp rx=0 tx=0).stop 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 msgr2=0x7f288c0ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0ab6e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f287800e9b0 tx=0x7f287800ee70 comp rx=0 tx=0).stop 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 shutdown_connections 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f286c06b840 0x7f286c06dd00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c0cfcc0 0x7f288c0abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288c0c6240 0x7f288c0ab6e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 --2- 172.21.15.102:0/1439754647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288c0c5940 0x7f288c1ef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.413+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 >> 172.21.15.102:0/1439754647 conn(0x7f288c0728c0 msgr2=0x7f288c0cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:56.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.414+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 shutdown_connections 2024-03-25T05:37:56.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.414+0000 7f2894200640 1 -- 172.21.15.102:0/1439754647 wait complete. 2024-03-25T05:37:56.424 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-25T05:37:56.424 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T05:37:56.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.637+0000 7f5884600640 1 Processor -- start 2024-03-25T05:37:56.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.637+0000 7f5884600640 1 -- start start 2024-03-25T05:37:56.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5884600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c152060 0x7f587c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5884600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c06e340 con 0x7f587c0c3dc0 2024-03-25T05:37:56.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5884600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0c53b0 con 0x7f587c0c39c0 2024-03-25T05:37:56.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5884600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c152440 con 0x7f587c152060 2024-03-25T05:37:56.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5881c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c152060 0x7f587c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5881200640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f587c0c39c0 0x7f587c15b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34460/0 (socket says 172.21.15.102:34460) 2024-03-25T05:37:56.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5881c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c152060 0x7f587c0c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57910/0 (socket says 172.21.15.102:57910) 2024-03-25T05:37:56.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.638+0000 7f5881200640 1 -- 172.21.15.102:0/452086509 learned_addr learned my addr 172.21.15.102:0/452086509 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:56.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.639+0000 7f5881c00640 1 -- 172.21.15.102:0/452086509 >> v1:172.21.15.187:6789/0 conn(0x7f587c0c39c0 legacy=0x7f587c15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.639+0000 7f5881c00640 1 -- 172.21.15.102:0/452086509 >> v1:172.21.15.102:6789/0 conn(0x7f587c0c3dc0 legacy=0x7f587c15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.639+0000 7f5881c00640 1 -- 172.21.15.102:0/452086509 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0c27d0 con 0x7f587c152060 2024-03-25T05:37:56.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.639+0000 7f587be00640 1 -- 172.21.15.102:0/452086509 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531587033 0 0) 0x7f587c0c53b0 con 0x7f587c0c39c0 2024-03-25T05:37:56.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.640+0000 7f5881c00640 1 --2- 172.21.15.102:0/452086509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c152060 0x7f587c0c7700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58700097d0 tx=0x7f587002b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6e8bd16380c98f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.640+0000 7f587be00640 1 -- 172.21.15.102:0/452086509 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870030890 con 0x7f587c152060 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.640+0000 7f587be00640 1 -- 172.21.15.102:0/452086509 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58700309f0 con 0x7f587c152060 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.640+0000 7f587be00640 1 -- 172.21.15.102:0/452086509 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870030d80 con 0x7f587c152060 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.640+0000 7f5884600640 1 -- 172.21.15.102:0/452086509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c152060 msgr2=0x7f587c0c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.640+0000 7f5884600640 1 --2- 172.21.15.102:0/452086509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c152060 0x7f587c0c7700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58700097d0 tx=0x7f587002b9d0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.641+0000 7f5884600640 1 -- 172.21.15.102:0/452086509 shutdown_connections 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.641+0000 7f5884600640 1 --2- 172.21.15.102:0/452086509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c152060 0x7f587c0c7700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.641+0000 7f5884600640 1 -- 172.21.15.102:0/452086509 >> 172.21.15.102:0/452086509 conn(0x7f587c0c7dd0 msgr2=0x7f587c0c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.641+0000 7f5884600640 1 -- 172.21.15.102:0/452086509 shutdown_connections 2024-03-25T05:37:56.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.641+0000 7f5884600640 1 -- 172.21.15.102:0/452086509 wait complete. 2024-03-25T05:37:56.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.642+0000 7f5884600640 1 Processor -- start 2024-03-25T05:37:56.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.642+0000 7f5884600640 1 -- start start 2024-03-25T05:37:56.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5884600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c0c39c0 0x7f587c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5884600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c0c3dc0 0x7f587c06b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5884600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587c152060 0x7f587c1e3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5884600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1e3310 con 0x7f587c152060 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5884600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c14d550 con 0x7f587c0c3dc0 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5884600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c14cd10 con 0x7f587c0c39c0 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5881c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c0c39c0 0x7f587c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5881200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c0c3dc0 0x7f587c06b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5882600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587c152060 0x7f587c1e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5881c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c0c39c0 0x7f587c14e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57926/0 (socket says 172.21.15.102:57926) 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.643+0000 7f5881c00640 1 -- 172.21.15.102:0/3778155732 learned_addr learned my addr 172.21.15.102:0/3778155732 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5881c00640 1 -- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c0c3dc0 msgr2=0x7f587c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5881c00640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c0c3dc0 0x7f587c06b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5881c00640 1 -- 172.21.15.102:0/3778155732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587c152060 msgr2=0x7f587c1e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5881c00640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587c152060 0x7f587c1e3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5881c00640 1 -- 172.21.15.102:0/3778155732 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870009400 con 0x7f587c0c39c0 2024-03-25T05:37:56.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5881c00640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c0c39c0 0x7f587c14e010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f587002bfe0 tx=0x7f58700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:56.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5879600640 1 -- 172.21.15.102:0/3778155732 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587003e070 con 0x7f587c0c39c0 2024-03-25T05:37:56.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5879600640 1 -- 172.21.15.102:0/3778155732 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870030830 con 0x7f587c0c39c0 2024-03-25T05:37:56.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5879600640 1 -- 172.21.15.102:0/3778155732 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700423f0 con 0x7f587c0c39c0 2024-03-25T05:37:56.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.644+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c14cfb0 con 0x7f587c0c39c0 2024-03-25T05:37:56.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.645+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c14d270 con 0x7f587c0c39c0 2024-03-25T05:37:56.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.646+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c067fb0 con 0x7f587c0c39c0 2024-03-25T05:37:56.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.647+0000 7f5879600640 1 -- 172.21.15.102:0/3778155732 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5870042550 con 0x7f587c0c39c0 2024-03-25T05:37:56.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.647+0000 7f5879600640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f585c06b840 0x7f585c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:56.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.647+0000 7f5879600640 1 -- 172.21.15.102:0/3778155732 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f58700acc50 con 0x7f587c0c39c0 2024-03-25T05:37:56.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.648+0000 7f5881200640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f585c06b840 0x7f585c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:56.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.648+0000 7f5881200640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f585c06b840 0x7f585c06dd00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5868007f70 tx=0x7f5868007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:56.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.652+0000 7f5879600640 1 -- 172.21.15.102:0/3778155732 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f58700774f0 con 0x7f587c0c39c0 2024-03-25T05:37:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.841+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f587c15bfb0 con 0x7f585c06b840 2024-03-25T05:37:56.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.850+0000 7f5879600640 1 -- 172.21.15.102:0/3778155732 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332787 (secure 0 0 0) 0x7f5868004c70 con 0x7f585c06b840 2024-03-25T05:37:56.847 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:56.849 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T05:37:56.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f585c06b840 msgr2=0x7f585c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f585c06b840 0x7f585c06dd00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5868007f70 tx=0x7f5868007f00 comp rx=0 tx=0).stop 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c0c39c0 msgr2=0x7f587c14e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c0c39c0 0x7f587c14e010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f587002bfe0 tx=0x7f58700046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 shutdown_connections 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f585c06b840 0x7f585c06dd00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587c152060 0x7f587c1e3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c0c3dc0 0x7f587c06b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 --2- 172.21.15.102:0/3778155732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c0c39c0 0x7f587c14e010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 >> 172.21.15.102:0/3778155732 conn(0x7f587c0c7dd0 msgr2=0x7f587c14eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.855+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 shutdown_connections 2024-03-25T05:37:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:56.856+0000 7f5884600640 1 -- 172.21.15.102:0/3778155732 wait complete. 2024-03-25T05:37:56.865 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-25T05:37:55.010979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218456,"kb_used_data":2328,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756264,"statfs":{"total":773094113280,"available":772870414336,"internally_reserved":0,"allocated":2383872,"data_stored":2052084,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5042,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003196"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.541577+0000","last_change":"2024-03-25T05:37:30.423912+0000","last_active":"2024-03-25T05:37:54.541577+0000","last_peered":"2024-03-25T05:37:54.541577+0000","last_clean":"2024-03-25T05:37:54.541577+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T05:37:54.541577+0000","last_undegraded":"2024-03-25T05:37:54.541577+0000","last_fullsized":"2024-03-25T05:37:54.541577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433740+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T05:37:37.433740+0000","last_peered":"2024-03-25T05:37:37.433740+0000","last_clean":"2024-03-25T05:37:37.433740+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T05:37:37.433740+0000","last_undegraded":"2024-03-25T05:37:37.433740+0000","last_fullsized":"2024-03-25T05:37:37.433740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431653+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T05:37:37.431653+0000","last_peered":"2024-03-25T05:37:37.431653+0000","last_clean":"2024-03-25T05:37:37.431653+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T05:37:37.431653+0000","last_undegraded":"2024-03-25T05:37:37.431653+0000","last_fullsized":"2024-03-25T05:37:37.431653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:43:49.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433909+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T05:37:37.433909+0000","last_peered":"2024-03-25T05:37:37.433909+0000","last_clean":"2024-03-25T05:37:37.433909+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T05:37:37.433909+0000","last_undegraded":"2024-03-25T05:37:37.433909+0000","last_fullsized":"2024-03-25T05:37:37.433909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585751+0000","last_change":"2024-03-25T05:37:31.155929+0000","last_active":"2024-03-25T05:37:38.585751+0000","last_peered":"2024-03-25T05:37:38.585751+0000","last_clean":"2024-03-25T05:37:38.585751+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T05:37:38.585751+0000","last_undegraded":"2024-03-25T05:37:38.585751+0000","last_fullsized":"2024-03-25T05:37:38.585751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432218+0000","last_change":"2024-03-25T05:37:35.459531+0000","last_active":"2024-03-25T05:37:37.432218+0000","last_peered":"2024-03-25T05:37:37.432218+0000","last_clean":"2024-03-25T05:37:37.432218+0000","last_became_active":"2024-03-25T05:37:35.459127+0000","last_became_peered":"2024-03-25T05:37:35.459127+0000","last_unstale":"2024-03-25T05:37:37.432218+0000","last_undegraded":"2024-03-25T05:37:37.432218+0000","last_fullsized":"2024-03-25T05:37:37.432218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.530924+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T05:37:54.530924+0000","last_peered":"2024-03-25T05:37:54.530924+0000","last_clean":"2024-03-25T05:37:54.530924+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T05:37:54.530924+0000","last_undegraded":"2024-03-25T05:37:54.530924+0000","last_fullsized":"2024-03-25T05:37:54.530924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221959+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T05:37:38.221959+0000","last_peered":"2024-03-25T05:37:38.221959+0000","last_clean":"2024-03-25T05:37:38.221959+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T05:37:38.221959+0000","last_undegraded":"2024-03-25T05:37:38.221959+0000","last_fullsized":"2024-03-25T05:37:38.221959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432708+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T05:37:37.432708+0000","last_peered":"2024-03-25T05:37:37.432708+0000","last_clean":"2024-03-25T05:37:37.432708+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T05:37:37.432708+0000","last_undegraded":"2024-03-25T05:37:37.432708+0000","last_fullsized":"2024-03-25T05:37:37.432708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309619+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T05:37:38.309619+0000","last_peered":"2024-03-25T05:37:38.309619+0000","last_clean":"2024-03-25T05:37:38.309619+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T05:37:38.309619+0000","last_undegraded":"2024-03-25T05:37:38.309619+0000","last_fullsized":"2024-03-25T05:37:38.309619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222108+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T05:37:38.222108+0000","last_peered":"2024-03-25T05:37:38.222108+0000","last_clean":"2024-03-25T05:37:38.222108+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T05:37:38.222108+0000","last_undegraded":"2024-03-25T05:37:38.222108+0000","last_fullsized":"2024-03-25T05:37:38.222108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432306+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T05:37:37.432306+0000","last_peered":"2024-03-25T05:37:37.432306+0000","last_clean":"2024-03-25T05:37:37.432306+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T05:37:37.432306+0000","last_undegraded":"2024-03-25T05:37:37.432306+0000","last_fullsized":"2024-03-25T05:37:37.432306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805582+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T05:37:38.805582+0000","last_peered":"2024-03-25T05:37:38.805582+0000","last_clean":"2024-03-25T05:37:38.805582+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T05:37:38.805582+0000","last_undegraded":"2024-03-25T05:37:38.805582+0000","last_fullsized":"2024-03-25T05:37:38.805582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.520789+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T05:37:53.520789+0000","last_peered":"2024-03-25T05:37:53.520789+0000","last_clean":"2024-03-25T05:37:53.520789+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T05:37:53.520789+0000","last_undegraded":"2024-03-25T05:37:53.520789+0000","last_fullsized":"2024-03-25T05:37:53.520789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432841+0000","last_change":"2024-03-25T05:37:35.462815+0000","last_active":"2024-03-25T05:37:37.432841+0000","last_peered":"2024-03-25T05:37:37.432841+0000","last_clean":"2024-03-25T05:37:37.432841+0000","last_became_active":"2024-03-25T05:37:35.462293+0000","last_became_peered":"2024-03-25T05:37:35.462293+0000","last_unstale":"2024-03-25T05:37:37.432841+0000","last_undegraded":"2024-03-25T05:37:37.432841+0000","last_fullsized":"2024-03-25T05:37:37.432841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433456+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T05:37:37.433456+0000","last_peered":"2024-03-25T05:37:37.433456+0000","last_clean":"2024-03-25T05:37:37.433456+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T05:37:37.433456+0000","last_undegraded":"2024-03-25T05:37:37.433456+0000","last_fullsized":"2024-03-25T05:37:37.433456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432431+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T05:37:37.432431+0000","last_peered":"2024-03-25T05:37:37.432431+0000","last_clean":"2024-03-25T05:37:37.432431+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T05:37:37.432431+0000","last_undegraded":"2024-03-25T05:37:37.432431+0000","last_fullsized":"2024-03-25T05:37:37.432431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433020+0000","last_change":"2024-03-25T05:37:35.463326+0000","last_active":"2024-03-25T05:37:37.433020+0000","last_peered":"2024-03-25T05:37:37.433020+0000","last_clean":"2024-03-25T05:37:37.433020+0000","last_became_active":"2024-03-25T05:37:35.462618+0000","last_became_peered":"2024-03-25T05:37:35.462618+0000","last_unstale":"2024-03-25T05:37:37.433020+0000","last_undegraded":"2024-03-25T05:37:37.433020+0000","last_fullsized":"2024-03-25T05:37:37.433020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431690+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T05:37:37.431690+0000","last_peered":"2024-03-25T05:37:37.431690+0000","last_clean":"2024-03-25T05:37:37.431690+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T05:37:37.431690+0000","last_undegraded":"2024-03-25T05:37:37.431690+0000","last_fullsized":"2024-03-25T05:37:37.431690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.525052+0000","last_change":"2024-03-25T05:37:30.422594+0000","last_active":"2024-03-25T05:37:53.525052+0000","last_peered":"2024-03-25T05:37:53.525052+0000","last_clean":"2024-03-25T05:37:53.525052+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T05:37:53.525052+0000","last_undegraded":"2024-03-25T05:37:53.525052+0000","last_fullsized":"2024-03-25T05:37:53.525052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435022+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T05:37:37.435022+0000","last_peered":"2024-03-25T05:37:37.435022+0000","last_clean":"2024-03-25T05:37:37.435022+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T05:37:37.435022+0000","last_undegraded":"2024-03-25T05:37:37.435022+0000","last_fullsized":"2024-03-25T05:37:37.435022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432539+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T05:37:37.432539+0000","last_peered":"2024-03-25T05:37:37.432539+0000","last_clean":"2024-03-25T05:37:37.432539+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T05:37:37.432539+0000","last_undegraded":"2024-03-25T05:37:37.432539+0000","last_fullsized":"2024-03-25T05:37:37.432539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.526401+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T05:37:53.526401+0000","last_peered":"2024-03-25T05:37:53.526401+0000","last_clean":"2024-03-25T05:37:53.526401+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T05:37:53.526401+0000","last_undegraded":"2024-03-25T05:37:53.526401+0000","last_fullsized":"2024-03-25T05:37:53.526401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432590+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T05:37:37.432590+0000","last_peered":"2024-03-25T05:37:37.432590+0000","last_clean":"2024-03-25T05:37:37.432590+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T05:37:37.432590+0000","last_undegraded":"2024-03-25T05:37:37.432590+0000","last_fullsized":"2024-03-25T05:37:37.432590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585863+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T05:37:38.585863+0000","last_peered":"2024-03-25T05:37:38.585863+0000","last_clean":"2024-03-25T05:37:38.585863+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T05:37:38.585863+0000","last_undegraded":"2024-03-25T05:37:38.585863+0000","last_fullsized":"2024-03-25T05:37:38.585863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.521052+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T05:37:53.521052+0000","last_peered":"2024-03-25T05:37:53.521052+0000","last_clean":"2024-03-25T05:37:53.521052+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T05:37:53.521052+0000","last_undegraded":"2024-03-25T05:37:53.521052+0000","last_fullsized":"2024-03-25T05:37:53.521052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432209+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T05:37:37.432209+0000","last_peered":"2024-03-25T05:37:37.432209+0000","last_clean":"2024-03-25T05:37:37.432209+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T05:37:37.432209+0000","last_undegraded":"2024-03-25T05:37:37.432209+0000","last_fullsized":"2024-03-25T05:37:37.432209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433971+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T05:37:37.433971+0000","last_peered":"2024-03-25T05:37:37.433971+0000","last_clean":"2024-03-25T05:37:37.433971+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T05:37:37.433971+0000","last_undegraded":"2024-03-25T05:37:37.433971+0000","last_fullsized":"2024-03-25T05:37:37.433971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.533896+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T05:37:54.533896+0000","last_peered":"2024-03-25T05:37:54.533896+0000","last_clean":"2024-03-25T05:37:54.533896+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T05:37:54.533896+0000","last_undegraded":"2024-03-25T05:37:54.533896+0000","last_fullsized":"2024-03-25T05:37:54.533896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431411+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T05:37:37.431411+0000","last_peered":"2024-03-25T05:37:37.431411+0000","last_clean":"2024-03-25T05:37:37.431411+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T05:37:37.431411+0000","last_undegraded":"2024-03-25T05:37:37.431411+0000","last_fullsized":"2024-03-25T05:37:37.431411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:43:13.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431535+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T05:37:37.431535+0000","last_peered":"2024-03-25T05:37:37.431535+0000","last_clean":"2024-03-25T05:37:37.431535+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T05:37:37.431535+0000","last_undegraded":"2024-03-25T05:37:37.431535+0000","last_fullsized":"2024-03-25T05:37:37.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310081+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T05:37:38.310081+0000","last_peered":"2024-03-25T05:37:38.310081+0000","last_clean":"2024-03-25T05:37:38.310081+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T05:37:38.310081+0000","last_undegraded":"2024-03-25T05:37:38.310081+0000","last_fullsized":"2024-03-25T05:37:38.310081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585184+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T05:37:38.585184+0000","last_peered":"2024-03-25T05:37:38.585184+0000","last_clean":"2024-03-25T05:37:38.585184+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T05:37:38.585184+0000","last_undegraded":"2024-03-25T05:37:38.585184+0000","last_fullsized":"2024-03-25T05:37:38.585184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222226+0000","last_change":"2024-03-25T05:37:31.164193+0000","last_active":"2024-03-25T05:37:38.222226+0000","last_peered":"2024-03-25T05:37:38.222226+0000","last_clean":"2024-03-25T05:37:38.222226+0000","last_became_active":"2024-03-25T05:37:31.163899+0000","last_became_peered":"2024-03-25T05:37:31.163899+0000","last_unstale":"2024-03-25T05:37:38.222226+0000","last_undegraded":"2024-03-25T05:37:38.222226+0000","last_fullsized":"2024-03-25T05:37:38.222226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431583+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T05:37:37.431583+0000","last_peered":"2024-03-25T05:37:37.431583+0000","last_clean":"2024-03-25T05:37:37.431583+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T05:37:37.431583+0000","last_undegraded":"2024-03-25T05:37:37.431583+0000","last_fullsized":"2024-03-25T05:37:37.431583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431836+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T05:37:37.431836+0000","last_peered":"2024-03-25T05:37:37.431836+0000","last_clean":"2024-03-25T05:37:37.431836+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T05:37:37.431836+0000","last_undegraded":"2024-03-25T05:37:37.431836+0000","last_fullsized":"2024-03-25T05:37:37.431836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432936+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T05:37:37.432936+0000","last_peered":"2024-03-25T05:37:37.432936+0000","last_clean":"2024-03-25T05:37:37.432936+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T05:37:37.432936+0000","last_undegraded":"2024-03-25T05:37:37.432936+0000","last_fullsized":"2024-03-25T05:37:37.432936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222050+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T05:37:38.222050+0000","last_peered":"2024-03-25T05:37:38.222050+0000","last_clean":"2024-03-25T05:37:38.222050+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T05:37:38.222050+0000","last_undegraded":"2024-03-25T05:37:38.222050+0000","last_fullsized":"2024-03-25T05:37:38.222050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431467+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T05:37:37.431467+0000","last_peered":"2024-03-25T05:37:37.431467+0000","last_clean":"2024-03-25T05:37:37.431467+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T05:37:37.431467+0000","last_undegraded":"2024-03-25T05:37:37.431467+0000","last_fullsized":"2024-03-25T05:37:37.431467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431111+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T05:37:37.431111+0000","last_peered":"2024-03-25T05:37:37.431111+0000","last_clean":"2024-03-25T05:37:37.431111+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T05:37:37.431111+0000","last_undegraded":"2024-03-25T05:37:37.431111+0000","last_fullsized":"2024-03-25T05:37:37.431111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.544795+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T05:37:54.544795+0000","last_peered":"2024-03-25T05:37:54.544795+0000","last_clean":"2024-03-25T05:37:54.544795+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T05:37:54.544795+0000","last_undegraded":"2024-03-25T05:37:54.544795+0000","last_fullsized":"2024-03-25T05:37:54.544795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435112+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T05:37:37.435112+0000","last_peered":"2024-03-25T05:37:37.435112+0000","last_clean":"2024-03-25T05:37:37.435112+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T05:37:37.435112+0000","last_undegraded":"2024-03-25T05:37:37.435112+0000","last_fullsized":"2024-03-25T05:37:37.435112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.584741+0000","last_change":"2024-03-25T05:37:31.148439+0000","last_active":"2024-03-25T05:37:38.584741+0000","last_peered":"2024-03-25T05:37:38.584741+0000","last_clean":"2024-03-25T05:37:38.584741+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T05:37:38.584741+0000","last_undegraded":"2024-03-25T05:37:38.584741+0000","last_fullsized":"2024-03-25T05:37:38.584741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:53:17.257529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.532053+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T05:37:54.532053+0000","last_peered":"2024-03-25T05:37:54.532053+0000","last_clean":"2024-03-25T05:37:54.532053+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T05:37:54.532053+0000","last_undegraded":"2024-03-25T05:37:54.532053+0000","last_fullsized":"2024-03-25T05:37:54.532053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585707+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T05:37:38.585707+0000","last_peered":"2024-03-25T05:37:38.585707+0000","last_clean":"2024-03-25T05:37:38.585707+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T05:37:38.585707+0000","last_undegraded":"2024-03-25T05:37:38.585707+0000","last_fullsized":"2024-03-25T05:37:38.585707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433259+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T05:37:37.433259+0000","last_peered":"2024-03-25T05:37:37.433259+0000","last_clean":"2024-03-25T05:37:37.433259+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T05:37:37.433259+0000","last_undegraded":"2024-03-25T05:37:37.433259+0000","last_fullsized":"2024-03-25T05:37:37.433259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.524592+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T05:37:53.524592+0000","last_peered":"2024-03-25T05:37:53.524592+0000","last_clean":"2024-03-25T05:37:53.524592+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T05:37:53.524592+0000","last_undegraded":"2024-03-25T05:37:53.524592+0000","last_fullsized":"2024-03-25T05:37:53.524592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309433+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T05:37:38.309433+0000","last_peered":"2024-03-25T05:37:38.309433+0000","last_clean":"2024-03-25T05:37:38.309433+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T05:37:38.309433+0000","last_undegraded":"2024-03-25T05:37:38.309433+0000","last_fullsized":"2024-03-25T05:37:38.309433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309757+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T05:37:38.309757+0000","last_peered":"2024-03-25T05:37:38.309757+0000","last_clean":"2024-03-25T05:37:38.309757+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T05:37:38.309757+0000","last_undegraded":"2024-03-25T05:37:38.309757+0000","last_fullsized":"2024-03-25T05:37:38.309757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.536623+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T05:37:54.536623+0000","last_peered":"2024-03-25T05:37:54.536623+0000","last_clean":"2024-03-25T05:37:54.536623+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T05:37:54.536623+0000","last_undegraded":"2024-03-25T05:37:54.536623+0000","last_fullsized":"2024-03-25T05:37:54.536623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805783+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T05:37:38.805783+0000","last_peered":"2024-03-25T05:37:38.805783+0000","last_clean":"2024-03-25T05:37:38.805783+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T05:37:38.805783+0000","last_undegraded":"2024-03-25T05:37:38.805783+0000","last_fullsized":"2024-03-25T05:37:38.805783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222175+0000","last_change":"2024-03-25T05:37:31.167109+0000","last_active":"2024-03-25T05:37:38.222175+0000","last_peered":"2024-03-25T05:37:38.222175+0000","last_clean":"2024-03-25T05:37:38.222175+0000","last_became_active":"2024-03-25T05:37:31.166757+0000","last_became_peered":"2024-03-25T05:37:31.166757+0000","last_unstale":"2024-03-25T05:37:38.222175+0000","last_undegraded":"2024-03-25T05:37:38.222175+0000","last_fullsized":"2024-03-25T05:37:38.222175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432741+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T05:37:37.432741+0000","last_peered":"2024-03-25T05:37:37.432741+0000","last_clean":"2024-03-25T05:37:37.432741+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T05:37:37.432741+0000","last_undegraded":"2024-03-25T05:37:37.432741+0000","last_fullsized":"2024-03-25T05:37:37.432741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585200+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T05:37:38.585200+0000","last_peered":"2024-03-25T05:37:38.585200+0000","last_clean":"2024-03-25T05:37:38.585200+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T05:37:38.585200+0000","last_undegraded":"2024-03-25T05:37:38.585200+0000","last_fullsized":"2024-03-25T05:37:38.585200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310218+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T05:37:38.310218+0000","last_peered":"2024-03-25T05:37:38.310218+0000","last_clean":"2024-03-25T05:37:38.310218+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T05:37:38.310218+0000","last_undegraded":"2024-03-25T05:37:38.310218+0000","last_fullsized":"2024-03-25T05:37:38.310218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.575736+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T05:37:38.575736+0000","last_peered":"2024-03-25T05:37:38.575736+0000","last_clean":"2024-03-25T05:37:38.575736+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T05:37:38.575736+0000","last_undegraded":"2024-03-25T05:37:38.575736+0000","last_fullsized":"2024-03-25T05:37:38.575736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221545+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T05:37:38.221545+0000","last_peered":"2024-03-25T05:37:38.221545+0000","last_clean":"2024-03-25T05:37:38.221545+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T05:37:38.221545+0000","last_undegraded":"2024-03-25T05:37:38.221545+0000","last_fullsized":"2024-03-25T05:37:38.221545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309922+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T05:37:38.309922+0000","last_peered":"2024-03-25T05:37:38.309922+0000","last_clean":"2024-03-25T05:37:38.309922+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T05:37:38.309922+0000","last_undegraded":"2024-03-25T05:37:38.309922+0000","last_fullsized":"2024-03-25T05:37:38.309922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433022+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T05:37:37.433022+0000","last_peered":"2024-03-25T05:37:37.433022+0000","last_clean":"2024-03-25T05:37:37.433022+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T05:37:37.433022+0000","last_undegraded":"2024-03-25T05:37:37.433022+0000","last_fullsized":"2024-03-25T05:37:37.433022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432138+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T05:37:37.432138+0000","last_peered":"2024-03-25T05:37:37.432138+0000","last_clean":"2024-03-25T05:37:37.432138+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T05:37:37.432138+0000","last_undegraded":"2024-03-25T05:37:37.432138+0000","last_fullsized":"2024-03-25T05:37:37.432138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309589+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T05:37:38.309589+0000","last_peered":"2024-03-25T05:37:38.309589+0000","last_clean":"2024-03-25T05:37:38.309589+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T05:37:38.309589+0000","last_undegraded":"2024-03-25T05:37:38.309589+0000","last_fullsized":"2024-03-25T05:37:38.309589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.547582+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T05:37:54.547582+0000","last_peered":"2024-03-25T05:37:54.547582+0000","last_clean":"2024-03-25T05:37:54.547582+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T05:37:54.547582+0000","last_undegraded":"2024-03-25T05:37:54.547582+0000","last_fullsized":"2024-03-25T05:37:54.547582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585552+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T05:37:38.585552+0000","last_peered":"2024-03-25T05:37:38.585552+0000","last_clean":"2024-03-25T05:37:38.585552+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T05:37:38.585552+0000","last_undegraded":"2024-03-25T05:37:38.585552+0000","last_fullsized":"2024-03-25T05:37:38.585552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805642+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T05:37:38.805642+0000","last_peered":"2024-03-25T05:37:38.805642+0000","last_clean":"2024-03-25T05:37:38.805642+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T05:37:38.805642+0000","last_undegraded":"2024-03-25T05:37:38.805642+0000","last_fullsized":"2024-03-25T05:37:38.805642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.532342+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T05:37:54.532342+0000","last_peered":"2024-03-25T05:37:54.532342+0000","last_clean":"2024-03-25T05:37:54.532342+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T05:37:54.532342+0000","last_undegraded":"2024-03-25T05:37:54.532342+0000","last_fullsized":"2024-03-25T05:37:54.532342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433845+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T05:37:37.433845+0000","last_peered":"2024-03-25T05:37:37.433845+0000","last_clean":"2024-03-25T05:37:37.433845+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T05:37:37.433845+0000","last_undegraded":"2024-03-25T05:37:37.433845+0000","last_fullsized":"2024-03-25T05:37:37.433845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:50.989171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309666+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T05:37:38.309666+0000","last_peered":"2024-03-25T05:37:38.309666+0000","last_clean":"2024-03-25T05:37:38.309666+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T05:37:38.309666+0000","last_undegraded":"2024-03-25T05:37:38.309666+0000","last_fullsized":"2024-03-25T05:37:38.309666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.523331+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T05:37:53.523331+0000","last_peered":"2024-03-25T05:37:53.523331+0000","last_clean":"2024-03-25T05:37:53.523331+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T05:37:53.523331+0000","last_undegraded":"2024-03-25T05:37:53.523331+0000","last_fullsized":"2024-03-25T05:37:53.523331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433594+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T05:37:37.433594+0000","last_peered":"2024-03-25T05:37:37.433594+0000","last_clean":"2024-03-25T05:37:37.433594+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T05:37:37.433594+0000","last_undegraded":"2024-03-25T05:37:37.433594+0000","last_fullsized":"2024-03-25T05:37:37.433594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:14:50.068275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585076+0000","last_change":"2024-03-25T05:37:31.149941+0000","last_active":"2024-03-25T05:37:38.585076+0000","last_peered":"2024-03-25T05:37:38.585076+0000","last_clean":"2024-03-25T05:37:38.585076+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T05:37:38.585076+0000","last_undegraded":"2024-03-25T05:37:38.585076+0000","last_fullsized":"2024-03-25T05:37:38.585076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:24:40.019842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.538391+0000","last_change":"2024-03-25T05:37:30.419153+0000","last_active":"2024-03-25T05:37:54.538391+0000","last_peered":"2024-03-25T05:37:54.538391+0000","last_clean":"2024-03-25T05:37:54.538391+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T05:37:54.538391+0000","last_undegraded":"2024-03-25T05:37:54.538391+0000","last_fullsized":"2024-03-25T05:37:54.538391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:16:01.889443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222103+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T05:37:38.222103+0000","last_peered":"2024-03-25T05:37:38.222103+0000","last_clean":"2024-03-25T05:37:38.222103+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T05:37:38.222103+0000","last_undegraded":"2024-03-25T05:37:38.222103+0000","last_fullsized":"2024-03-25T05:37:38.222103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309669+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T05:37:38.309669+0000","last_peered":"2024-03-25T05:37:38.309669+0000","last_clean":"2024-03-25T05:37:38.309669+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T05:37:38.309669+0000","last_undegraded":"2024-03-25T05:37:38.309669+0000","last_fullsized":"2024-03-25T05:37:38.309669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'12","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522996+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T05:37:53.522996+0000","last_peered":"2024-03-25T05:37:53.522996+0000","last_clean":"2024-03-25T05:37:53.522996+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T05:37:53.522996+0000","last_undegraded":"2024-03-25T05:37:53.522996+0000","last_fullsized":"2024-03-25T05:37:53.522996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432193+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T05:37:37.432193+0000","last_peered":"2024-03-25T05:37:37.432193+0000","last_clean":"2024-03-25T05:37:37.432193+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T05:37:37.432193+0000","last_undegraded":"2024-03-25T05:37:37.432193+0000","last_fullsized":"2024-03-25T05:37:37.432193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432777+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T05:37:37.432777+0000","last_peered":"2024-03-25T05:37:37.432777+0000","last_clean":"2024-03-25T05:37:37.432777+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T05:37:37.432777+0000","last_undegraded":"2024-03-25T05:37:37.432777+0000","last_fullsized":"2024-03-25T05:37:37.432777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432692+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T05:37:37.432692+0000","last_peered":"2024-03-25T05:37:37.432692+0000","last_clean":"2024-03-25T05:37:37.432692+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T05:37:37.432692+0000","last_undegraded":"2024-03-25T05:37:37.432692+0000","last_fullsized":"2024-03-25T05:37:37.432692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432399+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T05:37:37.432399+0000","last_peered":"2024-03-25T05:37:37.432399+0000","last_clean":"2024-03-25T05:37:37.432399+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T05:37:37.432399+0000","last_undegraded":"2024-03-25T05:37:37.432399+0000","last_fullsized":"2024-03-25T05:37:37.432399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586024+0000","last_change":"2024-03-25T05:37:31.156173+0000","last_active":"2024-03-25T05:37:38.586024+0000","last_peered":"2024-03-25T05:37:38.586024+0000","last_clean":"2024-03-25T05:37:38.586024+0000","last_became_active":"2024-03-25T05:37:31.155640+0000","last_became_peered":"2024-03-25T05:37:31.155640+0000","last_unstale":"2024-03-25T05:37:38.586024+0000","last_undegraded":"2024-03-25T05:37:38.586024+0000","last_fullsized":"2024-03-25T05:37:38.586024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522880+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T05:37:53.522880+0000","last_peered":"2024-03-25T05:37:53.522880+0000","last_clean":"2024-03-25T05:37:53.522880+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T05:37:53.522880+0000","last_undegraded":"2024-03-25T05:37:53.522880+0000","last_fullsized":"2024-03-25T05:37:53.522880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431609+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T05:37:37.431609+0000","last_peered":"2024-03-25T05:37:37.431609+0000","last_clean":"2024-03-25T05:37:37.431609+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T05:37:37.431609+0000","last_undegraded":"2024-03-25T05:37:37.431609+0000","last_fullsized":"2024-03-25T05:37:37.431609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:27:40.435483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221996+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T05:37:38.221996+0000","last_peered":"2024-03-25T05:37:38.221996+0000","last_clean":"2024-03-25T05:37:38.221996+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T05:37:38.221996+0000","last_undegraded":"2024-03-25T05:37:38.221996+0000","last_fullsized":"2024-03-25T05:37:38.221996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522619+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T05:37:53.522619+0000","last_peered":"2024-03-25T05:37:53.522619+0000","last_clean":"2024-03-25T05:37:53.522619+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T05:37:53.522619+0000","last_undegraded":"2024-03-25T05:37:53.522619+0000","last_fullsized":"2024-03-25T05:37:53.522619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431779+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T05:37:37.431779+0000","last_peered":"2024-03-25T05:37:37.431779+0000","last_clean":"2024-03-25T05:37:37.431779+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T05:37:37.431779+0000","last_undegraded":"2024-03-25T05:37:37.431779+0000","last_fullsized":"2024-03-25T05:37:37.431779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:25:03.802329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586404+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T05:37:38.586404+0000","last_peered":"2024-03-25T05:37:38.586404+0000","last_clean":"2024-03-25T05:37:38.586404+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T05:37:38.586404+0000","last_undegraded":"2024-03-25T05:37:38.586404+0000","last_fullsized":"2024-03-25T05:37:38.586404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431019+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T05:37:37.431019+0000","last_peered":"2024-03-25T05:37:37.431019+0000","last_clean":"2024-03-25T05:37:37.431019+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T05:37:37.431019+0000","last_undegraded":"2024-03-25T05:37:37.431019+0000","last_fullsized":"2024-03-25T05:37:37.431019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221746+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T05:37:38.221746+0000","last_peered":"2024-03-25T05:37:38.221746+0000","last_clean":"2024-03-25T05:37:38.221746+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T05:37:38.221746+0000","last_undegraded":"2024-03-25T05:37:38.221746+0000","last_fullsized":"2024-03-25T05:37:38.221746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806142+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T05:37:38.806142+0000","last_peered":"2024-03-25T05:37:38.806142+0000","last_clean":"2024-03-25T05:37:38.806142+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T05:37:38.806142+0000","last_undegraded":"2024-03-25T05:37:38.806142+0000","last_fullsized":"2024-03-25T05:37:38.806142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431606+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T05:37:37.431606+0000","last_peered":"2024-03-25T05:37:37.431606+0000","last_clean":"2024-03-25T05:37:37.431606+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T05:37:37.431606+0000","last_undegraded":"2024-03-25T05:37:37.431606+0000","last_fullsized":"2024-03-25T05:37:37.431606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.543897+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T05:37:54.543897+0000","last_peered":"2024-03-25T05:37:54.543897+0000","last_clean":"2024-03-25T05:37:54.543897+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T05:37:54.543897+0000","last_undegraded":"2024-03-25T05:37:54.543897+0000","last_fullsized":"2024-03-25T05:37:54.543897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.531393+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T05:37:54.531393+0000","last_peered":"2024-03-25T05:37:54.531393+0000","last_clean":"2024-03-25T05:37:54.531393+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T05:37:54.531393+0000","last_undegraded":"2024-03-25T05:37:54.531393+0000","last_fullsized":"2024-03-25T05:37:54.531393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585400+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T05:37:38.585400+0000","last_peered":"2024-03-25T05:37:38.585400+0000","last_clean":"2024-03-25T05:37:38.585400+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T05:37:38.585400+0000","last_undegraded":"2024-03-25T05:37:38.585400+0000","last_fullsized":"2024-03-25T05:37:38.585400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:24.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.529480+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T05:37:53.529480+0000","last_peered":"2024-03-25T05:37:53.529480+0000","last_clean":"2024-03-25T05:37:53.529480+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T05:37:53.529480+0000","last_undegraded":"2024-03-25T05:37:53.529480+0000","last_fullsized":"2024-03-25T05:37:53.529480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432552+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T05:37:37.432552+0000","last_peered":"2024-03-25T05:37:37.432552+0000","last_clean":"2024-03-25T05:37:37.432552+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T05:37:37.432552+0000","last_undegraded":"2024-03-25T05:37:37.432552+0000","last_fullsized":"2024-03-25T05:37:37.432552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433789+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T05:37:37.433789+0000","last_peered":"2024-03-25T05:37:37.433789+0000","last_clean":"2024-03-25T05:37:37.433789+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T05:37:37.433789+0000","last_undegraded":"2024-03-25T05:37:37.433789+0000","last_fullsized":"2024-03-25T05:37:37.433789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:08:02.386273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805476+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T05:37:38.805476+0000","last_peered":"2024-03-25T05:37:38.805476+0000","last_clean":"2024-03-25T05:37:38.805476+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T05:37:38.805476+0000","last_undegraded":"2024-03-25T05:37:38.805476+0000","last_fullsized":"2024-03-25T05:37:38.805476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:31.170943+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:31.170199+0000","last_became_peered":"2024-03-25T05:37:31.170199+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221825+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T05:37:38.221825+0000","last_peered":"2024-03-25T05:37:38.221825+0000","last_clean":"2024-03-25T05:37:38.221825+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T05:37:38.221825+0000","last_undegraded":"2024-03-25T05:37:38.221825+0000","last_fullsized":"2024-03-25T05:37:38.221825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585300+0000","last_change":"2024-03-25T05:37:31.164026+0000","last_active":"2024-03-25T05:37:38.585300+0000","last_peered":"2024-03-25T05:37:38.585300+0000","last_clean":"2024-03-25T05:37:38.585300+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T05:37:38.585300+0000","last_undegraded":"2024-03-25T05:37:38.585300+0000","last_fullsized":"2024-03-25T05:37:38.585300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433660+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T05:37:37.433660+0000","last_peered":"2024-03-25T05:37:37.433660+0000","last_clean":"2024-03-25T05:37:37.433660+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T05:37:37.433660+0000","last_undegraded":"2024-03-25T05:37:37.433660+0000","last_fullsized":"2024-03-25T05:37:37.433660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432470+0000","last_change":"2024-03-25T05:37:31.166178+0000","last_active":"2024-03-25T05:37:37.432470+0000","last_peered":"2024-03-25T05:37:37.432470+0000","last_clean":"2024-03-25T05:37:37.432470+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T05:37:37.432470+0000","last_undegraded":"2024-03-25T05:37:37.432470+0000","last_fullsized":"2024-03-25T05:37:37.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806144+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T05:37:38.806144+0000","last_peered":"2024-03-25T05:37:38.806144+0000","last_clean":"2024-03-25T05:37:38.806144+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T05:37:38.806144+0000","last_undegraded":"2024-03-25T05:37:38.806144+0000","last_fullsized":"2024-03-25T05:37:38.806144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433913+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T05:37:37.433913+0000","last_peered":"2024-03-25T05:37:37.433913+0000","last_clean":"2024-03-25T05:37:37.433913+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T05:37:37.433913+0000","last_undegraded":"2024-03-25T05:37:37.433913+0000","last_fullsized":"2024-03-25T05:37:37.433913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221686+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T05:37:38.221686+0000","last_peered":"2024-03-25T05:37:38.221686+0000","last_clean":"2024-03-25T05:37:38.221686+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T05:37:38.221686+0000","last_undegraded":"2024-03-25T05:37:38.221686+0000","last_fullsized":"2024-03-25T05:37:38.221686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431855+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T05:37:37.431855+0000","last_peered":"2024-03-25T05:37:37.431855+0000","last_clean":"2024-03-25T05:37:37.431855+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T05:37:37.431855+0000","last_undegraded":"2024-03-25T05:37:37.431855+0000","last_fullsized":"2024-03-25T05:37:37.431855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221685+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T05:37:38.221685+0000","last_peered":"2024-03-25T05:37:38.221685+0000","last_clean":"2024-03-25T05:37:38.221685+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T05:37:38.221685+0000","last_undegraded":"2024-03-25T05:37:38.221685+0000","last_fullsized":"2024-03-25T05:37:38.221685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585021+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T05:37:38.585021+0000","last_peered":"2024-03-25T05:37:38.585021+0000","last_clean":"2024-03-25T05:37:38.585021+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T05:37:38.585021+0000","last_undegraded":"2024-03-25T05:37:38.585021+0000","last_fullsized":"2024-03-25T05:37:38.585021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310003+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T05:37:38.310003+0000","last_peered":"2024-03-25T05:37:38.310003+0000","last_clean":"2024-03-25T05:37:38.310003+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T05:37:38.310003+0000","last_undegraded":"2024-03-25T05:37:38.310003+0000","last_fullsized":"2024-03-25T05:37:38.310003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576738+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T05:37:38.576738+0000","last_peered":"2024-03-25T05:37:38.576738+0000","last_clean":"2024-03-25T05:37:38.576738+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T05:37:38.576738+0000","last_undegraded":"2024-03-25T05:37:38.576738+0000","last_fullsized":"2024-03-25T05:37:38.576738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222245+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T05:37:38.222245+0000","last_peered":"2024-03-25T05:37:38.222245+0000","last_clean":"2024-03-25T05:37:38.222245+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T05:37:38.222245+0000","last_undegraded":"2024-03-25T05:37:38.222245+0000","last_fullsized":"2024-03-25T05:37:38.222245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221566+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T05:37:38.221566+0000","last_peered":"2024-03-25T05:37:38.221566+0000","last_clean":"2024-03-25T05:37:38.221566+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T05:37:38.221566+0000","last_undegraded":"2024-03-25T05:37:38.221566+0000","last_fullsized":"2024-03-25T05:37:38.221566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431208+0000","last_change":"2024-03-25T05:37:31.160433+0000","last_active":"2024-03-25T05:37:37.431208+0000","last_peered":"2024-03-25T05:37:37.431208+0000","last_clean":"2024-03-25T05:37:37.431208+0000","last_became_active":"2024-03-25T05:37:31.159183+0000","last_became_peered":"2024-03-25T05:37:31.159183+0000","last_unstale":"2024-03-25T05:37:37.431208+0000","last_undegraded":"2024-03-25T05:37:37.431208+0000","last_fullsized":"2024-03-25T05:37:37.431208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585101+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T05:37:38.585101+0000","last_peered":"2024-03-25T05:37:38.585101+0000","last_clean":"2024-03-25T05:37:38.585101+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T05:37:38.585101+0000","last_undegraded":"2024-03-25T05:37:38.585101+0000","last_fullsized":"2024-03-25T05:37:38.585101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:20.495852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433449+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T05:37:37.433449+0000","last_peered":"2024-03-25T05:37:37.433449+0000","last_clean":"2024-03-25T05:37:37.433449+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T05:37:37.433449+0000","last_undegraded":"2024-03-25T05:37:37.433449+0000","last_fullsized":"2024-03-25T05:37:37.433449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432681+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T05:37:37.432681+0000","last_peered":"2024-03-25T05:37:37.432681+0000","last_clean":"2024-03-25T05:37:37.432681+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T05:37:37.432681+0000","last_undegraded":"2024-03-25T05:37:37.432681+0000","last_fullsized":"2024-03-25T05:37:37.432681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806103+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T05:37:38.806103+0000","last_peered":"2024-03-25T05:37:38.806103+0000","last_clean":"2024-03-25T05:37:38.806103+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T05:37:38.806103+0000","last_undegraded":"2024-03-25T05:37:38.806103+0000","last_fullsized":"2024-03-25T05:37:38.806103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310166+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T05:37:38.310166+0000","last_peered":"2024-03-25T05:37:38.310166+0000","last_clean":"2024-03-25T05:37:38.310166+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T05:37:38.310166+0000","last_undegraded":"2024-03-25T05:37:38.310166+0000","last_fullsized":"2024-03-25T05:37:38.310166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431511+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T05:37:37.431511+0000","last_peered":"2024-03-25T05:37:37.431511+0000","last_clean":"2024-03-25T05:37:37.431511+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T05:37:37.431511+0000","last_undegraded":"2024-03-25T05:37:37.431511+0000","last_fullsized":"2024-03-25T05:37:37.431511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309508+0000","last_change":"2024-03-25T05:37:31.164888+0000","last_active":"2024-03-25T05:37:38.309508+0000","last_peered":"2024-03-25T05:37:38.309508+0000","last_clean":"2024-03-25T05:37:38.309508+0000","last_became_active":"2024-03-25T05:37:31.164658+0000","last_became_peered":"2024-03-25T05:37:31.164658+0000","last_unstale":"2024-03-25T05:37:38.309508+0000","last_undegraded":"2024-03-25T05:37:38.309508+0000","last_fullsized":"2024-03-25T05:37:38.309508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221663+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T05:37:38.221663+0000","last_peered":"2024-03-25T05:37:38.221663+0000","last_clean":"2024-03-25T05:37:38.221663+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T05:37:38.221663+0000","last_undegraded":"2024-03-25T05:37:38.221663+0000","last_fullsized":"2024-03-25T05:37:38.221663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309565+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T05:37:38.309565+0000","last_peered":"2024-03-25T05:37:38.309565+0000","last_clean":"2024-03-25T05:37:38.309565+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T05:37:38.309565+0000","last_undegraded":"2024-03-25T05:37:38.309565+0000","last_fullsized":"2024-03-25T05:37:38.309565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222105+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T05:37:38.222105+0000","last_peered":"2024-03-25T05:37:38.222105+0000","last_clean":"2024-03-25T05:37:38.222105+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T05:37:38.222105+0000","last_undegraded":"2024-03-25T05:37:38.222105+0000","last_fullsized":"2024-03-25T05:37:38.222105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585511+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T05:37:38.585511+0000","last_peered":"2024-03-25T05:37:38.585511+0000","last_clean":"2024-03-25T05:37:38.585511+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T05:37:38.585511+0000","last_undegraded":"2024-03-25T05:37:38.585511+0000","last_fullsized":"2024-03-25T05:37:38.585511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435035+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T05:37:37.435035+0000","last_peered":"2024-03-25T05:37:37.435035+0000","last_clean":"2024-03-25T05:37:37.435035+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T05:37:37.435035+0000","last_undegraded":"2024-03-25T05:37:37.435035+0000","last_fullsized":"2024-03-25T05:37:37.435035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310094+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T05:37:38.310094+0000","last_peered":"2024-03-25T05:37:38.310094+0000","last_clean":"2024-03-25T05:37:38.310094+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T05:37:38.310094+0000","last_undegraded":"2024-03-25T05:37:38.310094+0000","last_fullsized":"2024-03-25T05:37:38.310094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":699077,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":111325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":108337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":698421,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T05:37:56.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T05:37:57.023 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:37:57.030+0000 7f9ada000640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-25T05:37:57.023 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:37:57.030+0000 7f9ada000640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-03-25T05:37:57.023 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:37:57.030+0000 7f9ada000640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-03-25T05:37:57.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.099+0000 7fb046200640 1 Processor -- start 2024-03-25T05:37:57.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.099+0000 7fb046200640 1 -- start start 2024-03-25T05:37:57.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.100+0000 7fb046200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0400c67e0 0x7fb0400c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.100+0000 7fb046200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb0400c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.100+0000 7fb046200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0400cbbe0 con 0x7fb040154120 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.100+0000 7fb046200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb040154500 con 0x7fb0400c67e0 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.100+0000 7fb046200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04006b250 con 0x7fb0400c6c10 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb03fe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0400c67e0 0x7fb0400c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb045800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb0400c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb045800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb0400c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57928/0 (socket says 172.21.15.102:57928) 2024-03-25T05:37:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb045800640 1 -- 172.21.15.102:0/2955921342 learned_addr learned my addr 172.21.15.102:0/2955921342 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb045800640 1 -- 172.21.15.102:0/2955921342 >> v2:172.21.15.102:3300/0 conn(0x7fb0400c67e0 msgr2=0x7fb0400c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb045800640 1 --2- 172.21.15.102:0/2955921342 >> v2:172.21.15.102:3300/0 conn(0x7fb0400c67e0 0x7fb0400c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb045800640 1 -- 172.21.15.102:0/2955921342 >> v1:172.21.15.102:6789/0 conn(0x7fb040154120 legacy=0x7fb0400cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.101+0000 7fb045800640 1 -- 172.21.15.102:0/2955921342 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400ca280 con 0x7fb0400c6c10 2024-03-25T05:37:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.103+0000 7fb045800640 1 --2- 172.21.15.102:0/2955921342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb0400c8240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb03802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce2683134c3d217 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:57.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.103+0000 7fb03f400640 1 -- 172.21.15.102:0/2955921342 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03802cb00 con 0x7fb0400c6c10 2024-03-25T05:37:57.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.103+0000 7fb03f400640 1 -- 172.21.15.102:0/2955921342 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03802cc60 con 0x7fb0400c6c10 2024-03-25T05:37:57.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.103+0000 7fb03f400640 1 -- 172.21.15.102:0/2955921342 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0380343f0 con 0x7fb0400c6c10 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.103+0000 7fb046200640 1 -- 172.21.15.102:0/2955921342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 msgr2=0x7fb0400c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.103+0000 7fb046200640 1 --2- 172.21.15.102:0/2955921342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb0400c8240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb03802bf60 comp rx=0 tx=0).stop 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.104+0000 7fb046200640 1 -- 172.21.15.102:0/2955921342 shutdown_connections 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.104+0000 7fb046200640 1 --2- 172.21.15.102:0/2955921342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb0400c8240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.104+0000 7fb046200640 1 --2- 172.21.15.102:0/2955921342 >> v2:172.21.15.102:3300/0 conn(0x7fb0400c67e0 0x7fb0400c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.104+0000 7fb046200640 1 -- 172.21.15.102:0/2955921342 >> 172.21.15.102:0/2955921342 conn(0x7fb0400cf3e0 msgr2=0x7fb0400cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.104+0000 7fb046200640 1 -- 172.21.15.102:0/2955921342 shutdown_connections 2024-03-25T05:37:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.104+0000 7fb046200640 1 -- 172.21.15.102:0/2955921342 wait complete. 2024-03-25T05:37:57.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.106+0000 7fb046200640 1 Processor -- start 2024-03-25T05:37:57.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.106+0000 7fb046200640 1 -- start start 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb046200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0400c67e0 0x7fb0401f0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb046200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb040150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb046200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb040154120 0x7fb0401510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb046200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04015dce0 con 0x7fb0400c67e0 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb046200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401f07a0 con 0x7fb040154120 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb046200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04015cbe0 con 0x7fb0400c6c10 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb040150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb044e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0400c67e0 0x7fb0401f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb040150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57934/0 (socket says 172.21.15.102:57934) 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb03fe00640 1 -- 172.21.15.102:0/2982703494 learned_addr learned my addr 172.21.15.102:0/2982703494 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb045800640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb040154120 0x7fb0401510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb03fe00640 1 -- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb040154120 msgr2=0x7fb0401510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.107+0000 7fb03fe00640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb040154120 0x7fb0401510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb03fe00640 1 -- 172.21.15.102:0/2982703494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0400c67e0 msgr2=0x7fb0401f0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb03fe00640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0400c67e0 0x7fb0401f0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb03fe00640 1 -- 172.21.15.102:0/2982703494 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009b30 con 0x7fb0400c6c10 2024-03-25T05:37:57.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb03fe00640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb040150b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e9b0 tx=0x7fb02c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:57.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb03cc00640 1 -- 172.21.15.102:0/2982703494 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c009670 con 0x7fb0400c6c10 2024-03-25T05:37:57.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb03cc00640 1 -- 172.21.15.102:0/2982703494 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00c9a0 con 0x7fb0400c6c10 2024-03-25T05:37:57.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb03cc00640 1 -- 172.21.15.102:0/2982703494 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00cd30 con 0x7fb0400c6c10 2024-03-25T05:37:57.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04015ce80 con 0x7fb0400c6c10 2024-03-25T05:37:57.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.108+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04015d440 con 0x7fb0400c6c10 2024-03-25T05:37:57.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.109+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04004f2f0 con 0x7fb0400c6c10 2024-03-25T05:37:57.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.110+0000 7fb03cc00640 1 -- 172.21.15.102:0/2982703494 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb02c013470 con 0x7fb0400c6c10 2024-03-25T05:37:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.111+0000 7fb03cc00640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb02006b810 0x7fb02006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.111+0000 7fb03cc00640 1 -- 172.21.15.102:0/2982703494 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb02c08aa80 con 0x7fb0400c6c10 2024-03-25T05:37:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.111+0000 7fb044e00640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb02006b810 0x7fb02006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.112+0000 7fb044e00640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb02006b810 0x7fb02006dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0340016e0 tx=0x7fb034009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:57.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.116+0000 7fb03cc00640 1 -- 172.21.15.102:0/2982703494 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb02c055170 con 0x7fb0400c6c10 2024-03-25T05:37:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.302+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0400ca7b0 con 0x7fb02006b810 2024-03-25T05:37:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.311+0000 7fb03cc00640 1 -- 172.21.15.102:0/2982703494 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332787 (secure 0 0 0) 0x7fb034001cc0 con 0x7fb02006b810 2024-03-25T05:37:57.309 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T05:37:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb02006b810 msgr2=0x7fb02006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb02006b810 0x7fb02006dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0340016e0 tx=0x7fb034009040 comp rx=0 tx=0).stop 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 msgr2=0x7fb040150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb040150b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e9b0 tx=0x7fb02c00ee70 comp rx=0 tx=0).stop 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 shutdown_connections 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb02006b810 0x7fb02006dcd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb040154120 0x7fb0401510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0400c6c10 0x7fb040150b70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 --2- 172.21.15.102:0/2982703494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0400c67e0 0x7fb0401f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 >> 172.21.15.102:0/2982703494 conn(0x7fb0400cf3e0 msgr2=0x7fb04006bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 shutdown_connections 2024-03-25T05:37:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.316+0000 7fb046200640 1 -- 172.21.15.102:0/2982703494 wait complete. 2024-03-25T05:37:57.325 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-03-25T05:37:57.011491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218456,"kb_used_data":2328,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756264,"statfs":{"total":773094113280,"available":772870414336,"internally_reserved":0,"allocated":2383872,"data_stored":2052084,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2953,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003263"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.541577+0000","last_change":"2024-03-25T05:37:30.423912+0000","last_active":"2024-03-25T05:37:54.541577+0000","last_peered":"2024-03-25T05:37:54.541577+0000","last_clean":"2024-03-25T05:37:54.541577+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T05:37:54.541577+0000","last_undegraded":"2024-03-25T05:37:54.541577+0000","last_fullsized":"2024-03-25T05:37:54.541577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433740+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T05:37:37.433740+0000","last_peered":"2024-03-25T05:37:37.433740+0000","last_clean":"2024-03-25T05:37:37.433740+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T05:37:37.433740+0000","last_undegraded":"2024-03-25T05:37:37.433740+0000","last_fullsized":"2024-03-25T05:37:37.433740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431653+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T05:37:37.431653+0000","last_peered":"2024-03-25T05:37:37.431653+0000","last_clean":"2024-03-25T05:37:37.431653+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T05:37:37.431653+0000","last_undegraded":"2024-03-25T05:37:37.431653+0000","last_fullsized":"2024-03-25T05:37:37.431653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:43:49.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433909+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T05:37:37.433909+0000","last_peered":"2024-03-25T05:37:37.433909+0000","last_clean":"2024-03-25T05:37:37.433909+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T05:37:37.433909+0000","last_undegraded":"2024-03-25T05:37:37.433909+0000","last_fullsized":"2024-03-25T05:37:37.433909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585751+0000","last_change":"2024-03-25T05:37:31.155929+0000","last_active":"2024-03-25T05:37:38.585751+0000","last_peered":"2024-03-25T05:37:38.585751+0000","last_clean":"2024-03-25T05:37:38.585751+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T05:37:38.585751+0000","last_undegraded":"2024-03-25T05:37:38.585751+0000","last_fullsized":"2024-03-25T05:37:38.585751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432218+0000","last_change":"2024-03-25T05:37:35.459531+0000","last_active":"2024-03-25T05:37:37.432218+0000","last_peered":"2024-03-25T05:37:37.432218+0000","last_clean":"2024-03-25T05:37:37.432218+0000","last_became_active":"2024-03-25T05:37:35.459127+0000","last_became_peered":"2024-03-25T05:37:35.459127+0000","last_unstale":"2024-03-25T05:37:37.432218+0000","last_undegraded":"2024-03-25T05:37:37.432218+0000","last_fullsized":"2024-03-25T05:37:37.432218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.530924+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T05:37:54.530924+0000","last_peered":"2024-03-25T05:37:54.530924+0000","last_clean":"2024-03-25T05:37:54.530924+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T05:37:54.530924+0000","last_undegraded":"2024-03-25T05:37:54.530924+0000","last_fullsized":"2024-03-25T05:37:54.530924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221959+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T05:37:38.221959+0000","last_peered":"2024-03-25T05:37:38.221959+0000","last_clean":"2024-03-25T05:37:38.221959+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T05:37:38.221959+0000","last_undegraded":"2024-03-25T05:37:38.221959+0000","last_fullsized":"2024-03-25T05:37:38.221959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432708+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T05:37:37.432708+0000","last_peered":"2024-03-25T05:37:37.432708+0000","last_clean":"2024-03-25T05:37:37.432708+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T05:37:37.432708+0000","last_undegraded":"2024-03-25T05:37:37.432708+0000","last_fullsized":"2024-03-25T05:37:37.432708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309619+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T05:37:38.309619+0000","last_peered":"2024-03-25T05:37:38.309619+0000","last_clean":"2024-03-25T05:37:38.309619+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T05:37:38.309619+0000","last_undegraded":"2024-03-25T05:37:38.309619+0000","last_fullsized":"2024-03-25T05:37:38.309619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222108+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T05:37:38.222108+0000","last_peered":"2024-03-25T05:37:38.222108+0000","last_clean":"2024-03-25T05:37:38.222108+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T05:37:38.222108+0000","last_undegraded":"2024-03-25T05:37:38.222108+0000","last_fullsized":"2024-03-25T05:37:38.222108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432306+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T05:37:37.432306+0000","last_peered":"2024-03-25T05:37:37.432306+0000","last_clean":"2024-03-25T05:37:37.432306+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T05:37:37.432306+0000","last_undegraded":"2024-03-25T05:37:37.432306+0000","last_fullsized":"2024-03-25T05:37:37.432306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805582+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T05:37:38.805582+0000","last_peered":"2024-03-25T05:37:38.805582+0000","last_clean":"2024-03-25T05:37:38.805582+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T05:37:38.805582+0000","last_undegraded":"2024-03-25T05:37:38.805582+0000","last_fullsized":"2024-03-25T05:37:38.805582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.520789+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T05:37:53.520789+0000","last_peered":"2024-03-25T05:37:53.520789+0000","last_clean":"2024-03-25T05:37:53.520789+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T05:37:53.520789+0000","last_undegraded":"2024-03-25T05:37:53.520789+0000","last_fullsized":"2024-03-25T05:37:53.520789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432841+0000","last_change":"2024-03-25T05:37:35.462815+0000","last_active":"2024-03-25T05:37:37.432841+0000","last_peered":"2024-03-25T05:37:37.432841+0000","last_clean":"2024-03-25T05:37:37.432841+0000","last_became_active":"2024-03-25T05:37:35.462293+0000","last_became_peered":"2024-03-25T05:37:35.462293+0000","last_unstale":"2024-03-25T05:37:37.432841+0000","last_undegraded":"2024-03-25T05:37:37.432841+0000","last_fullsized":"2024-03-25T05:37:37.432841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433456+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T05:37:37.433456+0000","last_peered":"2024-03-25T05:37:37.433456+0000","last_clean":"2024-03-25T05:37:37.433456+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T05:37:37.433456+0000","last_undegraded":"2024-03-25T05:37:37.433456+0000","last_fullsized":"2024-03-25T05:37:37.433456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432431+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T05:37:37.432431+0000","last_peered":"2024-03-25T05:37:37.432431+0000","last_clean":"2024-03-25T05:37:37.432431+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T05:37:37.432431+0000","last_undegraded":"2024-03-25T05:37:37.432431+0000","last_fullsized":"2024-03-25T05:37:37.432431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433020+0000","last_change":"2024-03-25T05:37:35.463326+0000","last_active":"2024-03-25T05:37:37.433020+0000","last_peered":"2024-03-25T05:37:37.433020+0000","last_clean":"2024-03-25T05:37:37.433020+0000","last_became_active":"2024-03-25T05:37:35.462618+0000","last_became_peered":"2024-03-25T05:37:35.462618+0000","last_unstale":"2024-03-25T05:37:37.433020+0000","last_undegraded":"2024-03-25T05:37:37.433020+0000","last_fullsized":"2024-03-25T05:37:37.433020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431690+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T05:37:37.431690+0000","last_peered":"2024-03-25T05:37:37.431690+0000","last_clean":"2024-03-25T05:37:37.431690+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T05:37:37.431690+0000","last_undegraded":"2024-03-25T05:37:37.431690+0000","last_fullsized":"2024-03-25T05:37:37.431690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.525052+0000","last_change":"2024-03-25T05:37:30.422594+0000","last_active":"2024-03-25T05:37:53.525052+0000","last_peered":"2024-03-25T05:37:53.525052+0000","last_clean":"2024-03-25T05:37:53.525052+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T05:37:53.525052+0000","last_undegraded":"2024-03-25T05:37:53.525052+0000","last_fullsized":"2024-03-25T05:37:53.525052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435022+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T05:37:37.435022+0000","last_peered":"2024-03-25T05:37:37.435022+0000","last_clean":"2024-03-25T05:37:37.435022+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T05:37:37.435022+0000","last_undegraded":"2024-03-25T05:37:37.435022+0000","last_fullsized":"2024-03-25T05:37:37.435022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432539+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T05:37:37.432539+0000","last_peered":"2024-03-25T05:37:37.432539+0000","last_clean":"2024-03-25T05:37:37.432539+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T05:37:37.432539+0000","last_undegraded":"2024-03-25T05:37:37.432539+0000","last_fullsized":"2024-03-25T05:37:37.432539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.526401+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T05:37:53.526401+0000","last_peered":"2024-03-25T05:37:53.526401+0000","last_clean":"2024-03-25T05:37:53.526401+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T05:37:53.526401+0000","last_undegraded":"2024-03-25T05:37:53.526401+0000","last_fullsized":"2024-03-25T05:37:53.526401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432590+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T05:37:37.432590+0000","last_peered":"2024-03-25T05:37:37.432590+0000","last_clean":"2024-03-25T05:37:37.432590+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T05:37:37.432590+0000","last_undegraded":"2024-03-25T05:37:37.432590+0000","last_fullsized":"2024-03-25T05:37:37.432590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585863+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T05:37:38.585863+0000","last_peered":"2024-03-25T05:37:38.585863+0000","last_clean":"2024-03-25T05:37:38.585863+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T05:37:38.585863+0000","last_undegraded":"2024-03-25T05:37:38.585863+0000","last_fullsized":"2024-03-25T05:37:38.585863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.521052+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T05:37:53.521052+0000","last_peered":"2024-03-25T05:37:53.521052+0000","last_clean":"2024-03-25T05:37:53.521052+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T05:37:53.521052+0000","last_undegraded":"2024-03-25T05:37:53.521052+0000","last_fullsized":"2024-03-25T05:37:53.521052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432209+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T05:37:37.432209+0000","last_peered":"2024-03-25T05:37:37.432209+0000","last_clean":"2024-03-25T05:37:37.432209+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T05:37:37.432209+0000","last_undegraded":"2024-03-25T05:37:37.432209+0000","last_fullsized":"2024-03-25T05:37:37.432209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433971+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T05:37:37.433971+0000","last_peered":"2024-03-25T05:37:37.433971+0000","last_clean":"2024-03-25T05:37:37.433971+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T05:37:37.433971+0000","last_undegraded":"2024-03-25T05:37:37.433971+0000","last_fullsized":"2024-03-25T05:37:37.433971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.533896+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T05:37:54.533896+0000","last_peered":"2024-03-25T05:37:54.533896+0000","last_clean":"2024-03-25T05:37:54.533896+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T05:37:54.533896+0000","last_undegraded":"2024-03-25T05:37:54.533896+0000","last_fullsized":"2024-03-25T05:37:54.533896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431411+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T05:37:37.431411+0000","last_peered":"2024-03-25T05:37:37.431411+0000","last_clean":"2024-03-25T05:37:37.431411+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T05:37:37.431411+0000","last_undegraded":"2024-03-25T05:37:37.431411+0000","last_fullsized":"2024-03-25T05:37:37.431411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:43:13.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431535+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T05:37:37.431535+0000","last_peered":"2024-03-25T05:37:37.431535+0000","last_clean":"2024-03-25T05:37:37.431535+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T05:37:37.431535+0000","last_undegraded":"2024-03-25T05:37:37.431535+0000","last_fullsized":"2024-03-25T05:37:37.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310081+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T05:37:38.310081+0000","last_peered":"2024-03-25T05:37:38.310081+0000","last_clean":"2024-03-25T05:37:38.310081+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T05:37:38.310081+0000","last_undegraded":"2024-03-25T05:37:38.310081+0000","last_fullsized":"2024-03-25T05:37:38.310081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585184+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T05:37:38.585184+0000","last_peered":"2024-03-25T05:37:38.585184+0000","last_clean":"2024-03-25T05:37:38.585184+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T05:37:38.585184+0000","last_undegraded":"2024-03-25T05:37:38.585184+0000","last_fullsized":"2024-03-25T05:37:38.585184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222226+0000","last_change":"2024-03-25T05:37:31.164193+0000","last_active":"2024-03-25T05:37:38.222226+0000","last_peered":"2024-03-25T05:37:38.222226+0000","last_clean":"2024-03-25T05:37:38.222226+0000","last_became_active":"2024-03-25T05:37:31.163899+0000","last_became_peered":"2024-03-25T05:37:31.163899+0000","last_unstale":"2024-03-25T05:37:38.222226+0000","last_undegraded":"2024-03-25T05:37:38.222226+0000","last_fullsized":"2024-03-25T05:37:38.222226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431583+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T05:37:37.431583+0000","last_peered":"2024-03-25T05:37:37.431583+0000","last_clean":"2024-03-25T05:37:37.431583+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T05:37:37.431583+0000","last_undegraded":"2024-03-25T05:37:37.431583+0000","last_fullsized":"2024-03-25T05:37:37.431583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431836+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T05:37:37.431836+0000","last_peered":"2024-03-25T05:37:37.431836+0000","last_clean":"2024-03-25T05:37:37.431836+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T05:37:37.431836+0000","last_undegraded":"2024-03-25T05:37:37.431836+0000","last_fullsized":"2024-03-25T05:37:37.431836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432936+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T05:37:37.432936+0000","last_peered":"2024-03-25T05:37:37.432936+0000","last_clean":"2024-03-25T05:37:37.432936+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T05:37:37.432936+0000","last_undegraded":"2024-03-25T05:37:37.432936+0000","last_fullsized":"2024-03-25T05:37:37.432936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222050+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T05:37:38.222050+0000","last_peered":"2024-03-25T05:37:38.222050+0000","last_clean":"2024-03-25T05:37:38.222050+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T05:37:38.222050+0000","last_undegraded":"2024-03-25T05:37:38.222050+0000","last_fullsized":"2024-03-25T05:37:38.222050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431467+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T05:37:37.431467+0000","last_peered":"2024-03-25T05:37:37.431467+0000","last_clean":"2024-03-25T05:37:37.431467+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T05:37:37.431467+0000","last_undegraded":"2024-03-25T05:37:37.431467+0000","last_fullsized":"2024-03-25T05:37:37.431467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431111+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T05:37:37.431111+0000","last_peered":"2024-03-25T05:37:37.431111+0000","last_clean":"2024-03-25T05:37:37.431111+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T05:37:37.431111+0000","last_undegraded":"2024-03-25T05:37:37.431111+0000","last_fullsized":"2024-03-25T05:37:37.431111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.544795+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T05:37:54.544795+0000","last_peered":"2024-03-25T05:37:54.544795+0000","last_clean":"2024-03-25T05:37:54.544795+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T05:37:54.544795+0000","last_undegraded":"2024-03-25T05:37:54.544795+0000","last_fullsized":"2024-03-25T05:37:54.544795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435112+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T05:37:37.435112+0000","last_peered":"2024-03-25T05:37:37.435112+0000","last_clean":"2024-03-25T05:37:37.435112+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T05:37:37.435112+0000","last_undegraded":"2024-03-25T05:37:37.435112+0000","last_fullsized":"2024-03-25T05:37:37.435112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.584741+0000","last_change":"2024-03-25T05:37:31.148439+0000","last_active":"2024-03-25T05:37:38.584741+0000","last_peered":"2024-03-25T05:37:38.584741+0000","last_clean":"2024-03-25T05:37:38.584741+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T05:37:38.584741+0000","last_undegraded":"2024-03-25T05:37:38.584741+0000","last_fullsized":"2024-03-25T05:37:38.584741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:53:17.257529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.532053+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T05:37:54.532053+0000","last_peered":"2024-03-25T05:37:54.532053+0000","last_clean":"2024-03-25T05:37:54.532053+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T05:37:54.532053+0000","last_undegraded":"2024-03-25T05:37:54.532053+0000","last_fullsized":"2024-03-25T05:37:54.532053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585707+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T05:37:38.585707+0000","last_peered":"2024-03-25T05:37:38.585707+0000","last_clean":"2024-03-25T05:37:38.585707+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T05:37:38.585707+0000","last_undegraded":"2024-03-25T05:37:38.585707+0000","last_fullsized":"2024-03-25T05:37:38.585707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433259+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T05:37:37.433259+0000","last_peered":"2024-03-25T05:37:37.433259+0000","last_clean":"2024-03-25T05:37:37.433259+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T05:37:37.433259+0000","last_undegraded":"2024-03-25T05:37:37.433259+0000","last_fullsized":"2024-03-25T05:37:37.433259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.524592+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T05:37:53.524592+0000","last_peered":"2024-03-25T05:37:53.524592+0000","last_clean":"2024-03-25T05:37:53.524592+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T05:37:53.524592+0000","last_undegraded":"2024-03-25T05:37:53.524592+0000","last_fullsized":"2024-03-25T05:37:53.524592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309433+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T05:37:38.309433+0000","last_peered":"2024-03-25T05:37:38.309433+0000","last_clean":"2024-03-25T05:37:38.309433+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T05:37:38.309433+0000","last_undegraded":"2024-03-25T05:37:38.309433+0000","last_fullsized":"2024-03-25T05:37:38.309433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309757+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T05:37:38.309757+0000","last_peered":"2024-03-25T05:37:38.309757+0000","last_clean":"2024-03-25T05:37:38.309757+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T05:37:38.309757+0000","last_undegraded":"2024-03-25T05:37:38.309757+0000","last_fullsized":"2024-03-25T05:37:38.309757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.536623+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T05:37:54.536623+0000","last_peered":"2024-03-25T05:37:54.536623+0000","last_clean":"2024-03-25T05:37:54.536623+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T05:37:54.536623+0000","last_undegraded":"2024-03-25T05:37:54.536623+0000","last_fullsized":"2024-03-25T05:37:54.536623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805783+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T05:37:38.805783+0000","last_peered":"2024-03-25T05:37:38.805783+0000","last_clean":"2024-03-25T05:37:38.805783+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T05:37:38.805783+0000","last_undegraded":"2024-03-25T05:37:38.805783+0000","last_fullsized":"2024-03-25T05:37:38.805783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222175+0000","last_change":"2024-03-25T05:37:31.167109+0000","last_active":"2024-03-25T05:37:38.222175+0000","last_peered":"2024-03-25T05:37:38.222175+0000","last_clean":"2024-03-25T05:37:38.222175+0000","last_became_active":"2024-03-25T05:37:31.166757+0000","last_became_peered":"2024-03-25T05:37:31.166757+0000","last_unstale":"2024-03-25T05:37:38.222175+0000","last_undegraded":"2024-03-25T05:37:38.222175+0000","last_fullsized":"2024-03-25T05:37:38.222175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432741+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T05:37:37.432741+0000","last_peered":"2024-03-25T05:37:37.432741+0000","last_clean":"2024-03-25T05:37:37.432741+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T05:37:37.432741+0000","last_undegraded":"2024-03-25T05:37:37.432741+0000","last_fullsized":"2024-03-25T05:37:37.432741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585200+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T05:37:38.585200+0000","last_peered":"2024-03-25T05:37:38.585200+0000","last_clean":"2024-03-25T05:37:38.585200+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T05:37:38.585200+0000","last_undegraded":"2024-03-25T05:37:38.585200+0000","last_fullsized":"2024-03-25T05:37:38.585200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310218+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T05:37:38.310218+0000","last_peered":"2024-03-25T05:37:38.310218+0000","last_clean":"2024-03-25T05:37:38.310218+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T05:37:38.310218+0000","last_undegraded":"2024-03-25T05:37:38.310218+0000","last_fullsized":"2024-03-25T05:37:38.310218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.575736+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T05:37:38.575736+0000","last_peered":"2024-03-25T05:37:38.575736+0000","last_clean":"2024-03-25T05:37:38.575736+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T05:37:38.575736+0000","last_undegraded":"2024-03-25T05:37:38.575736+0000","last_fullsized":"2024-03-25T05:37:38.575736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221545+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T05:37:38.221545+0000","last_peered":"2024-03-25T05:37:38.221545+0000","last_clean":"2024-03-25T05:37:38.221545+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T05:37:38.221545+0000","last_undegraded":"2024-03-25T05:37:38.221545+0000","last_fullsized":"2024-03-25T05:37:38.221545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309922+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T05:37:38.309922+0000","last_peered":"2024-03-25T05:37:38.309922+0000","last_clean":"2024-03-25T05:37:38.309922+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T05:37:38.309922+0000","last_undegraded":"2024-03-25T05:37:38.309922+0000","last_fullsized":"2024-03-25T05:37:38.309922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433022+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T05:37:37.433022+0000","last_peered":"2024-03-25T05:37:37.433022+0000","last_clean":"2024-03-25T05:37:37.433022+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T05:37:37.433022+0000","last_undegraded":"2024-03-25T05:37:37.433022+0000","last_fullsized":"2024-03-25T05:37:37.433022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432138+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T05:37:37.432138+0000","last_peered":"2024-03-25T05:37:37.432138+0000","last_clean":"2024-03-25T05:37:37.432138+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T05:37:37.432138+0000","last_undegraded":"2024-03-25T05:37:37.432138+0000","last_fullsized":"2024-03-25T05:37:37.432138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309589+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T05:37:38.309589+0000","last_peered":"2024-03-25T05:37:38.309589+0000","last_clean":"2024-03-25T05:37:38.309589+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T05:37:38.309589+0000","last_undegraded":"2024-03-25T05:37:38.309589+0000","last_fullsized":"2024-03-25T05:37:38.309589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.547582+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T05:37:54.547582+0000","last_peered":"2024-03-25T05:37:54.547582+0000","last_clean":"2024-03-25T05:37:54.547582+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T05:37:54.547582+0000","last_undegraded":"2024-03-25T05:37:54.547582+0000","last_fullsized":"2024-03-25T05:37:54.547582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585552+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T05:37:38.585552+0000","last_peered":"2024-03-25T05:37:38.585552+0000","last_clean":"2024-03-25T05:37:38.585552+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T05:37:38.585552+0000","last_undegraded":"2024-03-25T05:37:38.585552+0000","last_fullsized":"2024-03-25T05:37:38.585552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805642+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T05:37:38.805642+0000","last_peered":"2024-03-25T05:37:38.805642+0000","last_clean":"2024-03-25T05:37:38.805642+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T05:37:38.805642+0000","last_undegraded":"2024-03-25T05:37:38.805642+0000","last_fullsized":"2024-03-25T05:37:38.805642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.532342+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T05:37:54.532342+0000","last_peered":"2024-03-25T05:37:54.532342+0000","last_clean":"2024-03-25T05:37:54.532342+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T05:37:54.532342+0000","last_undegraded":"2024-03-25T05:37:54.532342+0000","last_fullsized":"2024-03-25T05:37:54.532342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433845+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T05:37:37.433845+0000","last_peered":"2024-03-25T05:37:37.433845+0000","last_clean":"2024-03-25T05:37:37.433845+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T05:37:37.433845+0000","last_undegraded":"2024-03-25T05:37:37.433845+0000","last_fullsized":"2024-03-25T05:37:37.433845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:50.989171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309666+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T05:37:38.309666+0000","last_peered":"2024-03-25T05:37:38.309666+0000","last_clean":"2024-03-25T05:37:38.309666+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T05:37:38.309666+0000","last_undegraded":"2024-03-25T05:37:38.309666+0000","last_fullsized":"2024-03-25T05:37:38.309666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.523331+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T05:37:53.523331+0000","last_peered":"2024-03-25T05:37:53.523331+0000","last_clean":"2024-03-25T05:37:53.523331+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T05:37:53.523331+0000","last_undegraded":"2024-03-25T05:37:53.523331+0000","last_fullsized":"2024-03-25T05:37:53.523331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433594+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T05:37:37.433594+0000","last_peered":"2024-03-25T05:37:37.433594+0000","last_clean":"2024-03-25T05:37:37.433594+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T05:37:37.433594+0000","last_undegraded":"2024-03-25T05:37:37.433594+0000","last_fullsized":"2024-03-25T05:37:37.433594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:14:50.068275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585076+0000","last_change":"2024-03-25T05:37:31.149941+0000","last_active":"2024-03-25T05:37:38.585076+0000","last_peered":"2024-03-25T05:37:38.585076+0000","last_clean":"2024-03-25T05:37:38.585076+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T05:37:38.585076+0000","last_undegraded":"2024-03-25T05:37:38.585076+0000","last_fullsized":"2024-03-25T05:37:38.585076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:24:40.019842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.538391+0000","last_change":"2024-03-25T05:37:30.419153+0000","last_active":"2024-03-25T05:37:54.538391+0000","last_peered":"2024-03-25T05:37:54.538391+0000","last_clean":"2024-03-25T05:37:54.538391+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T05:37:54.538391+0000","last_undegraded":"2024-03-25T05:37:54.538391+0000","last_fullsized":"2024-03-25T05:37:54.538391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:16:01.889443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222103+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T05:37:38.222103+0000","last_peered":"2024-03-25T05:37:38.222103+0000","last_clean":"2024-03-25T05:37:38.222103+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T05:37:38.222103+0000","last_undegraded":"2024-03-25T05:37:38.222103+0000","last_fullsized":"2024-03-25T05:37:38.222103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309669+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T05:37:38.309669+0000","last_peered":"2024-03-25T05:37:38.309669+0000","last_clean":"2024-03-25T05:37:38.309669+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T05:37:38.309669+0000","last_undegraded":"2024-03-25T05:37:38.309669+0000","last_fullsized":"2024-03-25T05:37:38.309669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'12","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522996+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T05:37:53.522996+0000","last_peered":"2024-03-25T05:37:53.522996+0000","last_clean":"2024-03-25T05:37:53.522996+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T05:37:53.522996+0000","last_undegraded":"2024-03-25T05:37:53.522996+0000","last_fullsized":"2024-03-25T05:37:53.522996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432193+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T05:37:37.432193+0000","last_peered":"2024-03-25T05:37:37.432193+0000","last_clean":"2024-03-25T05:37:37.432193+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T05:37:37.432193+0000","last_undegraded":"2024-03-25T05:37:37.432193+0000","last_fullsized":"2024-03-25T05:37:37.432193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432777+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T05:37:37.432777+0000","last_peered":"2024-03-25T05:37:37.432777+0000","last_clean":"2024-03-25T05:37:37.432777+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T05:37:37.432777+0000","last_undegraded":"2024-03-25T05:37:37.432777+0000","last_fullsized":"2024-03-25T05:37:37.432777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432692+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T05:37:37.432692+0000","last_peered":"2024-03-25T05:37:37.432692+0000","last_clean":"2024-03-25T05:37:37.432692+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T05:37:37.432692+0000","last_undegraded":"2024-03-25T05:37:37.432692+0000","last_fullsized":"2024-03-25T05:37:37.432692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432399+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T05:37:37.432399+0000","last_peered":"2024-03-25T05:37:37.432399+0000","last_clean":"2024-03-25T05:37:37.432399+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T05:37:37.432399+0000","last_undegraded":"2024-03-25T05:37:37.432399+0000","last_fullsized":"2024-03-25T05:37:37.432399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586024+0000","last_change":"2024-03-25T05:37:31.156173+0000","last_active":"2024-03-25T05:37:38.586024+0000","last_peered":"2024-03-25T05:37:38.586024+0000","last_clean":"2024-03-25T05:37:38.586024+0000","last_became_active":"2024-03-25T05:37:31.155640+0000","last_became_peered":"2024-03-25T05:37:31.155640+0000","last_unstale":"2024-03-25T05:37:38.586024+0000","last_undegraded":"2024-03-25T05:37:38.586024+0000","last_fullsized":"2024-03-25T05:37:38.586024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522880+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T05:37:53.522880+0000","last_peered":"2024-03-25T05:37:53.522880+0000","last_clean":"2024-03-25T05:37:53.522880+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T05:37:53.522880+0000","last_undegraded":"2024-03-25T05:37:53.522880+0000","last_fullsized":"2024-03-25T05:37:53.522880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431609+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T05:37:37.431609+0000","last_peered":"2024-03-25T05:37:37.431609+0000","last_clean":"2024-03-25T05:37:37.431609+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T05:37:37.431609+0000","last_undegraded":"2024-03-25T05:37:37.431609+0000","last_fullsized":"2024-03-25T05:37:37.431609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:27:40.435483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221996+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T05:37:38.221996+0000","last_peered":"2024-03-25T05:37:38.221996+0000","last_clean":"2024-03-25T05:37:38.221996+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T05:37:38.221996+0000","last_undegraded":"2024-03-25T05:37:38.221996+0000","last_fullsized":"2024-03-25T05:37:38.221996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522619+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T05:37:53.522619+0000","last_peered":"2024-03-25T05:37:53.522619+0000","last_clean":"2024-03-25T05:37:53.522619+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T05:37:53.522619+0000","last_undegraded":"2024-03-25T05:37:53.522619+0000","last_fullsized":"2024-03-25T05:37:53.522619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431779+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T05:37:37.431779+0000","last_peered":"2024-03-25T05:37:37.431779+0000","last_clean":"2024-03-25T05:37:37.431779+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T05:37:37.431779+0000","last_undegraded":"2024-03-25T05:37:37.431779+0000","last_fullsized":"2024-03-25T05:37:37.431779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:25:03.802329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586404+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T05:37:38.586404+0000","last_peered":"2024-03-25T05:37:38.586404+0000","last_clean":"2024-03-25T05:37:38.586404+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T05:37:38.586404+0000","last_undegraded":"2024-03-25T05:37:38.586404+0000","last_fullsized":"2024-03-25T05:37:38.586404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431019+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T05:37:37.431019+0000","last_peered":"2024-03-25T05:37:37.431019+0000","last_clean":"2024-03-25T05:37:37.431019+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T05:37:37.431019+0000","last_undegraded":"2024-03-25T05:37:37.431019+0000","last_fullsized":"2024-03-25T05:37:37.431019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221746+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T05:37:38.221746+0000","last_peered":"2024-03-25T05:37:38.221746+0000","last_clean":"2024-03-25T05:37:38.221746+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T05:37:38.221746+0000","last_undegraded":"2024-03-25T05:37:38.221746+0000","last_fullsized":"2024-03-25T05:37:38.221746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806142+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T05:37:38.806142+0000","last_peered":"2024-03-25T05:37:38.806142+0000","last_clean":"2024-03-25T05:37:38.806142+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T05:37:38.806142+0000","last_undegraded":"2024-03-25T05:37:38.806142+0000","last_fullsized":"2024-03-25T05:37:38.806142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431606+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T05:37:37.431606+0000","last_peered":"2024-03-25T05:37:37.431606+0000","last_clean":"2024-03-25T05:37:37.431606+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T05:37:37.431606+0000","last_undegraded":"2024-03-25T05:37:37.431606+0000","last_fullsized":"2024-03-25T05:37:37.431606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.543897+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T05:37:54.543897+0000","last_peered":"2024-03-25T05:37:54.543897+0000","last_clean":"2024-03-25T05:37:54.543897+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T05:37:54.543897+0000","last_undegraded":"2024-03-25T05:37:54.543897+0000","last_fullsized":"2024-03-25T05:37:54.543897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.531393+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T05:37:54.531393+0000","last_peered":"2024-03-25T05:37:54.531393+0000","last_clean":"2024-03-25T05:37:54.531393+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T05:37:54.531393+0000","last_undegraded":"2024-03-25T05:37:54.531393+0000","last_fullsized":"2024-03-25T05:37:54.531393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585400+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T05:37:38.585400+0000","last_peered":"2024-03-25T05:37:38.585400+0000","last_clean":"2024-03-25T05:37:38.585400+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T05:37:38.585400+0000","last_undegraded":"2024-03-25T05:37:38.585400+0000","last_fullsized":"2024-03-25T05:37:38.585400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:24.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.529480+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T05:37:53.529480+0000","last_peered":"2024-03-25T05:37:53.529480+0000","last_clean":"2024-03-25T05:37:53.529480+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T05:37:53.529480+0000","last_undegraded":"2024-03-25T05:37:53.529480+0000","last_fullsized":"2024-03-25T05:37:53.529480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432552+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T05:37:37.432552+0000","last_peered":"2024-03-25T05:37:37.432552+0000","last_clean":"2024-03-25T05:37:37.432552+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T05:37:37.432552+0000","last_undegraded":"2024-03-25T05:37:37.432552+0000","last_fullsized":"2024-03-25T05:37:37.432552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433789+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T05:37:37.433789+0000","last_peered":"2024-03-25T05:37:37.433789+0000","last_clean":"2024-03-25T05:37:37.433789+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T05:37:37.433789+0000","last_undegraded":"2024-03-25T05:37:37.433789+0000","last_fullsized":"2024-03-25T05:37:37.433789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:08:02.386273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805476+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T05:37:38.805476+0000","last_peered":"2024-03-25T05:37:38.805476+0000","last_clean":"2024-03-25T05:37:38.805476+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T05:37:38.805476+0000","last_undegraded":"2024-03-25T05:37:38.805476+0000","last_fullsized":"2024-03-25T05:37:38.805476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:31.170943+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:31.170199+0000","last_became_peered":"2024-03-25T05:37:31.170199+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221825+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T05:37:38.221825+0000","last_peered":"2024-03-25T05:37:38.221825+0000","last_clean":"2024-03-25T05:37:38.221825+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T05:37:38.221825+0000","last_undegraded":"2024-03-25T05:37:38.221825+0000","last_fullsized":"2024-03-25T05:37:38.221825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585300+0000","last_change":"2024-03-25T05:37:31.164026+0000","last_active":"2024-03-25T05:37:38.585300+0000","last_peered":"2024-03-25T05:37:38.585300+0000","last_clean":"2024-03-25T05:37:38.585300+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T05:37:38.585300+0000","last_undegraded":"2024-03-25T05:37:38.585300+0000","last_fullsized":"2024-03-25T05:37:38.585300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433660+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T05:37:37.433660+0000","last_peered":"2024-03-25T05:37:37.433660+0000","last_clean":"2024-03-25T05:37:37.433660+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T05:37:37.433660+0000","last_undegraded":"2024-03-25T05:37:37.433660+0000","last_fullsized":"2024-03-25T05:37:37.433660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432470+0000","last_change":"2024-03-25T05:37:31.166178+0000","last_active":"2024-03-25T05:37:37.432470+0000","last_peered":"2024-03-25T05:37:37.432470+0000","last_clean":"2024-03-25T05:37:37.432470+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T05:37:37.432470+0000","last_undegraded":"2024-03-25T05:37:37.432470+0000","last_fullsized":"2024-03-25T05:37:37.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806144+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T05:37:38.806144+0000","last_peered":"2024-03-25T05:37:38.806144+0000","last_clean":"2024-03-25T05:37:38.806144+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T05:37:38.806144+0000","last_undegraded":"2024-03-25T05:37:38.806144+0000","last_fullsized":"2024-03-25T05:37:38.806144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433913+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T05:37:37.433913+0000","last_peered":"2024-03-25T05:37:37.433913+0000","last_clean":"2024-03-25T05:37:37.433913+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T05:37:37.433913+0000","last_undegraded":"2024-03-25T05:37:37.433913+0000","last_fullsized":"2024-03-25T05:37:37.433913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221686+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T05:37:38.221686+0000","last_peered":"2024-03-25T05:37:38.221686+0000","last_clean":"2024-03-25T05:37:38.221686+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T05:37:38.221686+0000","last_undegraded":"2024-03-25T05:37:38.221686+0000","last_fullsized":"2024-03-25T05:37:38.221686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431855+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T05:37:37.431855+0000","last_peered":"2024-03-25T05:37:37.431855+0000","last_clean":"2024-03-25T05:37:37.431855+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T05:37:37.431855+0000","last_undegraded":"2024-03-25T05:37:37.431855+0000","last_fullsized":"2024-03-25T05:37:37.431855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221685+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T05:37:38.221685+0000","last_peered":"2024-03-25T05:37:38.221685+0000","last_clean":"2024-03-25T05:37:38.221685+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T05:37:38.221685+0000","last_undegraded":"2024-03-25T05:37:38.221685+0000","last_fullsized":"2024-03-25T05:37:38.221685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585021+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T05:37:38.585021+0000","last_peered":"2024-03-25T05:37:38.585021+0000","last_clean":"2024-03-25T05:37:38.585021+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T05:37:38.585021+0000","last_undegraded":"2024-03-25T05:37:38.585021+0000","last_fullsized":"2024-03-25T05:37:38.585021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310003+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T05:37:38.310003+0000","last_peered":"2024-03-25T05:37:38.310003+0000","last_clean":"2024-03-25T05:37:38.310003+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T05:37:38.310003+0000","last_undegraded":"2024-03-25T05:37:38.310003+0000","last_fullsized":"2024-03-25T05:37:38.310003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576738+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T05:37:38.576738+0000","last_peered":"2024-03-25T05:37:38.576738+0000","last_clean":"2024-03-25T05:37:38.576738+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T05:37:38.576738+0000","last_undegraded":"2024-03-25T05:37:38.576738+0000","last_fullsized":"2024-03-25T05:37:38.576738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222245+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T05:37:38.222245+0000","last_peered":"2024-03-25T05:37:38.222245+0000","last_clean":"2024-03-25T05:37:38.222245+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T05:37:38.222245+0000","last_undegraded":"2024-03-25T05:37:38.222245+0000","last_fullsized":"2024-03-25T05:37:38.222245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221566+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T05:37:38.221566+0000","last_peered":"2024-03-25T05:37:38.221566+0000","last_clean":"2024-03-25T05:37:38.221566+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T05:37:38.221566+0000","last_undegraded":"2024-03-25T05:37:38.221566+0000","last_fullsized":"2024-03-25T05:37:38.221566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431208+0000","last_change":"2024-03-25T05:37:31.160433+0000","last_active":"2024-03-25T05:37:37.431208+0000","last_peered":"2024-03-25T05:37:37.431208+0000","last_clean":"2024-03-25T05:37:37.431208+0000","last_became_active":"2024-03-25T05:37:31.159183+0000","last_became_peered":"2024-03-25T05:37:31.159183+0000","last_unstale":"2024-03-25T05:37:37.431208+0000","last_undegraded":"2024-03-25T05:37:37.431208+0000","last_fullsized":"2024-03-25T05:37:37.431208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585101+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T05:37:38.585101+0000","last_peered":"2024-03-25T05:37:38.585101+0000","last_clean":"2024-03-25T05:37:38.585101+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T05:37:38.585101+0000","last_undegraded":"2024-03-25T05:37:38.585101+0000","last_fullsized":"2024-03-25T05:37:38.585101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:20.495852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433449+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T05:37:37.433449+0000","last_peered":"2024-03-25T05:37:37.433449+0000","last_clean":"2024-03-25T05:37:37.433449+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T05:37:37.433449+0000","last_undegraded":"2024-03-25T05:37:37.433449+0000","last_fullsized":"2024-03-25T05:37:37.433449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432681+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T05:37:37.432681+0000","last_peered":"2024-03-25T05:37:37.432681+0000","last_clean":"2024-03-25T05:37:37.432681+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T05:37:37.432681+0000","last_undegraded":"2024-03-25T05:37:37.432681+0000","last_fullsized":"2024-03-25T05:37:37.432681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806103+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T05:37:38.806103+0000","last_peered":"2024-03-25T05:37:38.806103+0000","last_clean":"2024-03-25T05:37:38.806103+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T05:37:38.806103+0000","last_undegraded":"2024-03-25T05:37:38.806103+0000","last_fullsized":"2024-03-25T05:37:38.806103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310166+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T05:37:38.310166+0000","last_peered":"2024-03-25T05:37:38.310166+0000","last_clean":"2024-03-25T05:37:38.310166+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T05:37:38.310166+0000","last_undegraded":"2024-03-25T05:37:38.310166+0000","last_fullsized":"2024-03-25T05:37:38.310166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431511+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T05:37:37.431511+0000","last_peered":"2024-03-25T05:37:37.431511+0000","last_clean":"2024-03-25T05:37:37.431511+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T05:37:37.431511+0000","last_undegraded":"2024-03-25T05:37:37.431511+0000","last_fullsized":"2024-03-25T05:37:37.431511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309508+0000","last_change":"2024-03-25T05:37:31.164888+0000","last_active":"2024-03-25T05:37:38.309508+0000","last_peered":"2024-03-25T05:37:38.309508+0000","last_clean":"2024-03-25T05:37:38.309508+0000","last_became_active":"2024-03-25T05:37:31.164658+0000","last_became_peered":"2024-03-25T05:37:31.164658+0000","last_unstale":"2024-03-25T05:37:38.309508+0000","last_undegraded":"2024-03-25T05:37:38.309508+0000","last_fullsized":"2024-03-25T05:37:38.309508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221663+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T05:37:38.221663+0000","last_peered":"2024-03-25T05:37:38.221663+0000","last_clean":"2024-03-25T05:37:38.221663+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T05:37:38.221663+0000","last_undegraded":"2024-03-25T05:37:38.221663+0000","last_fullsized":"2024-03-25T05:37:38.221663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309565+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T05:37:38.309565+0000","last_peered":"2024-03-25T05:37:38.309565+0000","last_clean":"2024-03-25T05:37:38.309565+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T05:37:38.309565+0000","last_undegraded":"2024-03-25T05:37:38.309565+0000","last_fullsized":"2024-03-25T05:37:38.309565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222105+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T05:37:38.222105+0000","last_peered":"2024-03-25T05:37:38.222105+0000","last_clean":"2024-03-25T05:37:38.222105+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T05:37:38.222105+0000","last_undegraded":"2024-03-25T05:37:38.222105+0000","last_fullsized":"2024-03-25T05:37:38.222105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585511+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T05:37:38.585511+0000","last_peered":"2024-03-25T05:37:38.585511+0000","last_clean":"2024-03-25T05:37:38.585511+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T05:37:38.585511+0000","last_undegraded":"2024-03-25T05:37:38.585511+0000","last_fullsized":"2024-03-25T05:37:38.585511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435035+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T05:37:37.435035+0000","last_peered":"2024-03-25T05:37:37.435035+0000","last_clean":"2024-03-25T05:37:37.435035+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T05:37:37.435035+0000","last_undegraded":"2024-03-25T05:37:37.435035+0000","last_fullsized":"2024-03-25T05:37:37.435035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310094+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T05:37:38.310094+0000","last_peered":"2024-03-25T05:37:38.310094+0000","last_clean":"2024-03-25T05:37:38.310094+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T05:37:38.310094+0000","last_undegraded":"2024-03-25T05:37:38.310094+0000","last_fullsized":"2024-03-25T05:37:38.310094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":699077,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":111325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":108337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":698421,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T05:37:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-25T05:37:57.331 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-25T05:37:57.331 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-25T05:37:57.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-25T05:37:57.331 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-25T05:37:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.561+0000 7f94c9200640 1 Processor -- start 2024-03-25T05:37:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.561+0000 7f94c9200640 1 -- start start 2024-03-25T05:37:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.562+0000 7f94c9200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f94c4154120 0x7f94c40cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.562+0000 7f94c9200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40cbbe0 con 0x7f94c40c67e0 2024-03-25T05:37:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.562+0000 7f94c9200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40ca280 con 0x7f94c40c6c10 2024-03-25T05:37:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.562+0000 7f94c9200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c4154500 con 0x7f94c4154120 2024-03-25T05:37:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.562+0000 7f94c2a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f94c40c67e0 0x7f94c40c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60934/0 (socket says 172.21.15.102:60934) 2024-03-25T05:37:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.562+0000 7f94c2a00640 1 -- 172.21.15.102:0/2393507357 learned_addr learned my addr 172.21.15.102:0/2393507357 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.562+0000 7f94c3400640 1 --2- 172.21.15.102:0/2393507357 >> v2:172.21.15.102:3300/0 conn(0x7f94c4154120 0x7f94c40cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.563+0000 7f94c2000640 1 -- 172.21.15.102:0/2393507357 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714215252 0 0) 0x7f94c40cbbe0 con 0x7f94c40c67e0 2024-03-25T05:37:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.563+0000 7f94c2000640 1 -- 172.21.15.102:0/2393507357 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a8003520 con 0x7f94c40c67e0 2024-03-25T05:37:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.563+0000 7f94c2000640 1 -- 172.21.15.102:0/2393507357 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502764999 0 0) 0x7f94c40ca280 con 0x7f94c40c6c10 2024-03-25T05:37:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.563+0000 7f94c2000640 1 -- 172.21.15.102:0/2393507357 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c40cbbe0 con 0x7f94c40c6c10 2024-03-25T05:37:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.563+0000 7f94c3400640 1 -- 172.21.15.102:0/2393507357 >> v1:172.21.15.187:6789/0 conn(0x7f94c40c6c10 legacy=0x7f94c4164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.563+0000 7f94c3400640 1 -- 172.21.15.102:0/2393507357 >> v1:172.21.15.102:6789/0 conn(0x7f94c40c67e0 legacy=0x7f94c40c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.563+0000 7f94c3400640 1 -- 172.21.15.102:0/2393507357 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c415aac0 con 0x7f94c4154120 2024-03-25T05:37:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.564+0000 7f94c3400640 1 --2- 172.21.15.102:0/2393507357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c4154120 0x7f94c40cb000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097a0 tx=0x7f94b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7213258e45c283f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.564+0000 7f94c2000640 1 -- 172.21.15.102:0/2393507357 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4031830 con 0x7f94c4154120 2024-03-25T05:37:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.564+0000 7f94c2000640 1 -- 172.21.15.102:0/2393507357 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4031990 con 0x7f94c4154120 2024-03-25T05:37:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.564+0000 7f94c2000640 1 -- 172.21.15.102:0/2393507357 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4031d20 con 0x7f94c4154120 2024-03-25T05:37:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.565+0000 7f94c9200640 1 -- 172.21.15.102:0/2393507357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c4154120 msgr2=0x7f94c40cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.565+0000 7f94c9200640 1 --2- 172.21.15.102:0/2393507357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c4154120 0x7f94c40cb000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097a0 tx=0x7f94b402b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.565+0000 7f94c9200640 1 -- 172.21.15.102:0/2393507357 shutdown_connections 2024-03-25T05:37:57.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.565+0000 7f94c9200640 1 --2- 172.21.15.102:0/2393507357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c4154120 0x7f94c40cb000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.565+0000 7f94c9200640 1 -- 172.21.15.102:0/2393507357 >> 172.21.15.102:0/2393507357 conn(0x7f94c40cf3e0 msgr2=0x7f94c40cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:57.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.565+0000 7f94c9200640 1 -- 172.21.15.102:0/2393507357 shutdown_connections 2024-03-25T05:37:57.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.565+0000 7f94c9200640 1 -- 172.21.15.102:0/2393507357 wait complete. 2024-03-25T05:37:57.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.567+0000 7f94c9200640 1 Processor -- start 2024-03-25T05:37:57.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.567+0000 7f94c9200640 1 -- start start 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c9200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c40c67e0 0x7f94c4156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c9200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c40c6c10 0x7f94c40c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c9200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c4154120 0x7f94c41efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c9200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41f2e90 con 0x7f94c40c67e0 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c9200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41f3130 con 0x7f94c4154120 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c9200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41f3410 con 0x7f94c40c6c10 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c40c67e0 0x7f94c4156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c40c67e0 0x7f94c4156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56364/0 (socket says 172.21.15.102:56364) 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 -- 172.21.15.102:0/3985410430 learned_addr learned my addr 172.21.15.102:0/3985410430 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c2a00640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c40c6c10 0x7f94c40c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3e00640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c4154120 0x7f94c41efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 -- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c40c6c10 msgr2=0x7f94c40c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c40c6c10 0x7f94c40c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 -- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c4154120 msgr2=0x7f94c41efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c4154120 0x7f94c41efc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.568+0000 7f94c3400640 1 -- 172.21.15.102:0/3985410430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009400 con 0x7f94c40c67e0 2024-03-25T05:37:57.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.569+0000 7f94c2a00640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c40c6c10 0x7f94c40c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:57.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.569+0000 7f94c3400640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c40c67e0 0x7f94c4156a90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000c00 tx=0x7f94b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:57.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.569+0000 7f94bb400640 1 -- 172.21.15.102:0/3985410430 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b403a830 con 0x7f94c40c67e0 2024-03-25T05:37:57.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.569+0000 7f94bb400640 1 -- 172.21.15.102:0/3985410430 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b403a9d0 con 0x7f94c40c67e0 2024-03-25T05:37:57.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.569+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c41f36f0 con 0x7f94c40c67e0 2024-03-25T05:37:57.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.569+0000 7f94bb400640 1 -- 172.21.15.102:0/3985410430 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b403ad80 con 0x7f94c40c67e0 2024-03-25T05:37:57.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.569+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c41f3cb0 con 0x7f94c40c67e0 2024-03-25T05:37:57.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.571+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c40c7160 con 0x7f94c40c67e0 2024-03-25T05:37:57.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.571+0000 7f94bb400640 1 -- 172.21.15.102:0/3985410430 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f94b404d450 con 0x7f94c40c67e0 2024-03-25T05:37:57.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.572+0000 7f94bb400640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f94a406b840 0x7f94a406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:57.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.572+0000 7f94bb400640 1 -- 172.21.15.102:0/3985410430 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94b40ac4e0 con 0x7f94c40c67e0 2024-03-25T05:37:57.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.573+0000 7f94c2a00640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f94a406b840 0x7f94a406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:57.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.573+0000 7f94c2a00640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f94a406b840 0x7f94a406dd00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94c41572d0 tx=0x7f94b0007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.577+0000 7f94bb400640 1 -- 172.21.15.102:0/3985410430 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f94b4076bd0 con 0x7f94c40c67e0 2024-03-25T05:37:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.822+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f94c404f2f0 con 0x7f94c40c67e0 2024-03-25T05:37:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.826+0000 7f94bb400640 1 -- 172.21.15.102:0/3985410430 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171788 (secure 0 0 0) 0x7f94b4035090 con 0x7f94c40c67e0 2024-03-25T05:37:57.821 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:57.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f94a406b840 msgr2=0x7f94a406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f94a406b840 0x7f94a406dd00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94c41572d0 tx=0x7f94b0007d80 comp rx=0 tx=0).stop 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c40c67e0 msgr2=0x7f94c4156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c40c67e0 0x7f94c4156a90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000c00 tx=0x7f94b40046c0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 shutdown_connections 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f94a406b840 0x7f94a406dd00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c4154120 0x7f94c41efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c40c6c10 0x7f94c40c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 --2- 172.21.15.102:0/3985410430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94c40c67e0 0x7f94c4156a90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.829+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 >> 172.21.15.102:0/3985410430 conn(0x7f94c40cf3e0 msgr2=0x7f94c40ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.830+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 shutdown_connections 2024-03-25T05:37:57.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:57.830+0000 7f94c9200640 1 -- 172.21.15.102:0/3985410430 wait complete. 2024-03-25T05:37:57.847 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":864804910},{"type":"v1","addr":"172.21.15.187:6833","nonce":864804910}]},"active_addr":"172.21.15.187:6833/864804910","active_change":"2024-03-25T05:37:18.990430+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":400628348}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2922099890}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":3493794315}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2417465275}]}]} 2024-03-25T05:37:57.850 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-25T05:37:57.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-25T05:37:57.851 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.029+0000 7fb00d800640 1 Processor -- start 2024-03-25T05:37:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.029+0000 7fb00d800640 1 -- start start 2024-03-25T05:37:58.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb00d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb0080cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb00d800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb0080c67e0 0x7fb0080cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb00d800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0080cbbe0 con 0x7fb0080c6c10 2024-03-25T05:37:58.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb00d800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb008154500 con 0x7fb0080c67e0 2024-03-25T05:37:58.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb00d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00806b250 con 0x7fb008154120 2024-03-25T05:37:58.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb0080cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb0080c67e0 0x7fb0080cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb0080cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57950/0 (socket says 172.21.15.102:57950) 2024-03-25T05:37:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007e00640 1 -- 172.21.15.102:0/2507941217 learned_addr learned my addr 172.21.15.102:0/2507941217 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007e00640 1 -- 172.21.15.102:0/2507941217 >> v2:172.21.15.187:3300/0 conn(0x7fb0080c67e0 msgr2=0x7fb0080cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007e00640 1 --2- 172.21.15.102:0/2507941217 >> v2:172.21.15.187:3300/0 conn(0x7fb0080c67e0 0x7fb0080cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007e00640 1 -- 172.21.15.102:0/2507941217 >> v1:172.21.15.102:6789/0 conn(0x7fb0080c6c10 legacy=0x7fb0080c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.031+0000 7fb007e00640 1 -- 172.21.15.102:0/2507941217 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080ca280 con 0x7fb008154120 2024-03-25T05:37:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.033+0000 7fb007e00640 1 --2- 172.21.15.102:0/2507941217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb0080cb000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faff8009870 tx=0x7faff802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b9ec365fa0405f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.033+0000 7fb006a00640 1 -- 172.21.15.102:0/2507941217 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8030840 con 0x7fb008154120 2024-03-25T05:37:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.033+0000 7fb006a00640 1 -- 172.21.15.102:0/2507941217 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80309a0 con 0x7fb008154120 2024-03-25T05:37:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.033+0000 7fb006a00640 1 -- 172.21.15.102:0/2507941217 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8030d30 con 0x7fb008154120 2024-03-25T05:37:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 -- 172.21.15.102:0/2507941217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 msgr2=0x7fb0080cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 --2- 172.21.15.102:0/2507941217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb0080cb000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faff8009870 tx=0x7faff802b980 comp rx=0 tx=0).stop 2024-03-25T05:37:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 -- 172.21.15.102:0/2507941217 shutdown_connections 2024-03-25T05:37:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 --2- 172.21.15.102:0/2507941217 >> v2:172.21.15.187:3300/0 conn(0x7fb0080c67e0 0x7fb0080cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 --2- 172.21.15.102:0/2507941217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb0080cb000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 -- 172.21.15.102:0/2507941217 >> 172.21.15.102:0/2507941217 conn(0x7fb0080cf3e0 msgr2=0x7fb0080cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 -- 172.21.15.102:0/2507941217 shutdown_connections 2024-03-25T05:37:58.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.034+0000 7fb00d800640 1 -- 172.21.15.102:0/2507941217 wait complete. 2024-03-25T05:37:58.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.036+0000 7fb00d800640 1 Processor -- start 2024-03-25T05:37:58.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.036+0000 7fb00d800640 1 -- start start 2024-03-25T05:37:58.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb00d800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0080c67e0 0x7fb0081572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb00d800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0080c6c10 0x7fb0081f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb00d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb00814cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb00d800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081f2ad0 con 0x7fb0080c6c10 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb00d800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008159a30 con 0x7fb0080c67e0 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb00d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb008159d10 con 0x7fb008154120 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb007400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0080c6c10 0x7fb0081f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb007e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0080c67e0 0x7fb0081572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb007e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0080c67e0 0x7fb0081572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48268/0 (socket says 172.21.15.102:48268) 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb007e00640 1 -- 172.21.15.102:0/1635170339 learned_addr learned my addr 172.21.15.102:0/1635170339 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.038+0000 7fb00ce00640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb00814cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb007e00640 1 -- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 msgr2=0x7fb00814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb007e00640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb00814cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb007e00640 1 -- 172.21.15.102:0/1635170339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0080c6c10 msgr2=0x7fb0081f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb007e00640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0080c6c10 0x7fb0081f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb007e00640 1 -- 172.21.15.102:0/1635170339 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff80094d0 con 0x7fb0080c67e0 2024-03-25T05:37:58.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb00ce00640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb00814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:58.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb007e00640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0080c67e0 0x7fb0081572e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faff8009870 tx=0x7faff8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fafffe00640 1 -- 172.21.15.102:0/1635170339 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8039a90 con 0x7fb0080c67e0 2024-03-25T05:37:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fafffe00640 1 -- 172.21.15.102:0/1635170339 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff8039c10 con 0x7fb0080c67e0 2024-03-25T05:37:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fafffe00640 1 -- 172.21.15.102:0/1635170339 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80433f0 con 0x7fb0080c67e0 2024-03-25T05:37:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.039+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb008159ff0 con 0x7fb0080c67e0 2024-03-25T05:37:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.040+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb008159740 con 0x7fb0080c67e0 2024-03-25T05:37:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.040+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0081f2f80 con 0x7fb0080c67e0 2024-03-25T05:37:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.043+0000 7fafffe00640 1 -- 172.21.15.102:0/1635170339 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faff8042390 con 0x7fb0080c67e0 2024-03-25T05:37:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.044+0000 7fafffe00640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fafe806b810 0x7fafe806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.044+0000 7fafffe00640 1 -- 172.21.15.102:0/1635170339 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faff80aca80 con 0x7fb0080c67e0 2024-03-25T05:37:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.044+0000 7fb007400640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fafe806b810 0x7fafe806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.045+0000 7fb007400640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fafe806b810 0x7fafe806dcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb008155890 tx=0x7faff4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.046+0000 7fafffe00640 1 -- 172.21.15.102:0/1635170339 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faff8077310 con 0x7fb0080c67e0 2024-03-25T05:37:58.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.236+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb00804f2f0 con 0x7fb0080c67e0 2024-03-25T05:37:58.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.237+0000 7fafffe00640 1 -- 172.21.15.102:0/1635170339 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7faff807a9d0 con 0x7fb0080c67e0 2024-03-25T05:37:58.231 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:58.231 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fafe806b810 msgr2=0x7fafe806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fafe806b810 0x7fafe806dcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb008155890 tx=0x7faff4009190 comp rx=0 tx=0).stop 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0080c67e0 msgr2=0x7fb0081572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0080c67e0 0x7fb0081572e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faff8009870 tx=0x7faff8004730 comp rx=0 tx=0).stop 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 shutdown_connections 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fafe806b810 0x7fafe806dcd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb008154120 0x7fb00814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0080c6c10 0x7fb0081f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 --2- 172.21.15.102:0/1635170339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0080c67e0 0x7fb0081572e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.239+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 >> 172.21.15.102:0/1635170339 conn(0x7fb0080cf3e0 msgr2=0x7fb00806b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:58.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.240+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 shutdown_connections 2024-03-25T05:37:58.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.240+0000 7fb00d800640 1 -- 172.21.15.102:0/1635170339 wait complete. 2024-03-25T05:37:58.248 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-25T05:37:58.249 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:37:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.419+0000 7f2ccde00640 1 Processor -- start 2024-03-25T05:37:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.419+0000 7f2ccde00640 1 -- start start 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccde00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2cc80c67e0 0x7f2cc80c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccde00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2cc80c6c10 0x7f2cc80c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccde00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc80cbbe0 con 0x7f2cc8154120 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccde00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc8154500 con 0x7f2cc80c67e0 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccde00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc806b250 con 0x7f2cc80c6c10 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccd400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2cc80c6c10 0x7f2cc80c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccd400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2cc80c6c10 0x7f2cc80c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48282/0 (socket says 172.21.15.102:48282) 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2ccd400640 1 -- 172.21.15.102:0/3577985802 learned_addr learned my addr 172.21.15.102:0/3577985802 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.420+0000 7f2cc7e00640 1 --2- 172.21.15.102:0/3577985802 >> v2:172.21.15.102:3300/0 conn(0x7f2cc80c67e0 0x7f2cc80c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.421+0000 7f2ccd400640 1 -- 172.21.15.102:0/3577985802 >> v2:172.21.15.102:3300/0 conn(0x7f2cc80c67e0 msgr2=0x7f2cc80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.421+0000 7f2ccd400640 1 --2- 172.21.15.102:0/3577985802 >> v2:172.21.15.102:3300/0 conn(0x7f2cc80c67e0 0x7f2cc80c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.421+0000 7f2ccd400640 1 -- 172.21.15.102:0/3577985802 >> v1:172.21.15.102:6789/0 conn(0x7f2cc8154120 legacy=0x7f2cc80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.421+0000 7f2ccd400640 1 -- 172.21.15.102:0/3577985802 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80ca280 con 0x7f2cc80c6c10 2024-03-25T05:37:58.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.422+0000 7f2cc7e00640 1 --2- 172.21.15.102:0/3577985802 >> v2:172.21.15.102:3300/0 conn(0x7f2cc80c67e0 0x7f2cc80c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:58.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.422+0000 7f2ccd400640 1 --2- 172.21.15.102:0/3577985802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c6c10 0x7f2cc80c8240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2cc815e2f0 tx=0x7f2cc002bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=378e80a87b08267e server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:58.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.423+0000 7f2cc7400640 1 -- 172.21.15.102:0/3577985802 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc002cb10 con 0x7f2cc80c6c10 2024-03-25T05:37:58.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.423+0000 7f2cc7400640 1 -- 172.21.15.102:0/3577985802 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc002cc70 con 0x7f2cc80c6c10 2024-03-25T05:37:58.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.423+0000 7f2cc7400640 1 -- 172.21.15.102:0/3577985802 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00343f0 con 0x7f2cc80c6c10 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.423+0000 7f2ccde00640 1 -- 172.21.15.102:0/3577985802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c6c10 msgr2=0x7f2cc80c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.423+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3577985802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c6c10 0x7f2cc80c8240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2cc815e2f0 tx=0x7f2cc002bf70 comp rx=0 tx=0).stop 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.424+0000 7f2ccde00640 1 -- 172.21.15.102:0/3577985802 shutdown_connections 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.424+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3577985802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c6c10 0x7f2cc80c8240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.424+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3577985802 >> v2:172.21.15.102:3300/0 conn(0x7f2cc80c67e0 0x7f2cc80c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.424+0000 7f2ccde00640 1 -- 172.21.15.102:0/3577985802 >> 172.21.15.102:0/3577985802 conn(0x7f2cc80cf3e0 msgr2=0x7f2cc80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.424+0000 7f2ccde00640 1 -- 172.21.15.102:0/3577985802 shutdown_connections 2024-03-25T05:37:58.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.424+0000 7f2ccde00640 1 -- 172.21.15.102:0/3577985802 wait complete. 2024-03-25T05:37:58.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.426+0000 7f2ccde00640 1 Processor -- start 2024-03-25T05:37:58.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.426+0000 7f2ccde00640 1 -- start start 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccde00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c67e0 0x7f2cc81595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccde00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cc80c6c10 0x7f2cc81ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccde00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cc8154120 0x7f2cc81ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccde00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc81f34f0 con 0x7f2cc80c6c10 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccde00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8151430 con 0x7f2cc80c67e0 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccde00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc814e660 con 0x7f2cc8154120 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2cc7e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cc80c6c10 0x7f2cc81ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c67e0 0x7f2cc81595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2cc7e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cc80c6c10 0x7f2cc81ef3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56378/0 (socket says 172.21.15.102:56378) 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2cc7e00640 1 -- 172.21.15.102:0/3617697749 learned_addr learned my addr 172.21.15.102:0/3617697749 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccd400640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cc8154120 0x7f2cc81ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccca00640 1 -- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cc8154120 msgr2=0x7f2cc81ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccca00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cc8154120 0x7f2cc81ef8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccca00640 1 -- 172.21.15.102:0/3617697749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cc80c6c10 msgr2=0x7f2cc81ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccca00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cc80c6c10 0x7f2cc81ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.428+0000 7f2ccca00640 1 -- 172.21.15.102:0/3617697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0009b30 con 0x7f2cc80c67e0 2024-03-25T05:37:58.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.429+0000 7f2cc7e00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cc80c6c10 0x7f2cc81ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:58.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.429+0000 7f2ccca00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c67e0 0x7f2cc81595c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c3c0 tx=0x7f2cbc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:58.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.429+0000 7f2cc4c00640 1 -- 172.21.15.102:0/3617697749 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0052d0 con 0x7f2cc80c67e0 2024-03-25T05:37:58.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.429+0000 7f2cc4c00640 1 -- 172.21.15.102:0/3617697749 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc005450 con 0x7f2cc80c67e0 2024-03-25T05:37:58.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.429+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc81f28e0 con 0x7f2cc80c67e0 2024-03-25T05:37:58.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.429+0000 7f2cc4c00640 1 -- 172.21.15.102:0/3617697749 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc007260 con 0x7f2cc80c67e0 2024-03-25T05:37:58.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.429+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc81f2ea0 con 0x7f2cc80c67e0 2024-03-25T05:37:58.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.430+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc80c7160 con 0x7f2cc80c67e0 2024-03-25T05:37:58.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.432+0000 7f2cc4c00640 1 -- 172.21.15.102:0/3617697749 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cbc0073c0 con 0x7f2cc80c67e0 2024-03-25T05:37:58.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.433+0000 7f2cc4c00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2ca806b810 0x7f2ca806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:58.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.433+0000 7f2cc4c00640 1 -- 172.21.15.102:0/3617697749 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2cbc0897c0 con 0x7f2cc80c67e0 2024-03-25T05:37:58.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.433+0000 7f2cc7e00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2ca806b810 0x7f2ca806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:58.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.434+0000 7f2cc7e00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2ca806b810 0x7f2ca806dcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80c2ea0 tx=0x7f2cb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:58.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.441+0000 7f2cc4c00640 1 -- 172.21.15.102:0/3617697749 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2cbc053eb0 con 0x7f2cc80c67e0 2024-03-25T05:37:58.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.633+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cc804f2f0 con 0x7f2cc80c67e0 2024-03-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.634+0000 7f2cc4c00640 1 -- 172.21.15.102:0/3617697749 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f2cbc057570 con 0x7f2cc80c67e0 2024-03-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:37:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2ca806b810 msgr2=0x7f2ca806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2ca806b810 0x7f2ca806dcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80c2ea0 tx=0x7f2cb4008040 comp rx=0 tx=0).stop 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c67e0 msgr2=0x7f2cc81595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c67e0 0x7f2cc81595c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c3c0 tx=0x7f2cbc00c880 comp rx=0 tx=0).stop 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 shutdown_connections 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2ca806b810 0x7f2ca806dcd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cc8154120 0x7f2cc81ef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cc80c6c10 0x7f2cc81ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 --2- 172.21.15.102:0/3617697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cc80c67e0 0x7f2cc81595c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 >> 172.21.15.102:0/3617697749 conn(0x7f2cc80cf3e0 msgr2=0x7f2cc80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 shutdown_connections 2024-03-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:58.636+0000 7f2ccde00640 1 -- 172.21.15.102:0/3617697749 wait complete. 2024-03-25T05:37:58.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-25T05:37:58.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-25T05:37:58.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-25T05:37:58.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-25T05:37:58.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-25T05:37:58.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-25T05:37:58.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-25T05:37:58.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-25T05:37:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.027+0000 7fcdc8e00640 1 Processor -- start 2024-03-25T05:37:59.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.027+0000 7fcdc8e00640 1 -- start start 2024-03-25T05:37:59.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.034+0000 7f42ace00640 1 Processor -- start 2024-03-25T05:37:59.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.034+0000 7f42ace00640 1 -- start start 2024-03-25T05:37:59.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.035+0000 7fcdc8e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.035+0000 7fcdc8e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcdc4072150 0x7fcdc4071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.036+0000 7fcdc3400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.036+0000 7fcdc3400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:57976/0 (socket says 172.21.15.102:57976) 2024-03-25T05:37:59.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f42ace00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f42a806e5b0 0x7f42a80711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f5dc0c00640 1 Processor -- start 2024-03-25T05:37:59.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7fcdc8e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc416aa90 con 0x7fcdc4072550 2024-03-25T05:37:59.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7fcdc8e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc406bcc0 con 0x7fcdc4072150 2024-03-25T05:37:59.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7fcdc8e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4169ef0 con 0x7fcdc4070de0 2024-03-25T05:37:59.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7fcdbaa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcdc4072150 0x7fcdc4071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7fcdbaa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcdc4072150 0x7fcdc4071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56380/0 (socket says 172.21.15.102:56380) 2024-03-25T05:37:59.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7fcdbaa00640 1 -- 172.21.15.102:0/621830180 learned_addr learned my addr 172.21.15.102:0/621830180 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f5dc0c00640 1 -- start start 2024-03-25T05:37:59.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.040+0000 7fcdc3400640 1 -- 172.21.15.102:0/621830180 >> v2:172.21.15.102:3300/0 conn(0x7fcdc4072150 msgr2=0x7fcdc4071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.040+0000 7fcdc3400640 1 --2- 172.21.15.102:0/621830180 >> v2:172.21.15.102:3300/0 conn(0x7fcdc4072150 0x7fcdc4071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.040+0000 7fcdc3400640 1 -- 172.21.15.102:0/621830180 >> v1:172.21.15.102:6789/0 conn(0x7fcdc4072550 legacy=0x7fcdc41668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.041+0000 7fcdc3400640 1 -- 172.21.15.102:0/621830180 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc416a160 con 0x7fcdc4070de0 2024-03-25T05:37:59.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f42ace00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a806f910 con 0x7f42a806e990 2024-03-25T05:37:59.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f42ace00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a806f350 con 0x7f42a81567e0 2024-03-25T05:37:59.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f42ace00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a8072f90 con 0x7f42a806e5b0 2024-03-25T05:37:59.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f42a6800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f42a81567e0 0x7f42a814f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34486/0 (socket says 172.21.15.102:34486) 2024-03-25T05:37:59.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.038+0000 7f42a6800640 1 -- 172.21.15.102:0/2205865426 learned_addr learned my addr 172.21.15.102:0/2205865426 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:59.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727698069 0 0) 0x7f42a806f350 con 0x7f42a81567e0 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f428c003520 con 0x7f42a81567e0 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 911615269 0 0) 0x7f428c003520 con 0x7f42a81567e0 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 >> v2:172.21.15.187:3300/0 conn(0x7f42a806e5b0 msgr2=0x7f42a80711d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 --2- 172.21.15.102:0/2205865426 >> v2:172.21.15.187:3300/0 conn(0x7f42a806e5b0 0x7f42a80711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 >> v1:172.21.15.102:6789/0 conn(0x7f42a806e990 legacy=0x7f42a8072880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a806f630 con 0x7f42a81567e0 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f4294001670 con 0x7f42a81567e0 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 >> v1:172.21.15.187:6789/0 conn(0x7f42a81567e0 legacy=0x7f42a814f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c003970 0x7f428c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0047c0 0x7f428c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428c0052a0 0x7f428c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8072f90 con 0x7f428c0052a0 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c190 con 0x7f428c003970 2024-03-25T05:37:59.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.039+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c350 con 0x7f428c0047c0 2024-03-25T05:37:59.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.042+0000 7f42a5400640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0047c0 0x7f428c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.044+0000 7f5dc0c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5dbc0cbe30 0x7f5dbc06e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f5dc0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 0x7f5dbc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f8603e00640 1 Processor -- start 2024-03-25T05:37:59.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f5dc0c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dbc070de0 con 0x7f5dbc14ffd0 2024-03-25T05:37:59.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f5dc0c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dbc0715f0 con 0x7f5dbc0cbe30 2024-03-25T05:37:59.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f5dc0c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc1503b0 con 0x7f5dbc071cc0 2024-03-25T05:37:59.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7fcdc3400640 1 --2- 172.21.15.102:0/621830180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c5180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400dbc0 tx=0x7fcdb402fd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4cf35d50c74f959 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.042+0000 7f42a5e00640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c003970 0x7f428c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.043+0000 7f42a5400640 1 -- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c003970 msgr2=0x7f428c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.043+0000 7f42a5400640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c003970 0x7f428c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.043+0000 7f42a5400640 1 -- 172.21.15.102:0/2205865426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428c0052a0 msgr2=0x7f428c00b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:59.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.043+0000 7f42a5400640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428c0052a0 0x7f428c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.043+0000 7f42a5400640 1 -- 172.21.15.102:0/2205865426 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a806f630 con 0x7f428c0047c0 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.044+0000 7f42a5400640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0047c0 0x7f428c004c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42a806eda0 tx=0x7f428c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=978f8a3b433cceb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298007ad0 con 0x7f428c0047c0 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298007c30 con 0x7f428c0047c0 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f42a4a00640 1 -- 172.21.15.102:0/2205865426 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298009310 con 0x7f428c0047c0 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f8603e00640 1 -- start start 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f5dbb400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5dbc14ffd0 0x7f5dbc156670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34488/0 (socket says 172.21.15.102:34488) 2024-03-25T05:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f5dbb400640 1 -- 172.21.15.102:0/1661853398 learned_addr learned my addr 172.21.15.102:0/1661853398 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:59.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.045+0000 7f5dbbe00640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 0x7f5dbc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.047+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911977258 0 0) 0x7f5dbc070de0 con 0x7f5dbc14ffd0 2024-03-25T05:37:59.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.048+0000 7f8603e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f85fc0d4bf0 0x7f85fc0452f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.048+0000 7f8603e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc0071d0 con 0x7f85fc050e70 2024-03-25T05:37:59.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.048+0000 7f8603e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc04b6d0 con 0x7f85fc007660 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.048+0000 7f8603e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85fc04bb30 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.049+0000 7f8602a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f85fc0d4bf0 0x7f85fc0452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.049+0000 7f8602a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f85fc0d4bf0 0x7f85fc0452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48310/0 (socket says 172.21.15.102:48310) 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.049+0000 7f8602a00640 1 -- 172.21.15.102:0/1343647089 learned_addr learned my addr 172.21.15.102:0/1343647089 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.047+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da0003520 con 0x7f5dbc14ffd0 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.049+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/1661853398 >> v2:172.21.15.102:3300/0 conn(0x7f5dbc0cbe30 0x7f5dbc06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067877671 0 0) 0x7f5da0003520 con 0x7f5dbc14ffd0 2024-03-25T05:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 msgr2=0x7f5dbc06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 0x7f5dbc06eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 >> v2:172.21.15.102:3300/0 conn(0x7f5dbc0cbe30 msgr2=0x7f5dbc06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 --2- 172.21.15.102:0/1661853398 >> v2:172.21.15.102:3300/0 conn(0x7f5dbc0cbe30 0x7f5dbc06e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0c6460 con 0x7f5dbc14ffd0 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f5db40019f0 con 0x7f5dbc14ffd0 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7fcdc2a00640 1 -- 172.21.15.102:0/621830180 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4030930 con 0x7fcdc4070de0 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7fcdc2a00640 1 -- 172.21.15.102:0/621830180 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb4030a90 con 0x7fcdc4070de0 2024-03-25T05:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7fcdc2a00640 1 -- 172.21.15.102:0/621830180 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4030e00 con 0x7fcdc4070de0 2024-03-25T05:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 >> v1:172.21.15.187:6789/0 conn(0x7f5dbc14ffd0 legacy=0x7f5dbc156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5da0003970 0x7f5da0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5da00047c0 0x7f5da0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 0x7f5da0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0715f0 con 0x7f5da0003970 2024-03-25T05:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc1503b0 con 0x7f5da00047c0 2024-03-25T05:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.050+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00141c0 con 0x7f5dbc071cc0 2024-03-25T05:37:59.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.051+0000 7fcdc8e00640 1 -- 172.21.15.102:0/621830180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 msgr2=0x7fcdc40c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.051+0000 7fcdc8e00640 1 --2- 172.21.15.102:0/621830180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c5180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400dbc0 tx=0x7fcdb402fd90 comp rx=0 tx=0).stop 2024-03-25T05:37:59.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.051+0000 7fcdc8e00640 1 -- 172.21.15.102:0/621830180 shutdown_connections 2024-03-25T05:37:59.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.051+0000 7fcdc8e00640 1 --2- 172.21.15.102:0/621830180 >> v2:172.21.15.102:3300/0 conn(0x7fcdc4072150 0x7fcdc4071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.051+0000 7fcdc8e00640 1 --2- 172.21.15.102:0/621830180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c5180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.051+0000 7fcdc8e00640 1 -- 172.21.15.102:0/621830180 >> 172.21.15.102:0/621830180 conn(0x7fcdc40cb340 msgr2=0x7fcdc40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.046+0000 7f42ace00640 1 -- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0047c0 msgr2=0x7f428c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.046+0000 7f42ace00640 1 --2- 172.21.15.102:0/2205865426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0047c0 0x7f428c004c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42a806eda0 tx=0x7f428c0057f0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.047+0000 7f42a6800640 1 -- 172.21.15.102:0/2205865426 reap_dead start 2024-03-25T05:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.047+0000 7f42a6800640 1 -- 172.21.15.102:0/2205865426 reap_dead start 2024-03-25T05:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.047+0000 7f42ace00640 1 -- 172.21.15.102:0/2205865426 shutdown_connections 2024-03-25T05:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.047+0000 7f42ace00640 1 -- 172.21.15.102:0/2205865426 >> 172.21.15.102:0/2205865426 conn(0x7f42a80c7dd0 msgr2=0x7f42a80c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.052+0000 7f42ace00640 1 -- 172.21.15.102:0/2205865426 shutdown_connections 2024-03-25T05:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.051+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/1661853398 >> v2:172.21.15.102:3300/0 conn(0x7f5dbc0cbe30 0x7f5dbc06e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.052+0000 7f5dbb400640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5da0003970 0x7f5da0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.052+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5da00047c0 0x7f5da0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.053+0000 7f5dbbe00640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 0x7f5da0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.049+0000 7f8602a00640 1 -- 172.21.15.102:0/1343647089 >> v1:172.21.15.187:6789/0 conn(0x7f85fc007660 legacy=0x7f85fc0db460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-25T05:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.049+0000 7f8602a00640 1 -- 172.21.15.102:0/1343647089 >> v1:172.21.15.102:6789/0 conn(0x7f85fc050e70 legacy=0x7f85fc0dad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.049+0000 7f8602a00640 1 -- 172.21.15.102:0/1343647089 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc045830 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.052+0000 7fcdc8e00640 1 -- 172.21.15.102:0/621830180 shutdown_connections 2024-03-25T05:37:59.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.052+0000 7fcdc8e00640 1 -- 172.21.15.102:0/621830180 wait complete. 2024-03-25T05:37:59.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7f5dbaa00640 1 -- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 msgr2=0x7f5da0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7fcdc8e00640 1 Processor -- start 2024-03-25T05:37:59.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.055+0000 7fcdc8e00640 1 -- start start 2024-03-25T05:37:59.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7f8602a00640 1 --2- 172.21.15.102:0/1343647089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0452f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f860404f810 tx=0x7f86040a80f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c1e2de672378cce server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7f8601600640 1 -- 172.21.15.102:0/1343647089 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040a8d60 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc071cc0 0x7f5da0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7f5dbaa00640 1 -- 172.21.15.102:0/1661853398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5da0003970 msgr2=0x7f5da0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5da0003970 0x7f5da0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.054+0000 7f5dbaa00640 1 -- 172.21.15.102:0/1661853398 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0c6460 con 0x7f5da00047c0 2024-03-25T05:37:59.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.056+0000 7fcdc8e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.056+0000 7f5dbb400640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5da0003970 0x7f5da0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:59.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.057+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5da00047c0 0x7f5da0004c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5da800b1e0 tx=0x7f5da00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3946fdbf625f15e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.052+0000 7f42ace00640 1 -- 172.21.15.102:0/2205865426 wait complete. 2024-03-25T05:37:59.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.058+0000 7f8601600640 1 -- 172.21.15.102:0/1343647089 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860406e040 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.058+0000 7f8601600640 1 -- 172.21.15.102:0/1343647089 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040b0640 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.058+0000 7f42ace00640 1 Processor -- start 2024-03-25T05:37:59.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.059+0000 7f42ace00640 1 -- start start 2024-03-25T05:37:59.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.060+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8004220 con 0x7f5da00047c0 2024-03-25T05:37:59.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.060+0000 7f42ace00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c0047c0 0x7f42a80c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.060+0000 7f42ace00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42a814bfa0 0x7f42a81ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.060+0000 7f42ace00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a8155a90 0x7f42a80c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.057+0000 7fcdc8e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdc4072150 0x7fcdc41618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.057+0000 7fcdc8e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdc4072550 0x7fcdc4161de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.057+0000 7fcdc8e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc41fd0b0 con 0x7fcdc4072550 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.057+0000 7fcdc8e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4162ac0 con 0x7fcdc4072150 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.057+0000 7fcdc8e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4162da0 con 0x7fcdc4070de0 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdc4072150 0x7fcdc41618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdc4072150 0x7fcdc41618a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48336/0 (socket says 172.21.15.102:48336) 2024-03-25T05:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7fcdbaa00640 1 -- 172.21.15.102:0/2524185941 learned_addr learned my addr 172.21.15.102:0/2524185941 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7fcdc3e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdc4072550 0x7fcdc4161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7fcdbaa00640 1 -- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 msgr2=0x7fcdc40c7d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7fcdbaa00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcdc4070de0 0x7fcdc40c7d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7fcdbaa00640 1 -- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdc4072550 msgr2=0x7fcdc4161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7fcdbaa00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdc4072550 0x7fcdc4161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7fcdbaa00640 1 -- 172.21.15.102:0/2524185941 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb400d8a0 con 0x7fcdc4072150 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7fcdc3e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdc4072550 0x7fcdc4161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.060+0000 7f42ace00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a814bce0 con 0x7f42a8155a90 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.060+0000 7f42ace00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80c4d90 con 0x7f428c0047c0 2024-03-25T05:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.060+0000 7f42ace00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80c3ea0 con 0x7f42a814bfa0 2024-03-25T05:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7f42a5400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42a814bfa0 0x7f42a81ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7f42a5400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42a814bfa0 0x7f42a81ece80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58014/0 (socket says 172.21.15.102:58014) 2024-03-25T05:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7f42a5400640 1 -- 172.21.15.102:0/758361768 learned_addr learned my addr 172.21.15.102:0/758361768 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.061+0000 7f42a6800640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a8155a90 0x7f42a80c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7f8603e00640 1 -- 172.21.15.102:0/1343647089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 msgr2=0x7f85fc0452f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.062+0000 7f8603e00640 1 --2- 172.21.15.102:0/1343647089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0452f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f860404f810 tx=0x7f86040a80f0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f42a5400640 1 -- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c0047c0 msgr2=0x7f42a80c3880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-25T05:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f42a5400640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c0047c0 0x7f42a80c3880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f42a5400640 1 -- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a8155a90 msgr2=0x7f42a80c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f42a5400640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a8155a90 0x7f42a80c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f42a5400640 1 -- 172.21.15.102:0/758361768 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a80c4180 con 0x7f42a814bfa0 2024-03-25T05:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f42a6800640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a8155a90 0x7f42a80c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8004380 con 0x7f5da00047c0 2024-03-25T05:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7f5dba000640 1 -- 172.21.15.102:0/1661853398 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8003830 con 0x7f5da00047c0 2024-03-25T05:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.063+0000 7fcdbaa00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdc4072150 0x7fcdc41618a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00d7d0 tx=0x7fcdac00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7fcdbbe00640 1 -- 172.21.15.102:0/2524185941 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0096a0 con 0x7fcdc4072150 2024-03-25T05:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7f8603e00640 1 -- 172.21.15.102:0/1343647089 shutdown_connections 2024-03-25T05:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7f8603e00640 1 --2- 172.21.15.102:0/1343647089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0452f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7f8603e00640 1 -- 172.21.15.102:0/1343647089 >> 172.21.15.102:0/1343647089 conn(0x7f85fc050350 msgr2=0x7f85fc050760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7fcdbbe00640 1 -- 172.21.15.102:0/2524185941 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac009800 con 0x7fcdc4072150 2024-03-25T05:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7fcdbbe00640 1 -- 172.21.15.102:0/2524185941 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac009bb0 con 0x7fcdc4072150 2024-03-25T05:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7f5dc0c00640 1 -- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5da00047c0 msgr2=0x7f5da0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.064+0000 7f5dc0c00640 1 --2- 172.21.15.102:0/1661853398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5da00047c0 0x7f5da0004c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5da800b1e0 tx=0x7f5da00057f0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.066+0000 7f5dbbe00640 1 -- 172.21.15.102:0/1661853398 reap_dead start 2024-03-25T05:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.066+0000 7f5dc0c00640 1 -- 172.21.15.102:0/1661853398 shutdown_connections 2024-03-25T05:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.066+0000 7f5dc0c00640 1 -- 172.21.15.102:0/1661853398 >> 172.21.15.102:0/1661853398 conn(0x7f5dbc0cb340 msgr2=0x7f5dbc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.066+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc4163080 con 0x7fcdc4072150 2024-03-25T05:37:59.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.066+0000 7f42a5400640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42a814bfa0 0x7f42a81ece80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42980343b0 tx=0x7f4298004700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.067+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc41f3190 con 0x7fcdc4072150 2024-03-25T05:37:59.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.067+0000 7f5dc0c00640 1 -- 172.21.15.102:0/1661853398 shutdown_connections 2024-03-25T05:37:59.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.068+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298034940 con 0x7f42a814bfa0 2024-03-25T05:37:59.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.068+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298034aa0 con 0x7f42a814bfa0 2024-03-25T05:37:59.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.068+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298034e50 con 0x7f42a814bfa0 2024-03-25T05:37:59.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.071+0000 7fcdbbe00640 1 -- 172.21.15.102:0/2524185941 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcdac009d10 con 0x7fcdc4072150 2024-03-25T05:37:59.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.072+0000 7fcdbbe00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcda006b810 0x7fcda006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.073+0000 7fcdc3400640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcda006b810 0x7fcda006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.073+0000 7fcdbbe00640 1 -- 172.21.15.102:0/2524185941 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcdac08aee0 con 0x7fcdc4072150 2024-03-25T05:37:59.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.068+0000 7f5dc0c00640 1 -- 172.21.15.102:0/1661853398 wait complete. 2024-03-25T05:37:59.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.074+0000 7fcdc3400640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcda006b810 0x7fcda006dcd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4039000 tx=0x7fcdb4034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.070+0000 7f5dc0c00640 1 Processor -- start 2024-03-25T05:37:59.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.074+0000 7f5dc0c00640 1 -- start start 2024-03-25T05:37:59.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.075+0000 7fcdc8e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7fcdc41efba0 0x7fcdc415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.075+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 --> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdc416a720 con 0x7fcdc41efba0 2024-03-25T05:37:59.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.077+0000 7f5dc0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5da00047c0 0x7f5dbc14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.077+0000 7f5dc0c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc14eeb0 0x7f5dbc150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.077+0000 7f5dbb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5da00047c0 0x7f5dbc14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.077+0000 7f5dbb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5da00047c0 0x7f5dbc14b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58016/0 (socket says 172.21.15.102:58016) 2024-03-25T05:37:59.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.078+0000 7f5dbb400640 1 -- 172.21.15.102:0/3657312530 learned_addr learned my addr 172.21.15.102:0/3657312530 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.078+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc14eeb0 0x7f5dbc150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.078+0000 7fcdc3e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7fcdc41efba0 0x7fcdc415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.065+0000 7f8603e00640 1 -- 172.21.15.102:0/1343647089 shutdown_connections 2024-03-25T05:37:59.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.067+0000 7f8603e00640 1 -- 172.21.15.102:0/1343647089 wait complete. 2024-03-25T05:37:59.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.078+0000 7f5dc0c00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dbc1510c0 0x7f5dbc1eab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.078+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a80c4460 con 0x7f42a814bfa0 2024-03-25T05:37:59.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.078+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a80c4a20 con 0x7f42a814bfa0 2024-03-25T05:37:59.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.069+0000 7f8603e00640 1 Processor -- start 2024-03-25T05:37:59.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.080+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42a8072360 con 0x7f42a814bfa0 2024-03-25T05:37:59.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.080+0000 7fcdc3e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7fcdc41efba0 0x7fcdc415fa90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.080+0000 7f8603e00640 1 -- start start 2024-03-25T05:37:59.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.081+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc153660 con 0x7f5dbc1510c0 2024-03-25T05:37:59.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.081+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc149740 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.081+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc14c2e0 con 0x7f5da00047c0 2024-03-25T05:37:59.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.082+0000 7fcdbbe00640 1 -- 172.21.15.102:0/2524185941 <== osd.2 v2:172.21.15.102:6816/3156921662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcdbc001920 con 0x7fcdc41efba0 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.086+0000 7f5dbaa00640 1 -- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5da00047c0 msgr2=0x7f5dbc14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.086+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5da00047c0 0x7f5dbc14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.086+0000 7f5dbaa00640 1 -- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dbc1510c0 msgr2=0x7f5dbc1eab70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.086+0000 7f5dbbe00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dbc1510c0 0x7f5dbc1eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.086+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dbc1510c0 0x7f5dbc1eab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.086+0000 7f5dbaa00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc151540 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.086+0000 7f5dbbe00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dbc1510c0 0x7f5dbc1eab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.087+0000 7f5dbaa00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc14eeb0 0x7f5dbc150b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5da8033000 tx=0x7f5da800d5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.087+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da802e870 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.088+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dbc14caf0 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.088+0000 7fc167600640 1 Processor -- start 2024-03-25T05:37:59.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.088+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc14bf70 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.090+0000 7f8603e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc007660 0x7f85fc035ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.090+0000 7f8603e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85fc050e70 0x7f85fc181e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.088+0000 7fc167600640 1 -- start start 2024-03-25T05:37:59.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.090+0000 7fc167600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc16006e5b0 0x7fc1600711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.090+0000 7fc167600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc16006e990 0x7fc1601567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.091+0000 7fc167600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc160072880 0x7fc16014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.091+0000 7fc167600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc160156d20 con 0x7fc160072880 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.091+0000 7fc167600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16006f910 con 0x7fc16006e5b0 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.091+0000 7fc167600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16006f350 con 0x7fc16006e990 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.091+0000 7fc164c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc16006e5b0 0x7fc1600711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.091+0000 7fc164c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc16006e5b0 0x7fc1600711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48348/0 (socket says 172.21.15.102:48348) 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.091+0000 7fc164c00640 1 -- 172.21.15.102:0/347387766 learned_addr learned my addr 172.21.15.102:0/347387766 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.092+0000 7fc164c00640 1 -- 172.21.15.102:0/347387766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc16006e990 msgr2=0x7fc1601567e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.092+0000 7fc164c00640 1 --2- 172.21.15.102:0/347387766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc16006e990 0x7fc1601567e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.092+0000 7fc164c00640 1 -- 172.21.15.102:0/347387766 >> v2:172.21.15.102:3300/0 conn(0x7fc160072880 msgr2=0x7fc16014f9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.092+0000 7fc164c00640 1 --2- 172.21.15.102:0/347387766 >> v2:172.21.15.102:3300/0 conn(0x7fc160072880 0x7fc16014f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.092+0000 7fc164c00640 1 -- 172.21.15.102:0/347387766 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16006f630 con 0x7fc16006e5b0 2024-03-25T05:37:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.092+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da80044f0 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.092+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da802ec10 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.094+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5dbc0724b0 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.094+0000 7fc18fe00640 1 Processor -- start 2024-03-25T05:37:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.085+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f429804f660 con 0x7f42a814bfa0 2024-03-25T05:37:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.094+0000 7fc18fe00640 1 -- start start 2024-03-25T05:37:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f8602000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85fc050e70 0x7f85fc181e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f429e000640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f428806b8e0 0x7f428806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f8602000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85fc050e70 0x7f85fc181e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58028/0 (socket says 172.21.15.102:58028) 2024-03-25T05:37:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f8603e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f42980b52e0 con 0x7f42a814bfa0 2024-03-25T05:37:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f8609800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f42a5e00640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f428806b8e0 0x7f428806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7fc164c00640 1 --2- 172.21.15.102:0/347387766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16006e5b0 0x7fc1600711d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1600679d0 tx=0x7fc15402b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa2cc55e19f2e2eb server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f429e000640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f4288075050 0x7f4288077490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 --> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4288077b60 con 0x7f4288075050 2024-03-25T05:37:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.096+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42980b5690 con 0x7f42a814bfa0 2024-03-25T05:37:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.096+0000 7f42a5e00640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f428806b8e0 0x7f428806dda0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42a000bd60 tx=0x7f42a000b510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.096+0000 7fc18fe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1880476c0 0x7fc18804e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.096+0000 7fc18fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880e0130 0x7fc1880e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.097+0000 7fc18fe00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18800abf0 con 0x7fc1880d7090 2024-03-25T05:37:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.097+0000 7fc18fe00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18804d320 con 0x7fc1880476c0 2024-03-25T05:37:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.097+0000 7fc18fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18804e1c0 con 0x7fc1880e0130 2024-03-25T05:37:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.097+0000 7f42a6800640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f4288075050 0x7f4288077490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.095+0000 7f8609800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0de4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48352/0 (socket says 172.21.15.102:48352) 2024-03-25T05:37:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.096+0000 7f8602a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc007660 0x7f85fc035ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.096+0000 7f8602000640 1 -- 172.21.15.102:0/619774404 learned_addr learned my addr 172.21.15.102:0/619774404 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.098+0000 7fc18ea00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc1880d7090 0x7fc18804edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60980/0 (socket says 172.21.15.102:60980) 2024-03-25T05:37:59.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.098+0000 7fc18ea00640 1 -- 172.21.15.102:0/2761176202 learned_addr learned my addr 172.21.15.102:0/2761176202 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:59.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.098+0000 7fc18f400640 1 --2- 172.21.15.102:0/2761176202 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880e0130 0x7fc1880e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.098+0000 7fc18e000640 1 --2- 172.21.15.102:0/2761176202 >> v2:172.21.15.102:3300/0 conn(0x7fc1880476c0 0x7fc18804e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.098+0000 7f8603e00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc0de0c0 con 0x7f85fc007660 2024-03-25T05:37:59.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.098+0000 7f8603e00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc1816e0 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.098+0000 7f8603e00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc049d90 con 0x7f85fc050e70 2024-03-25T05:37:59.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7fc18e000640 1 -- 172.21.15.102:0/2761176202 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880e0130 msgr2=0x7fc1880e05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7fc18e000640 1 --2- 172.21.15.102:0/2761176202 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880e0130 0x7fc1880e05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7fc18e000640 1 -- 172.21.15.102:0/2761176202 >> v1:172.21.15.102:6789/0 conn(0x7fc1880d7090 legacy=0x7fc18804edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7fc18e000640 1 -- 172.21.15.102:0/2761176202 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18804d060 con 0x7fc1880476c0 2024-03-25T05:37:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7f8609800640 1 -- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85fc050e70 msgr2=0x7f85fc181e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7f8609800640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85fc050e70 0x7f85fc181e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.100+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5da8005990 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7f8609800640 1 -- 172.21.15.102:0/619774404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc007660 msgr2=0x7f85fc035ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7f8609800640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc007660 0x7f85fc035ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7f8609800640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860406a540 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.099+0000 7f8602a00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc007660 0x7f85fc035ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.100+0000 7f8609800640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0de4d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b410 tx=0x7f85f000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.100+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0011830 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.100+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f00119b0 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.100+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0011d60 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.100+0000 7f8603e00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc0ccb10 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.101+0000 7fc18e000640 1 --2- 172.21.15.102:0/2761176202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc18804e6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc180009a00 tx=0x7fc18002baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541b51424a7be198 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.101+0000 7fc15f400640 1 -- 172.21.15.102:0/347387766 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154030890 con 0x7fc16006e5b0 2024-03-25T05:37:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.101+0000 7fc18d600640 1 -- 172.21.15.102:0/2761176202 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18002d650 con 0x7fc1880476c0 2024-03-25T05:37:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.101+0000 7fc18d600640 1 -- 172.21.15.102:0/2761176202 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18002d7b0 con 0x7fc1880476c0 2024-03-25T05:37:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.101+0000 7f8603e00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc049fe0 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.102+0000 7fc18fe00640 1 -- 172.21.15.102:0/2761176202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 msgr2=0x7fc18804e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.102+0000 7fc18d600640 1 -- 172.21.15.102:0/2761176202 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18002d650 con 0x7fc1880476c0 2024-03-25T05:37:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.102+0000 7fc18fe00640 1 --2- 172.21.15.102:0/2761176202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc18804e6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc180009a00 tx=0x7fc18002baa0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.103+0000 7f8603e00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85fc046470 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.103+0000 7fc18fe00640 1 -- 172.21.15.102:0/2761176202 shutdown_connections 2024-03-25T05:37:59.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.103+0000 7fc18fe00640 1 --2- 172.21.15.102:0/2761176202 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880e0130 0x7fc1880e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.103+0000 7fc18fe00640 1 --2- 172.21.15.102:0/2761176202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc18804e6a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.103+0000 7fc18fe00640 1 -- 172.21.15.102:0/2761176202 >> 172.21.15.102:0/2761176202 conn(0x7fc18800e6a0 msgr2=0x7fc188009d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.104+0000 7fc18fe00640 1 -- 172.21.15.102:0/2761176202 shutdown_connections 2024-03-25T05:37:59.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.104+0000 7fc18fe00640 1 -- 172.21.15.102:0/2761176202 wait complete. 2024-03-25T05:37:59.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.102+0000 7f42a6800640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f4288075050 0x7f4288077490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.106+0000 7f5db3400640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5d9c06b810 0x7f5d9c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.105+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85f001a400 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.106+0000 7fc15f400640 1 -- 172.21.15.102:0/347387766 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1540309f0 con 0x7fc16006e5b0 2024-03-25T05:37:59.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.106+0000 7fc15f400640 1 -- 172.21.15.102:0/347387766 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154030d80 con 0x7fc16006e5b0 2024-03-25T05:37:59.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.107+0000 7fc167600640 1 -- 172.21.15.102:0/347387766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16006e5b0 msgr2=0x7fc1600711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.107+0000 7fc167600640 1 --2- 172.21.15.102:0/347387766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16006e5b0 0x7fc1600711d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1600679d0 tx=0x7fc15402b9d0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.107+0000 7fc18fe00640 1 Processor -- start 2024-03-25T05:37:59.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.107+0000 7fc18fe00640 1 -- start start 2024-03-25T05:37:59.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.106+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5da80ac050 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.107+0000 7f5db3400640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f5d9c074f80 0x7f5d9c0773c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.107+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d9c077a90 con 0x7f5d9c074f80 2024-03-25T05:37:59.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.107+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5da80ac400 con 0x7f5dbc14eeb0 2024-03-25T05:37:59.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.108+0000 7f5dbb400640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5d9c06b810 0x7f5d9c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.108+0000 7f85faa00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f85e406b8e0 0x7f85e406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.109+0000 7f8602a00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f85e406b8e0 0x7f85e406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc167600640 1 -- 172.21.15.102:0/347387766 shutdown_connections 2024-03-25T05:37:59.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc167600640 1 --2- 172.21.15.102:0/347387766 >> v2:172.21.15.102:3300/0 conn(0x7fc160072880 0x7fc16014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc167600640 1 --2- 172.21.15.102:0/347387766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc16006e990 0x7fc1601567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc167600640 1 --2- 172.21.15.102:0/347387766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16006e5b0 0x7fc1600711d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc167600640 1 -- 172.21.15.102:0/347387766 >> 172.21.15.102:0/347387766 conn(0x7fc1600c7dd0 msgr2=0x7fc1600c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc18fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc1880d9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc167600640 1 -- 172.21.15.102:0/347387766 shutdown_connections 2024-03-25T05:37:59.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7fc167600640 1 -- 172.21.15.102:0/347387766 wait complete. 2024-03-25T05:37:59.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.111+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== osd.0 v2:172.21.15.102:6800/1923769414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4288077b60 con 0x7f4288075050 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.111+0000 7fc18ea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc1880d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.111+0000 7fc18ea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc1880d9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56450/0 (socket says 172.21.15.102:56450) 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.111+0000 7fc18ea00640 1 -- 172.21.15.102:0/2042605484 learned_addr learned my addr 172.21.15.102:0/2042605484 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.111+0000 7fc18fe00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880d7090 0x7fc188173960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.111+0000 7fc18e000640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880d7090 0x7fc188173960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.112+0000 7fc18fe00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1880e0130 0x7fc188047e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.112+0000 7fc18f400640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1880e0130 0x7fc188047e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.112+0000 7fc18fe00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880d7f30 con 0x7fc1880476c0 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.112+0000 7fc18fe00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880d75d0 con 0x7fc1880e0130 2024-03-25T05:37:59.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.113+0000 7fc18fe00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc188173110 con 0x7fc1880d7090 2024-03-25T05:37:59.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7f5dbbe00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f5d9c074f80 0x7f5d9c0773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.113+0000 7fc167600640 1 Processor -- start 2024-03-25T05:37:59.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.113+0000 7f5dbb400640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5d9c06b810 0x7f5d9c06dcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5db400a470 tx=0x7f5db4006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.110+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f85f0089d50 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.114+0000 7f85faa00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7f85e4075050 0x7f85e4077490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.114+0000 7fc167600640 1 -- start start 2024-03-25T05:37:59.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.114+0000 7fc18ea00640 1 -- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880d7090 msgr2=0x7fc188173960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.114+0000 7fc18ea00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880d7090 0x7fc188173960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.114+0000 7fc18ea00640 1 -- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1880e0130 msgr2=0x7fc188047e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.114+0000 7fc18ea00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1880e0130 0x7fc188047e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.114+0000 7fc18ea00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009400 con 0x7fc1880476c0 2024-03-25T05:37:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7fc167600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc16006e5b0 0x7fc160145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7fc167600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc16006e990 0x7fc16014b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7fc167600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc160072880 0x7fc16014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7fc167600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc160157e50 con 0x7fc16006e990 2024-03-25T05:37:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7fc167600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc160158730 con 0x7fc160072880 2024-03-25T05:37:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7fc167600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc160158fd0 con 0x7fc16006e5b0 2024-03-25T05:37:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7fc18ea00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc1880d9670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00c780 tx=0x7fc17c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7f8602a00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f85e406b8e0 0x7f85e406dda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00dd30 tx=0x7f86040ac000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85e4077b60 con 0x7f85e4075050 2024-03-25T05:37:59.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.116+0000 7f8602000640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7f85e4075050 0x7f85e4077490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.117+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0058b0 con 0x7fc1880476c0 2024-03-25T05:37:59.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.117+0000 7fc18e000640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1880d7090 0x7fc188173960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.117+0000 7f5dbbe00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f5d9c074f80 0x7f5d9c0773c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.117+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c005a10 con 0x7fc1880476c0 2024-03-25T05:37:59.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.118+0000 7fc18fe00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1880d7870 con 0x7fc1880476c0 2024-03-25T05:37:59.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.118+0000 7fc18fe00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1881733f0 con 0x7fc1880476c0 2024-03-25T05:37:59.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.119+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85f0037070 con 0x7f85fc0d4bf0 2024-03-25T05:37:59.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.119+0000 7fc18fe00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc18800a9a0 con 0x7fc1880476c0 2024-03-25T05:37:59.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.119+0000 7f8602000640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7f85e4075050 0x7f85e4077490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.119+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== osd.1 v2:172.21.15.102:6818/3411688389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5d9c077a90 con 0x7f5d9c074f80 2024-03-25T05:37:59.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.121+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c005e20 con 0x7fc1880476c0 2024-03-25T05:37:59.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.123+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc16006e990 0x7fc16014b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.123+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== osd.5 v2:172.21.15.187:6820/2672437380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f85e4077b60 con 0x7f85e4075050 2024-03-25T05:37:59.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.123+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc16006e990 0x7fc16014b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56454/0 (socket says 172.21.15.102:56454) 2024-03-25T05:37:59.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.123+0000 7fc15fe00640 1 -- 172.21.15.102:0/642075250 learned_addr learned my addr 172.21.15.102:0/642075250 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc15fe00640 1 -- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc16006e5b0 msgr2=0x7fc160145f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-25T05:37:59.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc15fe00640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc16006e5b0 0x7fc160145f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc15fe00640 1 -- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc160072880 msgr2=0x7fc16014ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.123+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc17c007070 con 0x7fc1880476c0 2024-03-25T05:37:59.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc165600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc160072880 0x7fc16014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc186a00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc17006b840 0x7fc17006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc17c08a1a0 con 0x7fc1880476c0 2024-03-25T05:37:59.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc186a00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fc170074f30 0x7fc170077370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc15fe00640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc160072880 0x7fc16014ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.125+0000 7fc15fe00640 1 -- 172.21.15.102:0/642075250 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540094d0 con 0x7fc16006e990 2024-03-25T05:37:59.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.125+0000 7fc165600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc160072880 0x7fc16014ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.124+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc170077a40 con 0x7fc170074f30 2024-03-25T05:37:59.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.125+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc17c08a550 con 0x7fc1880476c0 2024-03-25T05:37:59.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.125+0000 7fc18f400640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fc170074f30 0x7fc170077370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.125+0000 7f9313800640 1 Processor -- start 2024-03-25T05:37:59.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.125+0000 7f9313800640 1 -- start start 2024-03-25T05:37:59.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.125+0000 7fc18e000640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc17006b840 0x7fc17006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.126+0000 7fc18f400640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fc170074f30 0x7fc170077370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.126+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 --> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdc406f600 con 0x7fcdc41efba0 2024-03-25T05:37:59.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.126+0000 7fc18e000640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc17006b840 0x7fc17006dd00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc180036000 tx=0x7fc180008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.127+0000 7fc15fe00640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc16006e990 0x7fc16014b540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00b3e0 tx=0x7fc14c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.127+0000 7fcdbbe00640 1 -- 172.21.15.102:0/2524185941 <== osd.2 v2:172.21.15.102:6816/3156921662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdbc001e10 con 0x7fcdc41efba0 2024-03-25T05:37:59.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.127+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== osd.6 v2:172.21.15.187:6808/1811146406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc170077a40 con 0x7fc170074f30 2024-03-25T05:37:59.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.127+0000 7fc15cc00640 1 -- 172.21.15.102:0/642075250 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c011830 con 0x7fc16006e990 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.127+0000 7fc15cc00640 1 -- 172.21.15.102:0/642075250 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c0119b0 con 0x7fc16006e990 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.127+0000 7fc15cc00640 1 -- 172.21.15.102:0/642075250 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c011d60 con 0x7fc16006e990 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.128+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1601589f0 con 0x7fc16006e990 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.128+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc160155380 con 0x7fc16006e990 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.128+0000 7f9313800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.128+0000 7f9313800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c0718b0 con 0x7f930c0c73c0 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.128+0000 7f9313800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c071e70 con 0x7f930c154110 2024-03-25T05:37:59.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.128+0000 7f9313800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0c29e0 con 0x7f930c0c7830 2024-03-25T05:37:59.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7f9311800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7fcdc41efba0 msgr2=0x7fcdc415fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7fcdc8e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7fcdc41efba0 0x7fcdc415fa90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7f9311800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58062/0 (socket says 172.21.15.102:58062) 2024-03-25T05:37:59.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7f9311800640 1 -- 172.21.15.102:0/1770464250 learned_addr learned my addr 172.21.15.102:0/1770464250 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7f9311800640 1 -- 172.21.15.102:0/1770464250 >> v1:172.21.15.187:6789/0 conn(0x7f930c154110 legacy=0x7f930c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7f9311800640 1 -- 172.21.15.102:0/1770464250 >> v1:172.21.15.102:6789/0 conn(0x7f930c0c73c0 legacy=0x7f930c06e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcda006b810 msgr2=0x7fcda006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7fcdc8e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcda006b810 0x7fcda006dcd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4039000 tx=0x7fcdb4034000 comp rx=0 tx=0).stop 2024-03-25T05:37:59.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdc4072150 msgr2=0x7fcdc41618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7fcdc8e00640 1 --2- 172.21.15.102:0/2524185941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdc4072150 0x7fcdc41618a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00d7d0 tx=0x7fcdac00dc90 comp rx=0 tx=0).stop 2024-03-25T05:37:59.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.129+0000 7fcdc3e00640 1 -- 172.21.15.102:0/2524185941 reap_dead start 2024-03-25T05:37:59.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.130+0000 7f9311800640 1 -- 172.21.15.102:0/1770464250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c15a5b0 con 0x7f930c0c7830 2024-03-25T05:37:59.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.130+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 shutdown_connections 2024-03-25T05:37:59.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.130+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 >> 172.21.15.102:0/2524185941 conn(0x7fcdc40cb340 msgr2=0x7fcdc40c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.132+0000 7f9311800640 1 --2- 172.21.15.102:0/1770464250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c072300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92f80098a0 tx=0x7f92f802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89581407c5b7f917 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.132+0000 7f930b400640 1 -- 172.21.15.102:0/1770464250 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8030840 con 0x7f930c0c7830 2024-03-25T05:37:59.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.132+0000 7f930b400640 1 -- 172.21.15.102:0/1770464250 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80309a0 con 0x7f930c0c7830 2024-03-25T05:37:59.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.133+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 shutdown_connections 2024-03-25T05:37:59.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.133+0000 7f930b400640 1 -- 172.21.15.102:0/1770464250 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8030d30 con 0x7f930c0c7830 2024-03-25T05:37:59.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.133+0000 7fcdc8e00640 1 -- 172.21.15.102:0/2524185941 wait complete. 2024-03-25T05:37:59.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.133+0000 7fa96cc00640 1 Processor -- start 2024-03-25T05:37:59.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.134+0000 7f9313800640 1 -- 172.21.15.102:0/1770464250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 msgr2=0x7f930c072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.134+0000 7f9313800640 1 --2- 172.21.15.102:0/1770464250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c072300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92f80098a0 tx=0x7f92f802b980 comp rx=0 tx=0).stop 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7f9313800640 1 -- 172.21.15.102:0/1770464250 shutdown_connections 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7f9313800640 1 --2- 172.21.15.102:0/1770464250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c072300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7f9313800640 1 -- 172.21.15.102:0/1770464250 >> 172.21.15.102:0/1770464250 conn(0x7f930c0c7dd0 msgr2=0x7f930c0c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7f9313800640 1 -- 172.21.15.102:0/1770464250 shutdown_connections 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.133+0000 7fa96cc00640 1 -- start start 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7fa96cc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa968158270 0x7fa968072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7fa96cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96806f470 0x7fa96815dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7fa96cc00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680c5860 con 0x7fa96815e500 2024-03-25T05:37:59.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7fa96cc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa968162480 con 0x7fa968158270 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7fa96cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680c5580 con 0x7fa96806f470 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.136+0000 7fa966a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96806f470 0x7fa96815dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.136+0000 7fa966a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96806f470 0x7fa96815dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58076/0 (socket says 172.21.15.102:58076) 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.136+0000 7fa966a00640 1 -- 172.21.15.102:0/2937401526 learned_addr learned my addr 172.21.15.102:0/2937401526 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.132+0000 7fc15cc00640 1 -- 172.21.15.102:0/642075250 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc14c01a400 con 0x7fc16006e990 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.134+0000 7fc15cc00640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc14006b860 0x7fc14006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.134+0000 7fc15cc00640 1 -- 172.21.15.102:0/642075250 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc14c08a640 con 0x7fc16006e990 2024-03-25T05:37:59.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.135+0000 7f9313800640 1 -- 172.21.15.102:0/1770464250 wait complete. 2024-03-25T05:37:59.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.137+0000 7fa966a00640 1 -- 172.21.15.102:0/2937401526 >> v2:172.21.15.187:3300/0 conn(0x7fa968158270 msgr2=0x7fa968072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.137+0000 7fc167600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fc160158bc0 0x7fc160159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.137+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 --> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc16014ec90 con 0x7fc160158bc0 2024-03-25T05:37:59.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.137+0000 7fa967400640 1 --2- 172.21.15.102:0/2937401526 >> v2:172.21.15.187:3300/0 conn(0x7fa968158270 0x7fa968072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.137+0000 7fa966000640 1 -- 172.21.15.102:0/2937401526 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469486605 0 0) 0x7fa9680c5860 con 0x7fa96815e500 2024-03-25T05:37:59.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.138+0000 7fa966a00640 1 --2- 172.21.15.102:0/2937401526 >> v2:172.21.15.187:3300/0 conn(0x7fa968158270 0x7fa968072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.138+0000 7fa966a00640 1 -- 172.21.15.102:0/2937401526 >> v1:172.21.15.102:6789/0 conn(0x7fa96815e500 legacy=0x7fa968071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.138+0000 7fa966a00640 1 -- 172.21.15.102:0/2937401526 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9681616c0 con 0x7fa96806f470 2024-03-25T05:37:59.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.138+0000 7f9313800640 1 Processor -- start 2024-03-25T05:37:59.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.138+0000 7fa967400640 1 --2- 172.21.15.102:0/2937401526 >> v2:172.21.15.187:3300/0 conn(0x7fa968158270 0x7fa968072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.139+0000 7fc164c00640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc14006b860 0x7fc14006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.139+0000 7f9313800640 1 -- start start 2024-03-25T05:37:59.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.139+0000 7fc164c00640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc14006b860 0x7fc14006dd20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc154036000 tx=0x7fc15403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.140+0000 7f9313800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c0c73c0 0x7f930c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.140+0000 7f9313800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.140+0000 7f9313800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930c154110 0x7f930c0c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.140+0000 7f9313800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1f3f00 con 0x7f930c0c73c0 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.140+0000 7f9313800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1f2f10 con 0x7f930c154110 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.140+0000 7f9313800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1f3a70 con 0x7f930c0c7830 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.142+0000 7f930be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.142+0000 7f9311800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930c154110 0x7f930c0c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.142+0000 7f9311800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930c154110 0x7f930c0c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48400/0 (socket says 172.21.15.102:48400) 2024-03-25T05:37:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.142+0000 7f9311800640 1 -- 172.21.15.102:0/3317491178 learned_addr learned my addr 172.21.15.102:0/3317491178 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.143+0000 7fa966a00640 1 --2- 172.21.15.102:0/2937401526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96806f470 0x7fa96815dfc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa958009870 tx=0x7fa95802ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=604552f0cd7cb603 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.143+0000 7f9310e00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c0c73c0 0x7f930c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.143+0000 7f9311800640 1 -- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 msgr2=0x7f930c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.143+0000 7f9311800640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.143+0000 7f9311800640 1 -- 172.21.15.102:0/3317491178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c0c73c0 msgr2=0x7f930c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7f9311800640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c0c73c0 0x7f930c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.143+0000 7fa966000640 1 -- 172.21.15.102:0/2937401526 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95802f830 con 0x7fa96806f470 2024-03-25T05:37:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7fc165600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fc160158bc0 0x7fc160159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7f9311800640 1 -- 172.21.15.102:0/3317491178 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f80094d0 con 0x7f930c154110 2024-03-25T05:37:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7f930be00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930c0c7830 0x7f930c0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7f9310e00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c0c73c0 0x7f930c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7fa966000640 1 -- 172.21.15.102:0/2937401526 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95802f990 con 0x7fa96806f470 2024-03-25T05:37:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7fc165600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fc160158bc0 0x7fc160159440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.145+0000 7f9311800640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930c154110 0x7f930c0c3590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f92f80098a0 tx=0x7f92f8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.145+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8039da0 con 0x7f930c154110 2024-03-25T05:37:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.145+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f8043400 con 0x7f930c154110 2024-03-25T05:37:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.145+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8043790 con 0x7f930c154110 2024-03-25T05:37:59.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.146+0000 7fc15cc00640 1 -- 172.21.15.102:0/642075250 <== osd.4 v2:172.21.15.187:6816/2431545666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc16014ec90 con 0x7fc160158bc0 2024-03-25T05:37:59.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.146+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c0c53c0 con 0x7f930c154110 2024-03-25T05:37:59.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.147+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c1f3420 con 0x7f930c154110 2024-03-25T05:37:59.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.144+0000 7fa966000640 1 -- 172.21.15.102:0/2937401526 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95802fd20 con 0x7fa96806f470 2024-03-25T05:37:59.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.148+0000 7fa96cc00640 1 -- 172.21.15.102:0/2937401526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96806f470 msgr2=0x7fa96815dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.148+0000 7fa96cc00640 1 --2- 172.21.15.102:0/2937401526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96806f470 0x7fa96815dfc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa958009870 tx=0x7fa95802ba10 comp rx=0 tx=0).stop 2024-03-25T05:37:59.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.149+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f930c071b00 con 0x7f930c154110 2024-03-25T05:37:59.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 --> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42a8072080 con 0x7f4288075050 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7fa96cc00640 1 -- 172.21.15.102:0/2937401526 shutdown_connections 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7fa96cc00640 1 --2- 172.21.15.102:0/2937401526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96806f470 0x7fa96815dfc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7fa96cc00640 1 --2- 172.21.15.102:0/2937401526 >> v2:172.21.15.187:3300/0 conn(0x7fa968158270 0x7fa968072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7fa96cc00640 1 -- 172.21.15.102:0/2937401526 >> 172.21.15.102:0/2937401526 conn(0x7fa9680cb340 msgr2=0x7fa9680cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7fa96cc00640 1 -- 172.21.15.102:0/2937401526 shutdown_connections 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f92f80438f0 con 0x7f930c154110 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.152+0000 7f9308c00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f92ec06b840 0x7f92ec06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.153+0000 7f9310e00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f92ec06b840 0x7f92ec06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.153+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f92f803e070 con 0x7f930c154110 2024-03-25T05:37:59.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.151+0000 7fa96cc00640 1 -- 172.21.15.102:0/2937401526 wait complete. 2024-03-25T05:37:59.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.154+0000 7f9310e00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f92ec06b840 0x7f92ec06dd00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9304001cd0 tx=0x7f9304009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.154+0000 7fa96cc00640 1 Processor -- start 2024-03-25T05:37:59.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.154+0000 7fa96cc00640 1 -- start start 2024-03-25T05:37:59.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.154+0000 7f9308c00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f92ec075c50 0x7f92ec0780f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.154+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 --> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92ec0787c0 con 0x7f92ec075c50 2024-03-25T05:37:59.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.154+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92f807b820 con 0x7f930c154110 2024-03-25T05:37:59.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.154+0000 7f930be00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f92ec075c50 0x7f92ec0780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.156+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 --> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5dbc072210 con 0x7f5d9c074f80 2024-03-25T05:37:59.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.156+0000 7f429e000640 1 -- 172.21.15.102:0/758361768 <== osd.0 v2:172.21.15.102:6800/1923769414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4294005af0 con 0x7f4288075050 2024-03-25T05:37:59.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.156+0000 7fa96cc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa96806f470 0x7fa96813f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.156+0000 7fa967400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa96806f470 0x7fa96813f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.156+0000 7fa967400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa96806f470 0x7fa96813f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48406/0 (socket says 172.21.15.102:48406) 2024-03-25T05:37:59.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.157+0000 7f5db3400640 1 -- 172.21.15.102:0/3657312530 <== osd.1 v2:172.21.15.102:6818/3411688389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5dac0098d0 con 0x7f5d9c074f80 2024-03-25T05:37:59.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.157+0000 7fa967400640 1 -- 172.21.15.102:0/1913274274 learned_addr learned my addr 172.21.15.102:0/1913274274 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.157+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f4288075050 msgr2=0x7f4288077490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.157+0000 7f42ace00640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f4288075050 0x7f4288077490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.157+0000 7fa96cc00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa968158270 0x7fa968160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.157+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f5d9c074f80 msgr2=0x7f5d9c0773c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.157+0000 7f5dc0c00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f5d9c074f80 0x7f5d9c0773c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5d9c06b810 msgr2=0x7f5d9c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7fa96cc00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96815e500 0x7fa968160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f428806b8e0 msgr2=0x7f428806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f42ace00640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f428806b8e0 0x7f428806dda0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42a000bd60 tx=0x7f42a000b510 comp rx=0 tx=0).stop 2024-03-25T05:37:59.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42a814bfa0 msgr2=0x7f42a81ece80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f42ace00640 1 --2- 172.21.15.102:0/758361768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42a814bfa0 0x7f42a81ece80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42980343b0 tx=0x7f4298004700 comp rx=0 tx=0).stop 2024-03-25T05:37:59.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f42a6800640 1 -- 172.21.15.102:0/758361768 reap_dead start 2024-03-25T05:37:59.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.155+0000 7f930be00640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f92ec075c50 0x7f92ec0780f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f5dc0c00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5d9c06b810 0x7f5d9c06dcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5db400a470 tx=0x7f5db4006040 comp rx=0 tx=0).stop 2024-03-25T05:37:59.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc14eeb0 msgr2=0x7f5dbc150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f5dc0c00640 1 --2- 172.21.15.102:0/3657312530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc14eeb0 0x7f5dbc150b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5da8033000 tx=0x7f5da800d5a0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7fa967e00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96815e500 0x7fa968160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968145530 con 0x7fa968158270 2024-03-25T05:37:59.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680c3b30 con 0x7fa96806f470 2024-03-25T05:37:59.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96813bf30 con 0x7fa96815e500 2024-03-25T05:37:59.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7fa966a00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa968158270 0x7fa968160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f5dbbe00640 1 -- 172.21.15.102:0/3657312530 reap_dead start 2024-03-25T05:37:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 shutdown_connections 2024-03-25T05:37:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.158+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 >> 172.21.15.102:0/3657312530 conn(0x7f5dbc0cb340 msgr2=0x7f5dbc073fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 shutdown_connections 2024-03-25T05:37:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 >> 172.21.15.102:0/758361768 conn(0x7f42a80c7dd0 msgr2=0x7f42a8144c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 shutdown_connections 2024-03-25T05:37:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7f42ace00640 1 -- 172.21.15.102:0/758361768 wait complete. 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 shutdown_connections 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7f5dc0c00640 1 -- 172.21.15.102:0/3657312530 wait complete. 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7fa967e00640 1 -- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa96806f470 msgr2=0x7fa96813f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7fa967e00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa96806f470 0x7fa96813f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7fa967e00640 1 -- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa968158270 msgr2=0x7fa968160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7fa967e00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa968158270 0x7fa968160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.159+0000 7fa967e00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580094d0 con 0x7fa96815e500 2024-03-25T05:37:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7fa967e00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96815e500 0x7fa968160db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa95400c440 tx=0x7fa95400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9540035f0 con 0x7fa96815e500 2024-03-25T05:37:59.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa954003750 con 0x7fa96815e500 2024-03-25T05:37:59.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954003b00 con 0x7fa96815e500 2024-03-25T05:37:59.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968144f70 con 0x7fa96815e500 2024-03-25T05:37:59.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== osd.7 v2:172.21.15.187:6800/69914825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f92ec0787c0 con 0x7f92ec075c50 2024-03-25T05:37:59.160 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:37:59.160 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-25T05:37:59.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.160+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96813c1d0 con 0x7fa96815e500 2024-03-25T05:37:59.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.162+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa968161f60 con 0x7fa96815e500 2024-03-25T05:37:59.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.164+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa954003c60 con 0x7fa96815e500 2024-03-25T05:37:59.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.165+0000 7fa95f400640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa94806b8e0 0x7fa94806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.166+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa954089a70 con 0x7fa96815e500 2024-03-25T05:37:59.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.166+0000 7fa95f400640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7fa948074fd0 0x7fa948077410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.166+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa948077ae0 con 0x7fa948074fd0 2024-03-25T05:37:59.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.167+0000 7fa967400640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa94806b8e0 0x7fa94806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.167+0000 7fa966a00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7fa948074fd0 0x7fa948077410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.169+0000 7fa967400640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa94806b8e0 0x7fa94806dda0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa960007670 tx=0x7fa960007600 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.169+0000 7fa966a00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7fa948074fd0 0x7fa948077410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.171+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa954054130 con 0x7fa96815e500 2024-03-25T05:37:59.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.171+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== osd.3 v2:172.21.15.102:6808/3429470735 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa948077ae0 con 0x7fa948074fd0 2024-03-25T05:37:59.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.178+0000 7f8603e00640 1 -- 172.21.15.102:0/619774404 --> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85fc006b80 con 0x7f85e4075050 2024-03-25T05:37:59.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.182+0000 7f85faa00640 1 -- 172.21.15.102:0/619774404 <== osd.5 v2:172.21.15.187:6820/2672437380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85e4077b60 con 0x7f85e4075050 2024-03-25T05:37:59.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.183+0000 7f85efe00640 1 -- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7f85e4075050 msgr2=0x7f85e4077490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.183+0000 7f85efe00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7f85e4075050 0x7f85e4077490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.184+0000 7fc18fe00640 1 -- 172.21.15.102:0/2042605484 --> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc18804dde0 con 0x7fc170074f30 2024-03-25T05:37:59.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.184+0000 7fc186a00640 1 -- 172.21.15.102:0/2042605484 <== osd.6 v2:172.21.15.187:6808/1811146406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc170077a40 con 0x7fc170074f30 2024-03-25T05:37:59.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 -- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fc170074f30 msgr2=0x7fc170077370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fc170074f30 0x7fc170077370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 -- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc17006b840 msgr2=0x7fc17006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc17006b840 0x7fc17006dd00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc180036000 tx=0x7fc180008030 comp rx=0 tx=0).stop 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 -- 172.21.15.102:0/2042605484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 msgr2=0x7fc1880d9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 --2- 172.21.15.102:0/2042605484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1880476c0 0x7fc1880d9670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00c780 tx=0x7fc17c00cc40 comp rx=0 tx=0).stop 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc18f400640 1 -- 172.21.15.102:0/2042605484 reap_dead start 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 -- 172.21.15.102:0/2042605484 shutdown_connections 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.189+0000 7fc17be00640 1 -- 172.21.15.102:0/2042605484 >> 172.21.15.102:0/2042605484 conn(0x7fc18800e6a0 msgr2=0x7fc1880059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.190+0000 7fc17be00640 1 -- 172.21.15.102:0/2042605484 shutdown_connections 2024-03-25T05:37:59.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.190+0000 7fc17be00640 1 -- 172.21.15.102:0/2042605484 wait complete. 2024-03-25T05:37:59.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.190+0000 7f85efe00640 1 -- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f85e406b8e0 msgr2=0x7f85e406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.190+0000 7f85efe00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f85e406b8e0 0x7f85e406dda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00dd30 tx=0x7f86040ac000 comp rx=0 tx=0).stop 2024-03-25T05:37:59.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.190+0000 7f85efe00640 1 -- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 msgr2=0x7f85fc0de4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.190+0000 7f85efe00640 1 --2- 172.21.15.102:0/619774404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85fc0d4bf0 0x7f85fc0de4d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b410 tx=0x7f85f000b8d0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.190+0000 7f8609800640 1 -- 172.21.15.102:0/619774404 reap_dead start 2024-03-25T05:37:59.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.191+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 --> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc16014f040 con 0x7fc160158bc0 2024-03-25T05:37:59.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.192+0000 7fc15cc00640 1 -- 172.21.15.102:0/642075250 <== osd.4 v2:172.21.15.187:6816/2431545666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc16014f040 con 0x7fc160158bc0 2024-03-25T05:37:59.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.195+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fc160158bc0 msgr2=0x7fc160159440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.195+0000 7fc167600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fc160158bc0 0x7fc160159440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.189 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:37:59.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-25T05:37:59.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.196+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc14006b860 msgr2=0x7fc14006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7fc167600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc14006b860 0x7fc14006dd20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc154036000 tx=0x7fc15403b040 comp rx=0 tx=0).stop 2024-03-25T05:37:59.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc16006e990 msgr2=0x7fc16014b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7fc167600640 1 --2- 172.21.15.102:0/642075250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc16006e990 0x7fc16014b540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00b3e0 tx=0x7fc14c00b8a0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7f85efe00640 1 -- 172.21.15.102:0/619774404 shutdown_connections 2024-03-25T05:37:59.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7f85efe00640 1 -- 172.21.15.102:0/619774404 >> 172.21.15.102:0/619774404 conn(0x7f85fc050350 msgr2=0x7f85fc0d3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7f85efe00640 1 -- 172.21.15.102:0/619774404 shutdown_connections 2024-03-25T05:37:59.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7f85efe00640 1 -- 172.21.15.102:0/619774404 wait complete. 2024-03-25T05:37:59.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7fc165600640 1 -- 172.21.15.102:0/642075250 reap_dead start 2024-03-25T05:37:59.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 shutdown_connections 2024-03-25T05:37:59.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.197+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 >> 172.21.15.102:0/642075250 conn(0x7fc1600c7dd0 msgr2=0x7fc1600c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.198+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 shutdown_connections 2024-03-25T05:37:59.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.198+0000 7fc167600640 1 -- 172.21.15.102:0/642075250 wait complete. 2024-03-25T05:37:59.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.201+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 --> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa968161c80 con 0x7fa948074fd0 2024-03-25T05:37:59.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.203+0000 7fa95f400640 1 -- 172.21.15.102:0/1913274274 <== osd.3 v2:172.21.15.102:6808/3429470735 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa95802f7d0 con 0x7fa948074fd0 2024-03-25T05:37:59.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.209+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7fa948074fd0 msgr2=0x7fa948077410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.209+0000 7fa96cc00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7fa948074fd0 0x7fa948077410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.210+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 --> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f930c15ab70 con 0x7f92ec075c50 2024-03-25T05:37:59.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.211+0000 7f9308c00640 1 -- 172.21.15.102:0/3317491178 <== osd.7 v2:172.21.15.187:6800/69914825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f92fc001360 con 0x7f92ec075c50 2024-03-25T05:37:59.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.212+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f92ec075c50 msgr2=0x7f92ec0780f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.212+0000 7f9313800640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f92ec075c50 0x7f92ec0780f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.213+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f92ec06b840 msgr2=0x7f92ec06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.213+0000 7f9313800640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f92ec06b840 0x7f92ec06dd00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9304001cd0 tx=0x7f9304009040 comp rx=0 tx=0).stop 2024-03-25T05:37:59.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.213+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930c154110 msgr2=0x7f930c0c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.213+0000 7f9313800640 1 --2- 172.21.15.102:0/3317491178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930c154110 0x7f930c0c3590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f92f80098a0 tx=0x7f92f8004730 comp rx=0 tx=0).stop 2024-03-25T05:37:59.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.213+0000 7f9311800640 1 -- 172.21.15.102:0/3317491178 reap_dead start 2024-03-25T05:37:59.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.214+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 shutdown_connections 2024-03-25T05:37:59.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.214+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 >> 172.21.15.102:0/3317491178 conn(0x7f930c0c7dd0 msgr2=0x7f930c1526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.214+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 shutdown_connections 2024-03-25T05:37:59.208 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:37:59.208 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-25T05:37:59.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7f9313800640 1 -- 172.21.15.102:0/3317491178 wait complete. 2024-03-25T05:37:59.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa94806b8e0 msgr2=0x7fa94806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fa94806b8e0 0x7fa94806dda0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa960007670 tx=0x7fa960007600 comp rx=0 tx=0).stop 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96815e500 msgr2=0x7fa968160db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 --2- 172.21.15.102:0/1913274274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa96815e500 0x7fa968160db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa95400c440 tx=0x7fa95400c900 comp rx=0 tx=0).stop 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa967e00640 1 -- 172.21.15.102:0/1913274274 reap_dead start 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 shutdown_connections 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 >> 172.21.15.102:0/1913274274 conn(0x7fa9680cb340 msgr2=0x7fa9680c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 shutdown_connections 2024-03-25T05:37:59.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.215+0000 7fa96cc00640 1 -- 172.21.15.102:0/1913274274 wait complete. 2024-03-25T05:37:59.224 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:37:59.225 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-25T05:37:59.228 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:37:59.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-25T05:37:59.236 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:37:59.236 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-25T05:37:59.240 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:37:59.240 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:37:59.240 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-25T05:37:59.241 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-25T05:37:59.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.510+0000 7f4fb0a00640 1 Processor -- start 2024-03-25T05:37:59.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.511+0000 7f4fb0a00640 1 -- start start 2024-03-25T05:37:59.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.513+0000 7f4fb0a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4fac06f470 0x7f4fac071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.513+0000 7f4fb0a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac0c5320 con 0x7f4fac164000 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.513+0000 7f4fb0a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac0c5600 con 0x7f4fac16aad0 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.513+0000 7f4fb0a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac169ff0 con 0x7f4fac06f470 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.513+0000 7f4fabe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4fac06f470 0x7f4fac071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.513+0000 7f4fabe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4fac06f470 0x7f4fac071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56474/0 (socket says 172.21.15.102:56474) 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.513+0000 7f4fabe00640 1 -- 172.21.15.102:0/2857105460 learned_addr learned my addr 172.21.15.102:0/2857105460 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.515+0000 7f4fabe00640 1 -- 172.21.15.102:0/2857105460 >> v1:172.21.15.187:6789/0 conn(0x7f4fac16aad0 legacy=0x7f4fac1668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.515+0000 7f4fabe00640 1 -- 172.21.15.102:0/2857105460 >> v1:172.21.15.102:6789/0 conn(0x7f4fac164000 legacy=0x7f4fac072150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:59.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.515+0000 7f4fabe00640 1 -- 172.21.15.102:0/2857105460 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac16a2d0 con 0x7f4fac06f470 2024-03-25T05:37:59.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.519+0000 7f4fabe00640 1 --2- 172.21.15.102:0/2857105460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac06f470 0x7f4fac071610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400b370 tx=0x7f4fa402cfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3598d774b4a2244 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.523+0000 7f4faa000640 1 -- 172.21.15.102:0/2857105460 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa402dd90 con 0x7f4fac06f470 2024-03-25T05:37:59.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.523+0000 7f4faa000640 1 -- 172.21.15.102:0/2857105460 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa40090d0 con 0x7f4fac06f470 2024-03-25T05:37:59.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.523+0000 7f4faa000640 1 -- 172.21.15.102:0/2857105460 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa402dd90 con 0x7f4fac06f470 2024-03-25T05:37:59.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.524+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2857105460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac06f470 msgr2=0x7f4fac071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.524+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2857105460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac06f470 0x7f4fac071610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400b370 tx=0x7f4fa402cfe0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.528+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2857105460 shutdown_connections 2024-03-25T05:37:59.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.528+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2857105460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac06f470 0x7f4fac071610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.528+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2857105460 >> 172.21.15.102:0/2857105460 conn(0x7f4fac0cb340 msgr2=0x7f4fac0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.529+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2857105460 shutdown_connections 2024-03-25T05:37:59.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.529+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2857105460 wait complete. 2024-03-25T05:37:59.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.534+0000 7f4fb0a00640 1 Processor -- start 2024-03-25T05:37:59.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.544+0000 7f4fb0a00640 1 -- start start 2024-03-25T05:37:59.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.548+0000 7f4fb0a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fac06f470 0x7f4fac06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.548+0000 7f4fb0a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac164000 0x7f4fac1f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.548+0000 7f4fb0a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fac16aad0 0x7f4fac1f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.548+0000 7f4fb0a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac1f1ab0 con 0x7f4fac164000 2024-03-25T05:37:59.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.548+0000 7f4fb0a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac1f1f20 con 0x7f4fac06f470 2024-03-25T05:37:59.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.548+0000 7f4fb0a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac1f2200 con 0x7f4fac16aad0 2024-03-25T05:37:59.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.559+0000 7f4fab400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fac06f470 0x7f4fac06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.559+0000 7f4fab400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fac06f470 0x7f4fac06eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48420/0 (socket says 172.21.15.102:48420) 2024-03-25T05:37:59.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.559+0000 7f4fab400640 1 -- 172.21.15.102:0/2297837809 learned_addr learned my addr 172.21.15.102:0/2297837809 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.561+0000 7f4fab400640 1 -- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fac16aad0 msgr2=0x7f4fac1f14d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-25T05:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.561+0000 7f4fab400640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fac16aad0 0x7f4fac1f14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.561+0000 7f4fab400640 1 -- 172.21.15.102:0/2297837809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac164000 msgr2=0x7f4fac1f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.561+0000 7f4fab400640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac164000 0x7f4fac1f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.561+0000 7f4fab400640 1 -- 172.21.15.102:0/2297837809 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa400b050 con 0x7f4fac06f470 2024-03-25T05:37:59.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.563+0000 7f4fab400640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fac06f470 0x7f4fac06eac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00b450 tx=0x7f4f9c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.566+0000 7f4fa3400640 1 -- 172.21.15.102:0/2297837809 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c011890 con 0x7f4fac06f470 2024-03-25T05:37:59.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.566+0000 7f4fa3400640 1 -- 172.21.15.102:0/2297837809 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c011a10 con 0x7f4fac06f470 2024-03-25T05:37:59.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.566+0000 7f4fa3400640 1 -- 172.21.15.102:0/2297837809 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c011dc0 con 0x7f4fac06f470 2024-03-25T05:37:59.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.566+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac1f24e0 con 0x7f4fac06f470 2024-03-25T05:37:59.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.567+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac1f2aa0 con 0x7f4fac06f470 2024-03-25T05:37:59.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.576+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac074720 con 0x7f4fac06f470 2024-03-25T05:37:59.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.586+0000 7f4fa3400640 1 -- 172.21.15.102:0/2297837809 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f9c01a400 con 0x7f4fac06f470 2024-03-25T05:37:59.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.585+0000 7fba15600640 1 Processor -- start 2024-03-25T05:37:59.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.585+0000 7fba15600640 1 -- start start 2024-03-25T05:37:59.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.587+0000 7fba15600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fba101582e0 0x7fba1015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba15600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fba100ca270 0x7fba100cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba15600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1015f030 con 0x7fba100b3560 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba15600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100c6120 con 0x7fba100ca270 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba15600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100cb3a0 con 0x7fba101582e0 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba0ea00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fba101582e0 0x7fba1015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba0ea00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fba101582e0 0x7fba1015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48426/0 (socket says 172.21.15.102:48426) 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba0ea00640 1 -- 172.21.15.102:0/1300042405 learned_addr learned my addr 172.21.15.102:0/1300042405 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba0f400640 1 --2- 172.21.15.102:0/1300042405 >> v2:172.21.15.102:3300/0 conn(0x7fba100ca270 0x7fba100cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7fba0ea00640 1 -- 172.21.15.102:0/1300042405 >> v2:172.21.15.102:3300/0 conn(0x7fba100ca270 msgr2=0x7fba100cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.589+0000 7fba0ea00640 1 --2- 172.21.15.102:0/1300042405 >> v2:172.21.15.102:3300/0 conn(0x7fba100ca270 0x7fba100cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.589+0000 7fba0ea00640 1 -- 172.21.15.102:0/1300042405 >> v1:172.21.15.187:6789/0 conn(0x7fba100b3560 legacy=0x7fba100cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.589+0000 7fba0ea00640 1 -- 172.21.15.102:0/1300042405 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100cb680 con 0x7fba101582e0 2024-03-25T05:37:59.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.589+0000 7fba0f400640 1 --2- 172.21.15.102:0/1300042405 >> v2:172.21.15.102:3300/0 conn(0x7fba100ca270 0x7fba100cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.596+0000 7fb447200640 1 Processor -- start 2024-03-25T05:37:59.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.596+0000 7fb447200640 1 -- start start 2024-03-25T05:37:59.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.597+0000 7fba0ea00640 1 --2- 172.21.15.102:0/1300042405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba101582e0 0x7fba1015eaf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fba100caa70 tx=0x7fba0802bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e6fe1a16ccf3ad5 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.597+0000 7fba0d600640 1 -- 172.21.15.102:0/1300042405 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0802cb10 con 0x7fba101582e0 2024-03-25T05:37:59.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.597+0000 7fba0d600640 1 -- 172.21.15.102:0/1300042405 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0802cc70 con 0x7fba101582e0 2024-03-25T05:37:59.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.597+0000 7fba0d600640 1 -- 172.21.15.102:0/1300042405 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0802cb10 con 0x7fba101582e0 2024-03-25T05:37:59.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.588+0000 7f4fa3400640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4f8c06b8e0 0x7f4f8c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.589+0000 7f4fa3400640 1 -- 172.21.15.102:0/2297837809 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4f9c08a870 con 0x7f4fac06f470 2024-03-25T05:37:59.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.593+0000 7f4faaa00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4f8c06b8e0 0x7f4f8c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.598+0000 7fb447200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400df7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.598+0000 7fb447200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4400dfd30 con 0x7fb440046d70 2024-03-25T05:37:59.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.598+0000 7fb447200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44004b490 con 0x7fb44004c600 2024-03-25T05:37:59.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.598+0000 7fb447200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440045fb0 con 0x7fb4400d8fb0 2024-03-25T05:37:59.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.599+0000 7fb445400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb44004c600 0x7fb440005e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34546/0 (socket says 172.21.15.102:34546) 2024-03-25T05:37:59.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.599+0000 7fb445400640 1 -- 172.21.15.102:0/417329060 learned_addr learned my addr 172.21.15.102:0/417329060 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:59.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.599+0000 7fb445e00640 1 --2- 172.21.15.102:0/417329060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400df7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.600+0000 7fb444a00640 1 -- 172.21.15.102:0/417329060 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070024346 0 0) 0x7fb44004b490 con 0x7fb44004c600 2024-03-25T05:37:59.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.600+0000 7fb444a00640 1 -- 172.21.15.102:0/417329060 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb42c003520 con 0x7fb44004c600 2024-03-25T05:37:59.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.601+0000 7fb445e00640 1 -- 172.21.15.102:0/417329060 >> v1:172.21.15.187:6789/0 conn(0x7fb44004c600 legacy=0x7fb440005e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.601+0000 7fb445e00640 1 -- 172.21.15.102:0/417329060 >> v1:172.21.15.102:6789/0 conn(0x7fb440046d70 legacy=0x7fb440045330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.601+0000 7fb445e00640 1 -- 172.21.15.102:0/417329060 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440046290 con 0x7fb4400d8fb0 2024-03-25T05:37:59.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.595+0000 7f4faaa00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4f8c06b8e0 0x7f4f8c06dda0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006fd0 tx=0x7f4f98006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.597+0000 7f4fa3400640 1 -- 172.21.15.102:0/2297837809 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4f9c054fc0 con 0x7f4fac06f470 2024-03-25T05:37:59.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 -- 172.21.15.102:0/1300042405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba101582e0 msgr2=0x7fba1015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 --2- 172.21.15.102:0/1300042405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba101582e0 0x7fba1015eaf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fba100caa70 tx=0x7fba0802bf70 comp rx=0 tx=0).stop 2024-03-25T05:37:59.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 -- 172.21.15.102:0/1300042405 shutdown_connections 2024-03-25T05:37:59.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 --2- 172.21.15.102:0/1300042405 >> v2:172.21.15.102:3300/0 conn(0x7fba100ca270 0x7fba100cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 --2- 172.21.15.102:0/1300042405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba101582e0 0x7fba1015eaf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 -- 172.21.15.102:0/1300042405 >> 172.21.15.102:0/1300042405 conn(0x7fba1006b910 msgr2=0x7fba1006bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fb445e00640 1 --2- 172.21.15.102:0/417329060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400df7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4380097d0 tx=0x7fb43802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f23488f2e54d9fc server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 -- 172.21.15.102:0/1300042405 shutdown_connections 2024-03-25T05:37:59.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fba15600640 1 -- 172.21.15.102:0/1300042405 wait complete. 2024-03-25T05:37:59.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fb444a00640 1 -- 172.21.15.102:0/417329060 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438030610 con 0x7fb4400d8fb0 2024-03-25T05:37:59.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fb444a00640 1 -- 172.21.15.102:0/417329060 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438030770 con 0x7fb4400d8fb0 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.603+0000 7fb444a00640 1 -- 172.21.15.102:0/417329060 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438030b40 con 0x7fb4400d8fb0 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.604+0000 7fb447200640 1 -- 172.21.15.102:0/417329060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 msgr2=0x7fb4400df7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.604+0000 7fb447200640 1 --2- 172.21.15.102:0/417329060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400df7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4380097d0 tx=0x7fb43802b960 comp rx=0 tx=0).stop 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.604+0000 7fb447200640 1 -- 172.21.15.102:0/417329060 shutdown_connections 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.604+0000 7fb447200640 1 --2- 172.21.15.102:0/417329060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400df7f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.604+0000 7fb447200640 1 -- 172.21.15.102:0/417329060 >> 172.21.15.102:0/417329060 conn(0x7fb440050180 msgr2=0x7fb440050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.604+0000 7fb447200640 1 -- 172.21.15.102:0/417329060 shutdown_connections 2024-03-25T05:37:59.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.605+0000 7fb447200640 1 -- 172.21.15.102:0/417329060 wait complete. 2024-03-25T05:37:59.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.614+0000 7fba15600640 1 Processor -- start 2024-03-25T05:37:59.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.614+0000 7fba15600640 1 -- start start 2024-03-25T05:37:59.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.609+0000 7fb447200640 1 Processor -- start 2024-03-25T05:37:59.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7f99d5000640 1 Processor -- start 2024-03-25T05:37:59.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7fb447200640 1 -- start start 2024-03-25T05:37:59.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.617+0000 7fb447200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb440046d70 0x7fb4400def70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.618+0000 7fb447200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb44004c600 0x7fb4400055a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7fba15600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba100b3560 0x7fba10148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7fba15600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba100ca270 0x7fba1013e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7fba15600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba101582e0 0x7fba100b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7fba15600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba10145240 con 0x7fba101582e0 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7fba15600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100c46d0 con 0x7fba100b3560 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.616+0000 7fba15600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba10149570 con 0x7fba100ca270 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7fba0f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba101582e0 0x7fba100b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7fba0ea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba100b3560 0x7fba10148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7fba0f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba101582e0 0x7fba100b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56508/0 (socket says 172.21.15.102:56508) 2024-03-25T05:37:59.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7fba0f400640 1 -- 172.21.15.102:0/3214316967 learned_addr learned my addr 172.21.15.102:0/3214316967 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.617+0000 7f99d5000640 1 -- start start 2024-03-25T05:37:59.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.618+0000 7f99d5000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99c80e0490 0x7f99c8039e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fba0ea00640 1 -- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba100ca270 msgr2=0x7fba1013e250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-25T05:37:59.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fba0ea00640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba100ca270 0x7fba1013e250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fba0ea00640 1 -- 172.21.15.102:0/3214316967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba101582e0 msgr2=0x7fba100b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fba0ea00640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba101582e0 0x7fba100b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fba0ea00640 1 -- 172.21.15.102:0/3214316967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009b30 con 0x7fba100b3560 2024-03-25T05:37:59.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fba0f400640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba101582e0 0x7fba100b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:59.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7fb445e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb440046d70 0x7fb4400def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fb445e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb440046d70 0x7fb4400def70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56494/0 (socket says 172.21.15.102:56494) 2024-03-25T05:37:59.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fb445e00640 1 -- 172.21.15.102:0/567313312 learned_addr learned my addr 172.21.15.102:0/567313312 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7fb445400640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb44004c600 0x7fb4400055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.618+0000 7f99d5000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c803a4b0 con 0x7f99c804ffd0 2024-03-25T05:37:59.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7f99d5000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c804ef30 con 0x7f99c80d9250 2024-03-25T05:37:59.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7f99d5000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c804f210 con 0x7f99c80e0490 2024-03-25T05:37:59.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.621+0000 7fba0ea00640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba100b3560 0x7fba10148f50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba08032000 tx=0x7fba08004a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.621+0000 7fb447200640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.621+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400e2390 con 0x7fb440046d70 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.621+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400dfb90 con 0x7fb44004c600 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.621+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440006650 con 0x7fb4400d8fb0 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.619+0000 7f99cf400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f99c80d9250 0x7f99c80071b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34556/0 (socket says 172.21.15.102:34556) 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.620+0000 7f99cf400640 1 -- 172.21.15.102:0/2195204531 learned_addr learned my addr 172.21.15.102:0/2195204531 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.621+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495277228 0 0) 0x7f99c804ef30 con 0x7f99c80d9250 2024-03-25T05:37:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.621+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b8003520 con 0x7f99c80d9250 2024-03-25T05:37:59.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7fb445400640 1 -- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 msgr2=0x7fb4400dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7fb445400640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2146932926 0 0) 0x7f99b8003520 con 0x7f99c80d9250 2024-03-25T05:37:59.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 >> v2:172.21.15.187:3300/0 conn(0x7f99c80e0490 msgr2=0x7f99c8039e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-25T05:37:59.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7f99ce000640 1 --2- 172.21.15.102:0/2195204531 >> v2:172.21.15.187:3300/0 conn(0x7f99c80e0490 0x7f99c8039e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 >> v1:172.21.15.102:6789/0 conn(0x7f99c804ffd0 legacy=0x7f99c80e98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7fb445400640 1 -- 172.21.15.102:0/567313312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb440046d70 msgr2=0x7fb4400def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.622+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c804f4f0 con 0x7f99c80d9250 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7fb445400640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb440046d70 0x7fb4400def70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7fb445400640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438009400 con 0x7fb44004c600 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7fb445e00640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb440046d70 0x7fb4400def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f99c4001670 con 0x7f99c80d9250 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 >> v1:172.21.15.187:6789/0 conn(0x7f99c80d9250 legacy=0x7f99c80071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80039c0 0x7f99b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80047c0 0x7f99b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b80052a0 0x7f99b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c804f210 con 0x7f99b80039c0 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80149f0 con 0x7f99b80052a0 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b8014bb0 con 0x7f99b80047c0 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.623+0000 7f99cfe00640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b80052a0 0x7f99b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.624+0000 7fb445400640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb44004c600 0x7fb4400055a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c450 tx=0x7fb43400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.624+0000 7f99cfe00640 1 -- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80047c0 msgr2=0x7f99b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.624+0000 7f99cea00640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80047c0 0x7f99b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.624+0000 7f99cfe00640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80047c0 0x7f99b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.624+0000 7f99cfe00640 1 -- 172.21.15.102:0/2195204531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80039c0 msgr2=0x7f99b8003dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:37:59.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.624+0000 7fb43e000640 1 -- 172.21.15.102:0/567313312 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340074e0 con 0x7fb44004c600 2024-03-25T05:37:59.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.624+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4400df4b0 con 0x7fb44004c600 2024-03-25T05:37:59.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.625+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4400df920 con 0x7fb44004c600 2024-03-25T05:37:59.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.625+0000 7f99cf400640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80039c0 0x7f99b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.626+0000 7f99cfe00640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80039c0 0x7f99b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.627+0000 7f99cfe00640 1 -- 172.21.15.102:0/2195204531 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8003520 con 0x7f99b80052a0 2024-03-25T05:37:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.627+0000 7f99cfe00640 1 -- 172.21.15.102:0/2195204531 reap_dead start 2024-03-25T05:37:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.626+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb440005390 con 0x7fb44004c600 2024-03-25T05:37:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.628+0000 7f99cf400640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80039c0 0x7f99b8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.628+0000 7f99cfe00640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b80052a0 0x7f99b800b980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99d0050560 tx=0x7f99b80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e40d7e7ad3bead0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.628+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00a7b20 con 0x7f99b80052a0 2024-03-25T05:37:59.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.628+0000 7f99ce000640 1 -- 172.21.15.102:0/2195204531 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d006e040 con 0x7f99b80052a0 2024-03-25T05:37:59.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.628+0000 7f99cea00640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80047c0 0x7f99b8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.629+0000 7fb43e000640 1 -- 172.21.15.102:0/567313312 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434007640 con 0x7fb44004c600 2024-03-25T05:37:59.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.629+0000 7fb43e000640 1 -- 172.21.15.102:0/567313312 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340074e0 con 0x7fb44004c600 2024-03-25T05:37:59.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.629+0000 7f99d5000640 1 -- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b80052a0 msgr2=0x7f99b800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.629+0000 7f99d5000640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b80052a0 0x7f99b800b980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99d0050560 tx=0x7f99b80057f0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.629+0000 7f99d5000640 1 -- 172.21.15.102:0/2195204531 shutdown_connections 2024-03-25T05:37:59.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.629+0000 7f99d5000640 1 --2- 172.21.15.102:0/2195204531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b80052a0 0x7f99b800b980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.629+0000 7f99d5000640 1 -- 172.21.15.102:0/2195204531 >> 172.21.15.102:0/2195204531 conn(0x7f99c800e160 msgr2=0x7f99c800e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.630+0000 7f99d5000640 1 -- 172.21.15.102:0/2195204531 shutdown_connections 2024-03-25T05:37:59.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.630+0000 7f99d5000640 1 -- 172.21.15.102:0/2195204531 wait complete. 2024-03-25T05:37:59.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.632+0000 7fb43e000640 1 -- 172.21.15.102:0/567313312 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb4340047e0 con 0x7fb44004c600 2024-03-25T05:37:59.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.634+0000 7fb43e000640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb42806b870 0x7fb42806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.635+0000 7fb445e00640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb42806b870 0x7fb42806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.635+0000 7fb43e000640 1 -- 172.21.15.102:0/567313312 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb434089b60 con 0x7fb44004c600 2024-03-25T05:37:59.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.636+0000 7fb445e00640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb42806b870 0x7fb42806dd30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb438000c00 tx=0x7fb438008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.636+0000 7f99d5000640 1 Processor -- start 2024-03-25T05:37:59.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.636+0000 7f99d5000640 1 -- start start 2024-03-25T05:37:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.636+0000 7effecc00640 1 Processor -- start 2024-03-25T05:37:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.637+0000 7effecc00640 1 -- start start 2024-03-25T05:37:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.638+0000 7fb43e000640 1 -- 172.21.15.102:0/567313312 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb4340542d0 con 0x7fb44004c600 2024-03-25T05:37:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7f99d5000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80052a0 0x7f99c8048da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7f99d5000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99c80dc800 0x7f99c8049d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7f99d5000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99c804a270 0x7f99c8173b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7f99d5000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c81714f0 con 0x7f99b80052a0 2024-03-25T05:37:59.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7f99d5000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c804a6f0 con 0x7f99c804a270 2024-03-25T05:37:59.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7f99d5000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8170620 con 0x7f99c80dc800 2024-03-25T05:37:59.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.640+0000 7f99cea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99c80dc800 0x7f99c8049d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.640+0000 7f99cea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99c80dc800 0x7f99c8049d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58128/0 (socket says 172.21.15.102:58128) 2024-03-25T05:37:59.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.640+0000 7f99cea00640 1 -- 172.21.15.102:0/3475902571 learned_addr learned my addr 172.21.15.102:0/3475902571 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.640+0000 7f99cf400640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80052a0 0x7f99c8048da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.630+0000 7fba06a00640 1 -- 172.21.15.102:0/3214316967 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08009510 con 0x7fba100b3560 2024-03-25T05:37:59.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.633+0000 7fba06a00640 1 -- 172.21.15.102:0/3214316967 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08004680 con 0x7fba100b3560 2024-03-25T05:37:59.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.633+0000 7fba06a00640 1 -- 172.21.15.102:0/3214316967 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0803e450 con 0x7fba100b3560 2024-03-25T05:37:59.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba10144340 con 0x7fba100b3560 2024-03-25T05:37:59.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7f99cea00640 1 -- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99c804a270 msgr2=0x7f99c8173b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7f99cea00640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99c804a270 0x7f99c8173b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7f99cea00640 1 -- 172.21.15.102:0/3475902571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80052a0 msgr2=0x7f99c8048da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7f99cea00640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80052a0 0x7f99c8048da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7f99cea00640 1 -- 172.21.15.102:0/3475902571 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c81708e0 con 0x7f99c80dc800 2024-03-25T05:37:59.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.642+0000 7f99cf400640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80052a0 0x7f99c8048da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.638+0000 7effecc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7effe8153db0 0x7effe815a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7effecc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7effe80cb050 0x7effe806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7effecc00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe80c9e10 con 0x7effe80cab00 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7effecc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe815df80 con 0x7effe80cb050 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.639+0000 7effecc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe80ca340 con 0x7effe8153db0 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7effe7400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7effe8153db0 0x7effe815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7effe7400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7effe8153db0 0x7effe815a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48486/0 (socket says 172.21.15.102:48486) 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.641+0000 7effe7400640 1 -- 172.21.15.102:0/2094616975 learned_addr learned my addr 172.21.15.102:0/2094616975 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.642+0000 7f99cea00640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99c80dc800 0x7f99c8049d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c490 tx=0x7f99bc00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.643+0000 7fed21e00640 1 Processor -- start 2024-03-25T05:37:59.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.643+0000 7fed21e00640 1 -- start start 2024-03-25T05:37:59.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.643+0000 7effdea00640 1 --2- 172.21.15.102:0/2094616975 >> v2:172.21.15.102:3300/0 conn(0x7effe80cb050 0x7effe806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.643+0000 7f99c3400640 1 -- 172.21.15.102:0/3475902571 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc011800 con 0x7f99c80dc800 2024-03-25T05:37:59.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.643+0000 7f99c3400640 1 -- 172.21.15.102:0/3475902571 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc011980 con 0x7f99c80dc800 2024-03-25T05:37:59.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.643+0000 7f99c3400640 1 -- 172.21.15.102:0/3475902571 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc011d30 con 0x7f99c80dc800 2024-03-25T05:37:59.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.643+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c8170bc0 con 0x7f99c80dc800 2024-03-25T05:37:59.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.642+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba101445c0 con 0x7fba100b3560 2024-03-25T05:37:59.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.644+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c8171180 con 0x7f99c80dc800 2024-03-25T05:37:59.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7fed21e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fed1404b530 0x7fed140dac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7fed21e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed14005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7effe6a00640 1 -- 172.21.15.102:0/2094616975 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416165012 0 0) 0x7effe80c9e10 con 0x7effe80cab00 2024-03-25T05:37:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac005290 con 0x7f99c80dc800 2024-03-25T05:37:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7effe6a00640 1 -- 172.21.15.102:0/2094616975 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effcc003520 con 0x7effe80cab00 2024-03-25T05:37:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7fed1aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fed1404b530 0x7fed140dac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7fed1aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fed1404b530 0x7fed140dac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48502/0 (socket says 172.21.15.102:48502) 2024-03-25T05:37:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7fed1aa00640 1 -- 172.21.15.102:0/2294323658 learned_addr learned my addr 172.21.15.102:0/2294323658 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7fed1a000640 1 --2- 172.21.15.102:0/2294323658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed14005ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.646+0000 7fed21e00640 1 --2- 172.21.15.102:0/2294323658 >> v2:172.21.15.102:3300/0 conn(0x7fed14006400 0x7fed14034a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7effe7400640 1 -- 172.21.15.102:0/2094616975 >> v2:172.21.15.102:3300/0 conn(0x7effe80cb050 msgr2=0x7effe806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7effe7400640 1 --2- 172.21.15.102:0/2094616975 >> v2:172.21.15.102:3300/0 conn(0x7effe80cb050 0x7effe806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7effe7400640 1 -- 172.21.15.102:0/2094616975 >> v1:172.21.15.102:6789/0 conn(0x7effe80cab00 legacy=0x7effe80c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7effe7400640 1 -- 172.21.15.102:0/2094616975 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80ca060 con 0x7effe8153db0 2024-03-25T05:37:59.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed14007740 con 0x7fed14006400 2024-03-25T05:37:59.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed140068e0 con 0x7fed1404b530 2024-03-25T05:37:59.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed14006bc0 con 0x7fed1404b910 2024-03-25T05:37:59.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.647+0000 7fed1b400640 1 --2- 172.21.15.102:0/2294323658 >> v2:172.21.15.102:3300/0 conn(0x7fed14006400 0x7fed14034a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.648+0000 7fed1a000640 1 -- 172.21.15.102:0/2294323658 >> v2:172.21.15.187:3300/0 conn(0x7fed1404b530 msgr2=0x7fed140dac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.648+0000 7fed1a000640 1 --2- 172.21.15.102:0/2294323658 >> v2:172.21.15.187:3300/0 conn(0x7fed1404b530 0x7fed140dac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.648+0000 7fed1a000640 1 -- 172.21.15.102:0/2294323658 >> v2:172.21.15.102:3300/0 conn(0x7fed14006400 msgr2=0x7fed14034a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.648+0000 7fed1a000640 1 --2- 172.21.15.102:0/2294323658 >> v2:172.21.15.102:3300/0 conn(0x7fed14006400 0x7fed14034a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.648+0000 7fed1a000640 1 -- 172.21.15.102:0/2294323658 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14006ea0 con 0x7fed1404b910 2024-03-25T05:37:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.648+0000 7fed1b400640 1 --2- 172.21.15.102:0/2294323658 >> v2:172.21.15.102:3300/0 conn(0x7fed14006400 0x7fed14034a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.650+0000 7f99c3400640 1 -- 172.21.15.102:0/3475902571 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99bc01a450 con 0x7f99c80dc800 2024-03-25T05:37:59.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.651+0000 7f99c3400640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f99b006b8e0 0x7f99b006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.652+0000 7fed1a000640 1 --2- 172.21.15.102:0/2294323658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed14005ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed1404a7f0 tx=0x7fed0c02da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae876f984143ca26 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.652+0000 7fed19600640 1 -- 172.21.15.102:0/2294323658 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c031850 con 0x7fed1404b910 2024-03-25T05:37:59.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.652+0000 7f99c3400640 1 -- 172.21.15.102:0/3475902571 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f99bc08aec0 con 0x7f99c80dc800 2024-03-25T05:37:59.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.653+0000 7fed19600640 1 -- 172.21.15.102:0/2294323658 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c0319b0 con 0x7fed1404b910 2024-03-25T05:37:59.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.653+0000 7fed19600640 1 -- 172.21.15.102:0/2294323658 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c031d40 con 0x7fed1404b910 2024-03-25T05:37:59.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.652+0000 7f99cf400640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f99b006b8e0 0x7f99b006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.653+0000 7f99c3400640 1 -- 172.21.15.102:0/3475902571 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f99bc0590b0 con 0x7f99c80dc800 2024-03-25T05:37:59.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.652+0000 7fba06a00640 1 -- 172.21.15.102:0/3214316967 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba0803e5b0 con 0x7fba100b3560 2024-03-25T05:37:59.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7f99cf400640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f99b006b8e0 0x7f99b006dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99c4000ff0 tx=0x7f99c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 msgr2=0x7fed14005ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fed21e00640 1 --2- 172.21.15.102:0/2294323658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed14005ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed1404a7f0 tx=0x7fed0c02da30 comp rx=0 tx=0).stop 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 shutdown_connections 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fed21e00640 1 --2- 172.21.15.102:0/2294323658 >> v2:172.21.15.102:3300/0 conn(0x7fed14006400 0x7fed14034a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fed21e00640 1 --2- 172.21.15.102:0/2294323658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed14005ec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fed21e00640 1 --2- 172.21.15.102:0/2294323658 >> v2:172.21.15.187:3300/0 conn(0x7fed1404b530 0x7fed140dac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 >> 172.21.15.102:0/2294323658 conn(0x7fed140501b0 msgr2=0x7fed140505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.655+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 shutdown_connections 2024-03-25T05:37:59.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.654+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1004f2f0 con 0x7fba100b3560 2024-03-25T05:37:59.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.656+0000 7fed21e00640 1 -- 172.21.15.102:0/2294323658 wait complete. 2024-03-25T05:37:59.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.658+0000 7fed21e00640 1 Processor -- start 2024-03-25T05:37:59.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.659+0000 7fed21e00640 1 -- start start 2024-03-25T05:37:59.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.660+0000 7fba06a00640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb9f006b860 0x7fb9f006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.662+0000 7fed21e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed14006400 0x7fed1404f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.662+0000 7fed21e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1404b530 0x7fed14181ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.663+0000 7fed21e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed140da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.663+0000 7fed1aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed14006400 0x7fed1404f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.662+0000 7fba0e000640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb9f006b860 0x7fb9f006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.663+0000 7fba06a00640 1 -- 172.21.15.102:0/3214316967 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fba080acd30 con 0x7fba100b3560 2024-03-25T05:37:59.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.664+0000 7effe7400640 1 --2- 172.21.15.102:0/2094616975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe8153db0 0x7effe815a470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effe80cf430 tx=0x7effd802ba60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360bd3b7ace781 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.664+0000 7fed1aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed14006400 0x7fed1404f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48518/0 (socket says 172.21.15.102:48518) 2024-03-25T05:37:59.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.664+0000 7effe6a00640 1 -- 172.21.15.102:0/2094616975 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd802d820 con 0x7effe8153db0 2024-03-25T05:37:59.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.664+0000 7effe6a00640 1 -- 172.21.15.102:0/2094616975 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd802d980 con 0x7effe8153db0 2024-03-25T05:37:59.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.664+0000 7effe6a00640 1 -- 172.21.15.102:0/2094616975 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd802dd50 con 0x7effe8153db0 2024-03-25T05:37:59.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7fed1b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed140da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7fed1b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed140da8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58136/0 (socket says 172.21.15.102:58136) 2024-03-25T05:37:59.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7fed1a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1404b530 0x7fed14181ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7effecc00640 1 -- 172.21.15.102:0/2094616975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe8153db0 msgr2=0x7effe815a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7effecc00640 1 --2- 172.21.15.102:0/2094616975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe8153db0 0x7effe815a470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effe80cf430 tx=0x7effd802ba60 comp rx=0 tx=0).stop 2024-03-25T05:37:59.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7fed1aa00640 1 -- 172.21.15.102:0/3245102666 learned_addr learned my addr 172.21.15.102:0/3245102666 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7effecc00640 1 -- 172.21.15.102:0/2094616975 shutdown_connections 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7effecc00640 1 --2- 172.21.15.102:0/2094616975 >> v2:172.21.15.102:3300/0 conn(0x7effe80cb050 0x7effe806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7effecc00640 1 --2- 172.21.15.102:0/2094616975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe8153db0 0x7effe815a470 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effe80cf430 tx=0x7effd802ba60 comp rx=0 tx=0).stop 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.666+0000 7effecc00640 1 -- 172.21.15.102:0/2094616975 >> 172.21.15.102:0/2094616975 conn(0x7effe8072b30 msgr2=0x7effe806be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140d18d0 con 0x7fed1404b530 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140db500 con 0x7fed14006400 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.665+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140d8530 con 0x7fed1404b910 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.666+0000 7fed1b400640 1 -- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed14006400 msgr2=0x7fed1404f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.666+0000 7fed1b400640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed14006400 0x7fed1404f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.666+0000 7fed1b400640 1 -- 172.21.15.102:0/3245102666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1404b530 msgr2=0x7fed14181ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.666+0000 7fba0e000640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb9f006b860 0x7fb9f006dd20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fba100c4410 tx=0x7fba000079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.667+0000 7fba06a00640 1 -- 172.21.15.102:0/3214316967 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fba08077510 con 0x7fba100b3560 2024-03-25T05:37:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.667+0000 7fed1b400640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1404b530 0x7fed14181ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.667+0000 7fed1b400640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0800ae30 con 0x7fed1404b910 2024-03-25T05:37:59.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.667+0000 7fed1b400640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed140da8d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed1400e2a0 tx=0x7fed0800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.669+0000 7fed13400640 1 -- 172.21.15.102:0/3245102666 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08004220 con 0x7fed1404b910 2024-03-25T05:37:59.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.669+0000 7fed13400640 1 -- 172.21.15.102:0/3245102666 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08010040 con 0x7fed1404b910 2024-03-25T05:37:59.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.669+0000 7fed13400640 1 -- 172.21.15.102:0/3245102666 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800e810 con 0x7fed1404b910 2024-03-25T05:37:59.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.669+0000 7effecc00640 1 -- 172.21.15.102:0/2094616975 shutdown_connections 2024-03-25T05:37:59.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.669+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c009400 con 0x7fed1404b910 2024-03-25T05:37:59.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.669+0000 7effecc00640 1 -- 172.21.15.102:0/2094616975 wait complete. 2024-03-25T05:37:59.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.669+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed140d8250 con 0x7fed1404b910 2024-03-25T05:37:59.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.675+0000 7effecc00640 1 Processor -- start 2024-03-25T05:37:59.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.675+0000 7effecc00640 1 -- start start 2024-03-25T05:37:59.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.677+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf4005290 con 0x7fed1404b910 2024-03-25T05:37:59.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.677+0000 7fed1a000640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1404b530 0x7fed14181ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:37:59.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.677+0000 7fed13400640 1 -- 172.21.15.102:0/3245102666 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed0800e970 con 0x7fed1404b910 2024-03-25T05:37:59.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.679+0000 7fed13400640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fecfc06b860 0x7fecfc06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.680+0000 7fed1aa00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fecfc06b860 0x7fecfc06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.680+0000 7fed13400640 1 -- 172.21.15.102:0/3245102666 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fed0808a310 con 0x7fed1404b910 2024-03-25T05:37:59.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.681+0000 7effecc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe80cab00 0x7effe80ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.681+0000 7fed1aa00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fecfc06b860 0x7fecfc06dd20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed1c050ad0 tx=0x7fed1c0692b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.681+0000 7effecc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe80cb050 0x7effe80b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.681+0000 7effecc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe80c9650 0x7effe80b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.682+0000 7effe7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe80c9650 0x7effe80b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.682+0000 7effe7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe80c9650 0x7effe80b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58148/0 (socket says 172.21.15.102:58148) 2024-03-25T05:37:59.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.682+0000 7effecc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe81598f0 con 0x7effe80cab00 2024-03-25T05:37:59.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.682+0000 7effecc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe8146980 con 0x7effe80cb050 2024-03-25T05:37:59.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.682+0000 7effecc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe80b4740 con 0x7effe80c9650 2024-03-25T05:37:59.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.682+0000 7effe7e00640 1 -- 172.21.15.102:0/4157487608 learned_addr learned my addr 172.21.15.102:0/4157487608 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.682+0000 7effdea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe80cb050 0x7effe80b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.683+0000 7effe7400640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe80cab00 0x7effe80ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.683+0000 7effe7e00640 1 -- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe80cb050 msgr2=0x7effe80b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.683+0000 7effe7e00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe80cb050 0x7effe80b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.683+0000 7effe7e00640 1 -- 172.21.15.102:0/4157487608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe80cab00 msgr2=0x7effe80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.683+0000 7effe7e00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe80cab00 0x7effe80ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.683+0000 7effe7e00640 1 -- 172.21.15.102:0/4157487608 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd80094d0 con 0x7effe80c9650 2024-03-25T05:37:59.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.684+0000 7effe7400640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe80cab00 0x7effe80ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:37:59.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.684+0000 7effdea00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe80cb050 0x7effe80b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:37:59.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.684+0000 7effe7e00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe80c9650 0x7effe80b3580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effe000c7a0 tx=0x7effe000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.684+0000 7effdfe00640 1 -- 172.21.15.102:0/4157487608 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0003b70 con 0x7effe80c9650 2024-03-25T05:37:59.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.684+0000 7effdfe00640 1 -- 172.21.15.102:0/4157487608 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0003cf0 con 0x7effe80c9650 2024-03-25T05:37:59.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.685+0000 7effdfe00640 1 -- 172.21.15.102:0/4157487608 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000aa30 con 0x7effe80c9650 2024-03-25T05:37:59.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.685+0000 7fed13400640 1 -- 172.21.15.102:0/3245102666 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fed08054b80 con 0x7fed1404b910 2024-03-25T05:37:59.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.689+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe80b4a20 con 0x7effe80c9650 2024-03-25T05:37:59.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.689+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe8144e50 con 0x7effe80c9650 2024-03-25T05:37:59.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.691+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe80cb510 con 0x7effe80c9650 2024-03-25T05:37:59.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.692+0000 7effdfe00640 1 -- 172.21.15.102:0/4157487608 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effe000ab90 con 0x7effe80c9650 2024-03-25T05:37:59.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.694+0000 7effdfe00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7effc406b910 0x7effc406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.694+0000 7effdfe00640 1 -- 172.21.15.102:0/4157487608 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7effe008a240 con 0x7effe80c9650 2024-03-25T05:37:59.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.694+0000 7effe7400640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7effc406b910 0x7effc406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.697+0000 7effe7400640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7effc406b910 0x7effc406ddd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7effd8036000 tx=0x7effd8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.697+0000 7effdfe00640 1 -- 172.21.15.102:0/4157487608 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7effe0054900 con 0x7effe80c9650 2024-03-25T05:37:59.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.736+0000 7f6f9e600640 1 Processor -- start 2024-03-25T05:37:59.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.736+0000 7f6f9e600640 1 -- start start 2024-03-25T05:37:59.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.738+0000 7f6f9e600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6f9814fea0 0x7f6f98156600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.738+0000 7f6f9e600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6f9806b3f0 0x7f6f9806e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.738+0000 7f6f9e600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f98071420 con 0x7f6f9806afb0 2024-03-25T05:37:59.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.738+0000 7f6f9e600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980c2b70 con 0x7f6f9814fea0 2024-03-25T05:37:59.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.738+0000 7f6f9e600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9806b880 con 0x7f6f9806b3f0 2024-03-25T05:37:59.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.738+0000 7f342d200640 1 Processor -- start 2024-03-25T05:37:59.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.739+0000 7f6f96a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6f9806afb0 0x7f6f9806e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:32792/0 (socket says 172.21.15.102:32792) 2024-03-25T05:37:59.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.739+0000 7f6f96a00640 1 -- 172.21.15.102:0/1718758249 learned_addr learned my addr 172.21.15.102:0/1718758249 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:37:59.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.739+0000 7f342d200640 1 -- start start 2024-03-25T05:37:59.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.741+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519520403 0 0) 0x7f6f98071420 con 0x7f6f9806afb0 2024-03-25T05:37:59.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.741+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f7c003520 con 0x7f6f9806afb0 2024-03-25T05:37:59.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.742+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2531360894 0 0) 0x7f6f7c003520 con 0x7f6f9806afb0 2024-03-25T05:37:59.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.742+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 >> v2:172.21.15.187:3300/0 conn(0x7f6f9806b3f0 msgr2=0x7f6f9806e900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-25T05:37:59.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.742+0000 7f6f96000640 1 --2- 172.21.15.102:0/1718758249 >> v2:172.21.15.187:3300/0 conn(0x7f6f9806b3f0 0x7f6f9806e900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.742+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 >> v2:172.21.15.102:3300/0 conn(0x7f6f9814fea0 msgr2=0x7f6f98156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.742+0000 7f6f96000640 1 --2- 172.21.15.102:0/1718758249 >> v2:172.21.15.102:3300/0 conn(0x7f6f9814fea0 0x7f6f98156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.742+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9815a0f0 con 0x7f6f9806afb0 2024-03-25T05:37:59.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f6f88001650 con 0x7f6f9806afb0 2024-03-25T05:37:59.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f342d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280c4900 0x7f3428159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 >> v1:172.21.15.102:6789/0 conn(0x7f6f9806afb0 legacy=0x7f6f9806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f342d200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34280caba0 0x7f342815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f342d200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342815a6e0 con 0x7f3428153f00 2024-03-25T05:37:59.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c004c20 0x7f6f7c003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.744+0000 7f342d200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34280c4e70 con 0x7f34280caba0 2024-03-25T05:37:59.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.744+0000 7f342d200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c59f0 con 0x7f34280c4900 2024-03-25T05:37:59.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.744+0000 7f3426800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34280caba0 0x7f342815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f3426800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34280caba0 0x7f342815a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48534/0 (socket says 172.21.15.102:48534) 2024-03-25T05:37:59.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f3425400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280c4900 0x7f3428159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f3426800640 1 -- 172.21.15.102:0/587027201 learned_addr learned my addr 172.21.15.102:0/587027201 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f3425400640 1 -- 172.21.15.102:0/587027201 >> v2:172.21.15.187:3300/0 conn(0x7f34280caba0 msgr2=0x7f342815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f7c003f60 0x7f6f7c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f7c005540 0x7f6f7c0059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980c2b70 con 0x7f6f7c003f60 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9806b880 con 0x7f6f7c005540 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.743+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c006300 con 0x7f6f7c004c20 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.744+0000 7f6f96a00640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f7c003f60 0x7f6f7c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f6f97400640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c004c20 0x7f6f7c003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f6f96a00640 1 -- 172.21.15.102:0/1718758249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c004c20 msgr2=0x7f6f7c003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:37:59.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f6f96a00640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c004c20 0x7f6f7c003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f6f96a00640 1 -- 172.21.15.102:0/1718758249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f7c005540 msgr2=0x7f6f7c0059f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-25T05:37:59.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f6f96a00640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f7c005540 0x7f6f7c0059f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f3425400640 1 --2- 172.21.15.102:0/587027201 >> v2:172.21.15.187:3300/0 conn(0x7f34280caba0 0x7f342815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.746+0000 7f3424a00640 1 -- 172.21.15.102:0/587027201 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586945800 0 0) 0x7f342815a6e0 con 0x7f3428153f00 2024-03-25T05:37:59.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.745+0000 7f6f96a00640 1 -- 172.21.15.102:0/1718758249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c003520 con 0x7f6f7c003f60 2024-03-25T05:37:59.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.749+0000 7f3425400640 1 -- 172.21.15.102:0/587027201 >> v1:172.21.15.102:6789/0 conn(0x7f3428153f00 legacy=0x7f34280c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.749+0000 7f3425400640 1 -- 172.21.15.102:0/587027201 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280cbab0 con 0x7f34280c4900 2024-03-25T05:37:59.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.749+0000 7f6f97e00640 1 -- 172.21.15.102:0/1718758249 reap_dead start 2024-03-25T05:37:59.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.750+0000 7f6f96a00640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f7c003f60 0x7f6f7c005000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800d5a0 tx=0x7f6f7c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873a97001236fc41 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.750+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880058d0 con 0x7f6f7c003f60 2024-03-25T05:37:59.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.751+0000 7f3425400640 1 --2- 172.21.15.102:0/587027201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280c4900 0x7f3428159c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34140097a0 tx=0x7f341402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7668380f922d7b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.751+0000 7f3424a00640 1 -- 172.21.15.102:0/587027201 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341402d040 con 0x7f34280c4900 2024-03-25T05:37:59.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.751+0000 7f3424a00640 1 -- 172.21.15.102:0/587027201 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3414031810 con 0x7f34280c4900 2024-03-25T05:37:59.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.751+0000 7f3424a00640 1 -- 172.21.15.102:0/587027201 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414031ba0 con 0x7f34280c4900 2024-03-25T05:37:59.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.751+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88005a30 con 0x7f6f7c003f60 2024-03-25T05:37:59.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.751+0000 7f6f9e600640 1 -- 172.21.15.102:0/1718758249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f7c003f60 msgr2=0x7f6f7c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.752+0000 7f6f96000640 1 -- 172.21.15.102:0/1718758249 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880058d0 con 0x7f6f7c003f60 2024-03-25T05:37:59.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.752+0000 7f6f9e600640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f7c003f60 0x7f6f7c005000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800d5a0 tx=0x7f6f7c0047e0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.753+0000 7f6f9e600640 1 -- 172.21.15.102:0/1718758249 shutdown_connections 2024-03-25T05:37:59.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.753+0000 7f6f9e600640 1 --2- 172.21.15.102:0/1718758249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f7c003f60 0x7f6f7c005000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.753+0000 7f6f9e600640 1 -- 172.21.15.102:0/1718758249 >> 172.21.15.102:0/1718758249 conn(0x7f6f980cb340 msgr2=0x7f6f980cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.753+0000 7f342d200640 1 -- 172.21.15.102:0/587027201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280c4900 msgr2=0x7f3428159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.753+0000 7f342d200640 1 --2- 172.21.15.102:0/587027201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280c4900 0x7f3428159c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34140097a0 tx=0x7f341402b8b0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.755+0000 7f342d200640 1 -- 172.21.15.102:0/587027201 shutdown_connections 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.755+0000 7f342d200640 1 --2- 172.21.15.102:0/587027201 >> v2:172.21.15.187:3300/0 conn(0x7f34280caba0 0x7f342815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.755+0000 7f342d200640 1 --2- 172.21.15.102:0/587027201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280c4900 0x7f3428159c60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.755+0000 7f342d200640 1 -- 172.21.15.102:0/587027201 >> 172.21.15.102:0/587027201 conn(0x7f342806c060 msgr2=0x7f342806c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.755+0000 7f342d200640 1 -- 172.21.15.102:0/587027201 shutdown_connections 2024-03-25T05:37:59.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.755+0000 7f342d200640 1 -- 172.21.15.102:0/587027201 wait complete. 2024-03-25T05:37:59.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.758+0000 7f342d200640 1 Processor -- start 2024-03-25T05:37:59.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.762+0000 7f342d200640 1 -- start start 2024-03-25T05:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.763+0000 7f342d200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34280c4900 0x7f34280cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.763+0000 7f342d200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34280caba0 0x7f34280c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.763+0000 7f342d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3428153f00 0x7f34280c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.763+0000 7f342d200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c77e0 con 0x7f34280c4900 2024-03-25T05:37:59.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.763+0000 7f342d200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280d0030 con 0x7f34280caba0 2024-03-25T05:37:59.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.763+0000 7f342d200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c8610 con 0x7f3428153f00 2024-03-25T05:37:59.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.765+0000 7f6f9e600640 1 -- 172.21.15.102:0/1718758249 shutdown_connections 2024-03-25T05:37:59.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.765+0000 7f6f9e600640 1 -- 172.21.15.102:0/1718758249 wait complete. 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.765+0000 7f3425400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34280caba0 0x7f34280c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.765+0000 7f3425400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34280caba0 0x7f34280c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48564/0 (socket says 172.21.15.102:48564) 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.765+0000 7f3425400640 1 -- 172.21.15.102:0/2937034029 learned_addr learned my addr 172.21.15.102:0/2937034029 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.765+0000 7f3426800640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3428153f00 0x7f34280c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.768+0000 7f3425e00640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34280c4900 0x7f34280cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.768+0000 7f3425400640 1 -- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3428153f00 msgr2=0x7f34280c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.768+0000 7f3425400640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3428153f00 0x7f34280c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.768+0000 7f3425400640 1 -- 172.21.15.102:0/2937034029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34280c4900 msgr2=0x7f34280cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.768+0000 7f3425400640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34280c4900 0x7f34280cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.768+0000 7f3425400640 1 -- 172.21.15.102:0/2937034029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009400 con 0x7f34280caba0 2024-03-25T05:37:59.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.769+0000 7f3425400640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34280caba0 0x7f34280c8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3414000c00 tx=0x7f34140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.770+0000 7f341e000640 1 -- 172.21.15.102:0/2937034029 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341403ace0 con 0x7f34280caba0 2024-03-25T05:37:59.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.770+0000 7f341e000640 1 -- 172.21.15.102:0/2937034029 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341403ae40 con 0x7f34280caba0 2024-03-25T05:37:59.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.770+0000 7f341e000640 1 -- 172.21.15.102:0/2937034029 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414044630 con 0x7f34280caba0 2024-03-25T05:37:59.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.773+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280c7a30 con 0x7f34280caba0 2024-03-25T05:37:59.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.773+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280c7ff0 con 0x7f34280caba0 2024-03-25T05:37:59.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.773+0000 7f6f9e600640 1 Processor -- start 2024-03-25T05:37:59.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.773+0000 7f6f9e600640 1 -- start start 2024-03-25T05:37:59.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.784+0000 7f341e000640 1 -- 172.21.15.102:0/2937034029 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3414063070 con 0x7f34280caba0 2024-03-25T05:37:59.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.784+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34281531e0 con 0x7f34280caba0 2024-03-25T05:37:59.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.785+0000 7f341e000640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f340806b8e0 0x7f340806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.786+0000 7f341e000640 1 -- 172.21.15.102:0/2937034029 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f34140ac840 con 0x7f34280caba0 2024-03-25T05:37:59.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.786+0000 7f3425e00640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f340806b8e0 0x7f340806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.787+0000 7f3425e00640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f340806b8e0 0x7f340806dda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3418000f60 tx=0x7f3418009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.788+0000 7f6f9e600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c003f60 0x7f6f981ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.788+0000 7f6f9e600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f980c9460 0x7f6f981ec530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.788+0000 7f6f9e600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f981ef040 0x7f6f980c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.788+0000 7f6f9e600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981eb820 con 0x7f6f980c9460 2024-03-25T05:37:59.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.788+0000 7f6f97e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f981ef040 0x7f6f980c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.788+0000 7f6f97e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f981ef040 0x7f6f980c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48568/0 (socket says 172.21.15.102:48568) 2024-03-25T05:37:59.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.788+0000 7f6f97e00640 1 -- 172.21.15.102:0/4150101565 learned_addr learned my addr 172.21.15.102:0/4150101565 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:37:59.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f341e000640 1 -- 172.21.15.102:0/2937034029 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3414077020 con 0x7f34280caba0 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f97400640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c003f60 0x7f6f981ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980c99c0 con 0x7f6f981ef040 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980c9ca0 con 0x7f6f7c003f60 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f96a00640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f980c9460 0x7f6f981ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f97e00640 1 -- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c003f60 msgr2=0x7f6f981ebcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f97e00640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c003f60 0x7f6f981ebcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f97e00640 1 -- 172.21.15.102:0/4150101565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f980c9460 msgr2=0x7f6f981ec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f97e00640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f980c9460 0x7f6f981ec530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f97e00640 1 -- 172.21.15.102:0/4150101565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f981eb1d0 con 0x7f6f981ef040 2024-03-25T05:37:59.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.792+0000 7f6f97e00640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f981ef040 0x7f6f980c4a80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f980c33d0 tx=0x7f6f9000bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.796+0000 7f6f8f400640 1 -- 172.21.15.102:0/4150101565 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000cb90 con 0x7f6f981ef040 2024-03-25T05:37:59.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.797+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f981eb4b0 con 0x7f6f981ef040 2024-03-25T05:37:59.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.797+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f980c9f80 con 0x7f6f981ef040 2024-03-25T05:37:59.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.798+0000 7f6f8f400640 1 -- 172.21.15.102:0/4150101565 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9000ccf0 con 0x7f6f981ef040 2024-03-25T05:37:59.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.798+0000 7f6f8f400640 1 -- 172.21.15.102:0/4150101565 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90005290 con 0x7f6f981ef040 2024-03-25T05:37:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.807+0000 7f6f8f400640 1 -- 172.21.15.102:0/4150101565 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6f90012020 con 0x7f6f981ef040 2024-03-25T05:37:59.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.812+0000 7f6f8f400640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f7806b840 0x7f6f7806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:37:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.812+0000 7f6f8f400640 1 -- 172.21.15.102:0/4150101565 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6f9008a030 con 0x7f6f981ef040 2024-03-25T05:37:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.814+0000 7f6f97400640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f7806b840 0x7f6f7806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:37:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.817+0000 7f6f97400640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f7806b840 0x7f6f7806dd00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f84004700 tx=0x7f6f84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:37:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.817+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f70005290 con 0x7f6f981ef040 2024-03-25T05:37:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:37:59.825+0000 7f6f8f400640 1 -- 172.21.15.102:0/4150101565 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6f9001a080 con 0x7f6f981ef040 2024-03-25T05:38:00.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.058+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb44004b060 con 0x7fb44004c600 2024-03-25T05:38:00.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.059+0000 7fb43e000640 1 -- 172.21.15.102:0/567313312 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb434022020 con 0x7fb44004c600 2024-03-25T05:38:00.052 INFO:teuthology.orchestra.run.smithi102.stdout:55834574855 2024-03-25T05:38:00.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.062+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb42806b870 msgr2=0x7fb42806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.062+0000 7fb447200640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb42806b870 0x7fb42806dd30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb438000c00 tx=0x7fb438008030 comp rx=0 tx=0).stop 2024-03-25T05:38:00.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb44004c600 msgr2=0x7fb4400055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb44004c600 0x7fb4400055a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c450 tx=0x7fb43400c910 comp rx=0 tx=0).stop 2024-03-25T05:38:00.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 shutdown_connections 2024-03-25T05:38:00.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb42806b870 0x7fb42806dd30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4400d8fb0 0x7fb4400dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb44004c600 0x7fb4400055a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 --2- 172.21.15.102:0/567313312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb440046d70 0x7fb4400def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.063+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 >> 172.21.15.102:0/567313312 conn(0x7fb440050180 msgr2=0x7fb4400d67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.065+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 shutdown_connections 2024-03-25T05:38:00.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.065+0000 7fb447200640 1 -- 172.21.15.102:0/567313312 wait complete. 2024-03-25T05:38:00.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.129+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fac04f2f0 con 0x7f4fac06f470 2024-03-25T05:38:00.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.129+0000 7f4fa3400640 1 -- 172.21.15.102:0/2297837809 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f9c015020 con 0x7f4fac06f470 2024-03-25T05:38:00.122 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:38:00.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.133+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4f8c06b8e0 msgr2=0x7f4f8c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.133+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4f8c06b8e0 0x7f4f8c06dda0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006fd0 tx=0x7f4f98006bc0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.133+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fac06f470 msgr2=0x7f4fac06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.133+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fac06f470 0x7f4fac06eac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00b450 tx=0x7f4f9c00b910 comp rx=0 tx=0).stop 2024-03-25T05:38:00.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.133+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 shutdown_connections 2024-03-25T05:38:00.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.133+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4f8c06b8e0 0x7f4f8c06dda0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.137+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fac16aad0 0x7f4fac1f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.137+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac164000 0x7f4fac1f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.137+0000 7f4fb0a00640 1 --2- 172.21.15.102:0/2297837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fac06f470 0x7f4fac06eac0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.137+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 >> 172.21.15.102:0/2297837809 conn(0x7f4fac0cb340 msgr2=0x7f4fac0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-03-25T05:38:00.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.139+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 shutdown_connections 2024-03-25T05:38:00.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.139+0000 7f4fb0a00640 1 -- 172.21.15.102:0/2297837809 wait complete. 2024-03-25T05:38:00.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.149+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f99ac005810 con 0x7f99c80dc800 2024-03-25T05:38:00.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.149+0000 7f99c3400640 1 -- 172.21.15.102:0/3475902571 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99bc058c40 con 0x7f99c80dc800 2024-03-25T05:38:00.143 INFO:teuthology.orchestra.run.smithi102.stdout:55834574856 2024-03-25T05:38:00.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f99b006b8e0 msgr2=0x7f99b006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f99b006b8e0 0x7f99b006dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99c4000ff0 tx=0x7f99c4009040 comp rx=0 tx=0).stop 2024-03-25T05:38:00.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99c80dc800 msgr2=0x7f99c8049d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99c80dc800 0x7f99c8049d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c490 tx=0x7f99bc00c950 comp rx=0 tx=0).stop 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 shutdown_connections 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f99b006b8e0 0x7f99b006dda0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99c804a270 0x7f99c8173b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99c80dc800 0x7f99c8049d30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 --2- 172.21.15.102:0/3475902571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99b80052a0 0x7f99c8048da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.154+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 >> 172.21.15.102:0/3475902571 conn(0x7f99c800e160 msgr2=0x7f99c80d3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.155+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 shutdown_connections 2024-03-25T05:38:00.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.155+0000 7f99d5000640 1 -- 172.21.15.102:0/3475902571 wait complete. 2024-03-25T05:38:00.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-03-25T05:38:00.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-03-25T05:38:00.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.218+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba100cadb0 con 0x7fba100b3560 2024-03-25T05:38:00.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.218+0000 7fba06a00640 1 -- 172.21.15.102:0/3214316967 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba08043090 con 0x7fba100b3560 2024-03-25T05:38:00.211 INFO:teuthology.orchestra.run.smithi102.stdout:55834574855 2024-03-25T05:38:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.221+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb9f006b860 msgr2=0x7fb9f006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.221+0000 7fba15600640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb9f006b860 0x7fb9f006dd20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fba100c4410 tx=0x7fba000079c0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.221+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba100b3560 msgr2=0x7fba10148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.221+0000 7fba15600640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba100b3560 0x7fba10148f50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba08032000 tx=0x7fba08004a70 comp rx=0 tx=0).stop 2024-03-25T05:38:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 shutdown_connections 2024-03-25T05:38:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb9f006b860 0x7fb9f006dd20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba101582e0 0x7fba100b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba100ca270 0x7fba1013e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 --2- 172.21.15.102:0/3214316967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba100b3560 0x7fba10148f50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 >> 172.21.15.102:0/3214316967 conn(0x7fba1006b910 msgr2=0x7fba100b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 shutdown_connections 2024-03-25T05:38:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.222+0000 7fba15600640 1 -- 172.21.15.102:0/3214316967 wait complete. 2024-03-25T05:38:00.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-03-25T05:38:00.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.270+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effe804f2f0 con 0x7effe80c9650 2024-03-25T05:38:00.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.271+0000 7effdfe00640 1 -- 172.21.15.102:0/4157487608 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effe0003e60 con 0x7effe80c9650 2024-03-25T05:38:00.265 INFO:teuthology.orchestra.run.smithi102.stdout:55834574855 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7effc406b910 msgr2=0x7effc406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7effc406b910 0x7effc406ddd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7effd8036000 tx=0x7effd8008030 comp rx=0 tx=0).stop 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe80c9650 msgr2=0x7effe80b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe80c9650 0x7effe80b3580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effe000c7a0 tx=0x7effe000cc60 comp rx=0 tx=0).stop 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 shutdown_connections 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7effc406b910 0x7effc406ddd0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7effd8036000 tx=0x7effd8008030 comp rx=0 tx=0).stop 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe80c9650 0x7effe80b3580 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe80cb050 0x7effe80b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 --2- 172.21.15.102:0/4157487608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe80cab00 0x7effe80ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.275+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 >> 172.21.15.102:0/4157487608 conn(0x7effe8072b30 msgr2=0x7effe80cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.276+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 shutdown_connections 2024-03-25T05:38:00.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.276+0000 7effecc00640 1 -- 172.21.15.102:0/4157487608 wait complete. 2024-03-25T05:38:00.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.280+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fecf4005540 con 0x7fed1404b910 2024-03-25T05:38:00.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.281+0000 7fed13400640 1 -- 172.21.15.102:0/3245102666 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed08058240 con 0x7fed1404b910 2024-03-25T05:38:00.274 INFO:teuthology.orchestra.run.smithi102.stdout:55834574855 2024-03-25T05:38:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fecfc06b860 msgr2=0x7fecfc06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fecfc06b860 0x7fecfc06dd20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed1c050ad0 tx=0x7fed1c0692b0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 msgr2=0x7fed140da8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed140da8d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed1400e2a0 tx=0x7fed0800cc60 comp rx=0 tx=0).stop 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 shutdown_connections 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fecfc06b860 0x7fecfc06dd20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1404b910 0x7fed140da8d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1404b530 0x7fed14181ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 --2- 172.21.15.102:0/3245102666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed14006400 0x7fed1404f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 >> 172.21.15.102:0/3245102666 conn(0x7fed140501b0 msgr2=0x7fed140348c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 shutdown_connections 2024-03-25T05:38:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.284+0000 7fed21e00640 1 -- 172.21.15.102:0/3245102666 wait complete. 2024-03-25T05:38:00.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-03-25T05:38:00.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-03-25T05:38:00.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.381+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f342804f2f0 con 0x7f34280caba0 2024-03-25T05:38:00.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.381+0000 7f341e000640 1 -- 172.21.15.102:0/2937034029 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f341407a6e0 con 0x7f34280caba0 2024-03-25T05:38:00.374 INFO:teuthology.orchestra.run.smithi102.stdout:55834574855 2024-03-25T05:38:00.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f340806b8e0 msgr2=0x7f340806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f340806b8e0 0x7f340806dda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3418000f60 tx=0x7f3418009040 comp rx=0 tx=0).stop 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34280caba0 msgr2=0x7f34280c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34280caba0 0x7f34280c8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3414000c00 tx=0x7f34140046c0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 shutdown_connections 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f340806b8e0 0x7f340806dda0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3428153f00 0x7f34280c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34280caba0 0x7f34280c8af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 --2- 172.21.15.102:0/2937034029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34280c4900 0x7f34280cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 >> 172.21.15.102:0/2937034029 conn(0x7f342806c060 msgr2=0x7f34280b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 shutdown_connections 2024-03-25T05:38:00.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.384+0000 7f342d200640 1 -- 172.21.15.102:0/2937034029 wait complete. 2024-03-25T05:38:00.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-03-25T05:38:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.405+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f70005540 con 0x7f6f981ef040 2024-03-25T05:38:00.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.406+0000 7f6f8f400640 1 -- 172.21.15.102:0/4150101565 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f90057fa0 con 0x7f6f981ef040 2024-03-25T05:38:00.399 INFO:teuthology.orchestra.run.smithi102.stdout:55834574855 2024-03-25T05:38:00.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f7806b840 msgr2=0x7f6f7806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f7806b840 0x7f6f7806dd00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f84004700 tx=0x7f6f84008040 comp rx=0 tx=0).stop 2024-03-25T05:38:00.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f981ef040 msgr2=0x7f6f980c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f981ef040 0x7f6f980c4a80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f980c33d0 tx=0x7f6f9000bf80 comp rx=0 tx=0).stop 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 shutdown_connections 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f7806b840 0x7f6f7806dd00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f981ef040 0x7f6f980c4a80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f980c9460 0x7f6f981ec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 --2- 172.21.15.102:0/4150101565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f7c003f60 0x7f6f981ebcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 >> 172.21.15.102:0/4150101565 conn(0x7f6f980cb340 msgr2=0x7f6f980c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 shutdown_connections 2024-03-25T05:38:00.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:00.409+0000 7f6f9e600640 1 -- 172.21.15.102:0/4150101565 wait complete. 2024-03-25T05:38:00.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-03-25T05:38:01.133 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-25T05:38:01.191 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-25T05:38:01.205 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-25T05:38:01.242 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-25T05:38:01.294 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-25T05:38:01.305 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-25T05:38:01.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.392+0000 7f9ffce00640 1 Processor -- start 2024-03-25T05:38:01.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.392+0000 7f9ffce00640 1 -- start start 2024-03-25T05:38:01.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.394+0000 7f9ffce00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ff80c6f60 0x7f9ff8157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.394+0000 7f9ffce00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80c63c0 con 0x7f9ff806e5b0 2024-03-25T05:38:01.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.394+0000 7f9ffce00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff8162300 con 0x7f9ff806e990 2024-03-25T05:38:01.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.394+0000 7f9ffce00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff806f480 con 0x7f9ff80c6f60 2024-03-25T05:38:01.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.395+0000 7f9ff6800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9ff806e990 0x7f9ff8168b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34560/0 (socket says 172.21.15.102:34560) 2024-03-25T05:38:01.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.395+0000 7f9ff6800640 1 -- 172.21.15.102:0/134422798 learned_addr learned my addr 172.21.15.102:0/134422798 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:01.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.395+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809676908 0 0) 0x7f9ff8162300 con 0x7f9ff806e990 2024-03-25T05:38:01.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.395+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fdc003520 con 0x7f9ff806e990 2024-03-25T05:38:01.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.395+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536069179 0 0) 0x7f9ff80c63c0 con 0x7f9ff806e5b0 2024-03-25T05:38:01.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.395+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8162300 con 0x7f9ff806e5b0 2024-03-25T05:38:01.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 784789941 0 0) 0x7f9fdc003520 con 0x7f9ff806e990 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 >> v2:172.21.15.187:3300/0 conn(0x7f9ff80c6f60 msgr2=0x7f9ff8157f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 --2- 172.21.15.102:0/134422798 >> v2:172.21.15.187:3300/0 conn(0x7f9ff80c6f60 0x7f9ff8157f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 >> v1:172.21.15.102:6789/0 conn(0x7f9ff806e5b0 legacy=0x7f9ff80c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80c5d70 con 0x7f9ff806e990 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f9ff00019f0 con 0x7f9ff806e990 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 >> v1:172.21.15.187:6789/0 conn(0x7f9ff806e990 legacy=0x7f9ff8168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc003b00 0x7f9fdc003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fdc0047c0 0x7f9fdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fdc0052a0 0x7f9fdc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff806f480 con 0x7f9fdc0052a0 2024-03-25T05:38:01.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc00c100 con 0x7f9fdc003b00 2024-03-25T05:38:01.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.396+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc00c2c0 con 0x7f9fdc0047c0 2024-03-25T05:38:01.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.397+0000 7f9ff5400640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fdc0047c0 0x7f9fdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.397+0000 7f9ff5400640 1 -- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc003b00 msgr2=0x7f9fdc003f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-25T05:38:01.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.397+0000 7f9ff5400640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc003b00 0x7f9fdc003f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.397+0000 7f9ff5400640 1 -- 172.21.15.102:0/134422798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fdc0052a0 msgr2=0x7f9fdc00b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:38:01.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.397+0000 7f9ff5400640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fdc0052a0 0x7f9fdc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.397+0000 7f9ff5400640 1 -- 172.21.15.102:0/134422798 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80c5d70 con 0x7f9fdc0047c0 2024-03-25T05:38:01.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.399+0000 7f9ff6800640 1 -- 172.21.15.102:0/134422798 reap_dead start 2024-03-25T05:38:01.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.400+0000 7f9ff5400640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fdc0047c0 0x7f9fdc004c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fe801a7b0 tx=0x7f9fdc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c2b9b9255384494 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.400+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8043600 con 0x7f9fdc0047c0 2024-03-25T05:38:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.400+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe803f050 con 0x7f9fdc0047c0 2024-03-25T05:38:01.393 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.401+0000 7f9ff4a00640 1 -- 172.21.15.102:0/134422798 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8043a00 con 0x7f9fdc0047c0 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.402+0000 7f9ffce00640 1 -- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fdc0047c0 msgr2=0x7f9fdc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.402+0000 7f9ffce00640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fdc0047c0 0x7f9fdc004c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fe801a7b0 tx=0x7f9fdc0057f0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.402+0000 7f9ffce00640 1 -- 172.21.15.102:0/134422798 shutdown_connections 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.402+0000 7f9ffce00640 1 --2- 172.21.15.102:0/134422798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fdc0047c0 0x7f9fdc004c40 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fe801a7b0 tx=0x7f9fdc0057f0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.402+0000 7f9ffce00640 1 -- 172.21.15.102:0/134422798 >> 172.21.15.102:0/134422798 conn(0x7f9ff80c7dd0 msgr2=0x7f9ff80c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.402+0000 7f9ffce00640 1 -- 172.21.15.102:0/134422798 shutdown_connections 2024-03-25T05:38:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.402+0000 7f9ffce00640 1 -- 172.21.15.102:0/134422798 wait complete. 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.405+0000 7f9ffce00640 1 Processor -- start 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.406+0000 7f9ffce00640 1 -- start start 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.408+0000 7f9ffce00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc0047c0 0x7f9ff815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.408+0000 7f9ffce00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ff814d3e0 0x7f9ff81ef070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.408+0000 7f9ffce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff814d800 0x7f9ff814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.409+0000 7f9ff6800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff814d800 0x7f9ff814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.409+0000 7f9ff6800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff814d800 0x7f9ff814fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56616/0 (socket says 172.21.15.102:56616) 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.409+0000 7f9ff6800640 1 -- 172.21.15.102:0/3801644518 learned_addr learned my addr 172.21.15.102:0/3801644518 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.409+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff814ab10 con 0x7f9ff814d800 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.409+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff81eebe0 con 0x7f9fdc0047c0 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.409+0000 7f9ff5400640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ff814d3e0 0x7f9ff81ef070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.409+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff81516b0 con 0x7f9ff814d3e0 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.410+0000 7f9ff5e00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc0047c0 0x7f9ff815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.412+0000 7f9ff6800640 1 -- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ff814d3e0 msgr2=0x7f9ff81ef070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.412+0000 7f9ff6800640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ff814d3e0 0x7f9ff81ef070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.412+0000 7f9ff6800640 1 -- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc0047c0 msgr2=0x7f9ff815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.414+0000 7f9ff5400640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ff814d3e0 0x7f9ff81ef070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:38:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.414+0000 7f9ff6800640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc0047c0 0x7f9ff815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.414+0000 7f9ff6800640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8151990 con 0x7f9ff814d800 2024-03-25T05:38:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.418+0000 7f9ff5e00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc0047c0 0x7f9ff815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:38:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.419+0000 7f9ff6800640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff814d800 0x7f9ff814fd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80c2680 tx=0x7f9ff000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.419+0000 7f9fee000640 1 -- 172.21.15.102:0/3801644518 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000a610 con 0x7f9ff814d800 2024-03-25T05:38:01.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.420+0000 7f9fee000640 1 -- 172.21.15.102:0/3801644518 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff000a770 con 0x7f9ff814d800 2024-03-25T05:38:01.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.420+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8151c70 con 0x7f9ff814d800 2024-03-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.421+0000 7f9fee000640 1 -- 172.21.15.102:0/3801644518 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000ab00 con 0x7f9ff814d800 2024-03-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.422+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff814a330 con 0x7f9ff814d800 2024-03-25T05:38:01.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-25T05:38:01.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.427+0000 7f9fee000640 1 -- 172.21.15.102:0/3801644518 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ff000ac60 con 0x7f9ff814d800 2024-03-25T05:38:01.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.432+0000 7f9fee000640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9fd806b810 0x7f9fd806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.432+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff8152190 con 0x7f9ff814d800 2024-03-25T05:38:01.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.433+0000 7f9ff5e00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9fd806b810 0x7f9fd806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.433+0000 7f9fee000640 1 -- 172.21.15.102:0/3801644518 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9ff00581a0 con 0x7f9ff814d800 2024-03-25T05:38:01.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.433+0000 7f9ff5e00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9fd806b810 0x7f9fd806dcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4001820 tx=0x7f9fe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.445+0000 7f9fee000640 1 -- 172.21.15.102:0/3801644518 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9ff8152190 con 0x7f9ff814d800 2024-03-25T05:38:01.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.472+0000 7ff25ec00640 1 Processor -- start 2024-03-25T05:38:01.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.472+0000 7ff25ec00640 1 -- start start 2024-03-25T05:38:01.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.474+0000 7ff25ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff258158230 0x7ff2580cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.474+0000 7ff25ec00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2580cb1f0 0x7ff2580b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.474+0000 7ff25ce00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2580cb1f0 0x7ff2580b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.474+0000 7ff25ce00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2580cb1f0 0x7ff2580b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48602/0 (socket says 172.21.15.102:48602) 2024-03-25T05:38:01.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.478+0000 7ff25d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff258158230 0x7ff2580cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.478+0000 7ff25d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff258158230 0x7ff2580cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58208/0 (socket says 172.21.15.102:58208) 2024-03-25T05:38:01.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.478+0000 7ff25e200640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff25806b250 0x7ff2580ca1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:32814/0 (socket says 172.21.15.102:32814) 2024-03-25T05:38:01.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.482+0000 7ff25ce00640 1 -- 172.21.15.102:0/3342873178 learned_addr learned my addr 172.21.15.102:0/3342873178 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.482+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff258161f40 con 0x7ff25806b250 2024-03-25T05:38:01.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.482+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2580cbc10 con 0x7ff2580cb1f0 2024-03-25T05:38:01.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.482+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581621c0 con 0x7ff258158230 2024-03-25T05:38:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.485+0000 7ff257e00640 1 -- 172.21.15.102:0/3342873178 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704543057 0 0) 0x7ff258161f40 con 0x7ff25806b250 2024-03-25T05:38:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.485+0000 7ff257e00640 1 -- 172.21.15.102:0/3342873178 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff240003520 con 0x7ff25806b250 2024-03-25T05:38:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.485+0000 7ff25d800640 1 -- 172.21.15.102:0/3342873178 >> v2:172.21.15.187:3300/0 conn(0x7ff2580cb1f0 msgr2=0x7ff2580b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.485+0000 7ff25d800640 1 --2- 172.21.15.102:0/3342873178 >> v2:172.21.15.187:3300/0 conn(0x7ff2580cb1f0 0x7ff2580b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.485+0000 7ff25d800640 1 -- 172.21.15.102:0/3342873178 >> v1:172.21.15.102:6789/0 conn(0x7ff25806b250 legacy=0x7ff2580ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.485+0000 7ff25d800640 1 -- 172.21.15.102:0/3342873178 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258162480 con 0x7ff258158230 2024-03-25T05:38:01.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.490+0000 7ff25d800640 1 --2- 172.21.15.102:0/3342873178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff258158230 0x7ff2580cb6d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2440097a0 tx=0x7ff24402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5baae97df4e45d0c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.490+0000 7ff257e00640 1 -- 172.21.15.102:0/3342873178 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244030610 con 0x7ff258158230 2024-03-25T05:38:01.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.490+0000 7ff257e00640 1 -- 172.21.15.102:0/3342873178 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff244030770 con 0x7ff258158230 2024-03-25T05:38:01.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.490+0000 7ff257e00640 1 -- 172.21.15.102:0/3342873178 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244030b40 con 0x7ff258158230 2024-03-25T05:38:01.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.491+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff258158230 msgr2=0x7ff2580cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.491+0000 7ff25ec00640 1 --2- 172.21.15.102:0/3342873178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff258158230 0x7ff2580cb6d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2440097a0 tx=0x7ff24402b960 comp rx=0 tx=0).stop 2024-03-25T05:38:01.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.493+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 shutdown_connections 2024-03-25T05:38:01.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.493+0000 7ff25ec00640 1 --2- 172.21.15.102:0/3342873178 >> v2:172.21.15.187:3300/0 conn(0x7ff2580cb1f0 0x7ff2580b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.493+0000 7ff25ec00640 1 --2- 172.21.15.102:0/3342873178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff258158230 0x7ff2580cb6d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.493+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 >> 172.21.15.102:0/3342873178 conn(0x7ff2580cf3e0 msgr2=0x7ff2580cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.494+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 shutdown_connections 2024-03-25T05:38:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.497+0000 7ff25ec00640 1 -- 172.21.15.102:0/3342873178 wait complete. 2024-03-25T05:38:01.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.505+0000 7ff25ec00640 1 Processor -- start 2024-03-25T05:38:01.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.506+0000 7ff25ec00640 1 -- start start 2024-03-25T05:38:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.511+0000 7ff25ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25806b250 0x7ff258156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.511+0000 7ff25ec00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2580cb1f0 0x7ff2581f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25806b250 0x7ff258156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25ce00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2580cb1f0 0x7ff2581f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25ce00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2580cb1f0 0x7ff2581f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48608/0 (socket says 172.21.15.102:48608) 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25806b250 0x7ff258156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58222/0 (socket says 172.21.15.102:58222) 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25ce00640 1 -- 172.21.15.102:0/1859066279 learned_addr learned my addr 172.21.15.102:0/1859066279 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25ec00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff258158230 0x7ff2581f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25ec00640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581f3dd0 con 0x7ff258158230 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25ec00640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25815b330 con 0x7ff2580cb1f0 2024-03-25T05:38:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.515+0000 7ff25ec00640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25815a7b0 con 0x7ff25806b250 2024-03-25T05:38:01.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.520+0000 7ff25d800640 1 -- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2580cb1f0 msgr2=0x7ff2581f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.520+0000 7ff25d800640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2580cb1f0 0x7ff2581f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.520+0000 7ff25d800640 1 -- 172.21.15.102:0/1859066279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff258158230 msgr2=0x7ff2581f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.520+0000 7ff25e200640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff258158230 0x7ff2581f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.520+0000 7ff25d800640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff258158230 0x7ff2581f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.520+0000 7ff25d800640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244009400 con 0x7ff25806b250 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.520+0000 7ff25e200640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff258158230 0x7ff2581f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.521+0000 7ff25d800640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25806b250 0x7ff258156940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2581620f0 tx=0x7ff244004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.521+0000 7ff255600640 1 -- 172.21.15.102:0/1859066279 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24403e040 con 0x7ff25806b250 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.521+0000 7ff255600640 1 -- 172.21.15.102:0/1859066279 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2440399a0 con 0x7ff25806b250 2024-03-25T05:38:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.521+0000 7ff255600640 1 -- 172.21.15.102:0/1859066279 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244039d10 con 0x7ff25806b250 2024-03-25T05:38:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.526+0000 7ff25ec00640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25815aa90 con 0x7ff25806b250 2024-03-25T05:38:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.526+0000 7ff25ec00640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25815b050 con 0x7ff25806b250 2024-03-25T05:38:01.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.531+0000 7ff255600640 1 -- 172.21.15.102:0/1859066279 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff24404d3b0 con 0x7ff25806b250 2024-03-25T05:38:01.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.533+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c005290 con 0x7ff25806b250 2024-03-25T05:38:01.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.534+0000 7ff255600640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff23806b910 0x7ff23806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.534+0000 7ff255600640 1 -- 172.21.15.102:0/1859066279 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff2440ac930 con 0x7ff25806b250 2024-03-25T05:38:01.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.535+0000 7ff25ce00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff23806b910 0x7ff23806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.535+0000 7ff25ce00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff23806b910 0x7ff23806ddd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff258153df0 tx=0x7ff250009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.551+0000 7ff255600640 1 -- 172.21.15.102:0/1859066279 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff244077130 con 0x7ff25806b250 2024-03-25T05:38:01.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.556+0000 7f77d8a00640 1 Processor -- start 2024-03-25T05:38:01.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.557+0000 7f77d8a00640 1 -- start start 2024-03-25T05:38:01.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.559+0000 7f77d8a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77d4158420 0x7f77d40720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.563+0000 7f77d8a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.564+0000 7f77d8a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77d406f400 0x7f77d40715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.564+0000 7f77d8a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40c58c0 con 0x7f77d4158420 2024-03-25T05:38:01.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.564+0000 7f77d1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.565+0000 7f77d2800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77d406f400 0x7f77d40715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.565+0000 7f77d2800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77d406f400 0x7f77d40715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48610/0 (socket says 172.21.15.102:48610) 2024-03-25T05:38:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.565+0000 7f77d2800640 1 -- 172.21.15.102:0/3348407284 learned_addr learned my addr 172.21.15.102:0/3348407284 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.565+0000 7f77d8a00640 1 -- 172.21.15.102:0/3348407284 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40c2dc0 con 0x7f77d406f400 2024-03-25T05:38:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.565+0000 7f77d1e00640 1 --2- 172.21.15.102:0/3348407284 >> v2:172.21.15.102:3300/0 conn(0x7f77d4158420 0x7f77d40720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.566+0000 7f77d8a00640 1 -- 172.21.15.102:0/3348407284 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415df40 con 0x7f77d415ec30 2024-03-25T05:38:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.567+0000 7f77d1e00640 1 -- 172.21.15.102:0/3348407284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 msgr2=0x7f77d40c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.567+0000 7f77d1e00640 1 --2- 172.21.15.102:0/3348407284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.567+0000 7f77d1e00640 1 -- 172.21.15.102:0/3348407284 >> v2:172.21.15.187:3300/0 conn(0x7f77d406f400 msgr2=0x7f77d40715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.567+0000 7f77d1e00640 1 --2- 172.21.15.102:0/3348407284 >> v2:172.21.15.187:3300/0 conn(0x7f77d406f400 0x7f77d40715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.567+0000 7f77d1e00640 1 -- 172.21.15.102:0/3348407284 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4072620 con 0x7f77d4158420 2024-03-25T05:38:01.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.570+0000 7f77d1e00640 1 --2- 172.21.15.102:0/3348407284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 0x7f77d40720e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77d406c4e0 tx=0x7f77bc02bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a7447b92685554 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.571+0000 7f77d0a00640 1 -- 172.21.15.102:0/3348407284 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc02d710 con 0x7f77d4158420 2024-03-25T05:38:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.571+0000 7f77d0a00640 1 -- 172.21.15.102:0/3348407284 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc02d870 con 0x7f77d4158420 2024-03-25T05:38:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.572+0000 7f77d8a00640 1 -- 172.21.15.102:0/3348407284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 msgr2=0x7f77d40720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.572+0000 7f77d0a00640 1 -- 172.21.15.102:0/3348407284 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc02d710 con 0x7f77d4158420 2024-03-25T05:38:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.573+0000 7f77d8a00640 1 --2- 172.21.15.102:0/3348407284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 0x7f77d40720e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77d406c4e0 tx=0x7f77bc02bb60 comp rx=0 tx=0).stop 2024-03-25T05:38:01.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.573+0000 7f77d8a00640 1 -- 172.21.15.102:0/3348407284 shutdown_connections 2024-03-25T05:38:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.573+0000 7f77d8a00640 1 --2- 172.21.15.102:0/3348407284 >> v2:172.21.15.187:3300/0 conn(0x7f77d406f400 0x7f77d40715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.574+0000 7f77d8a00640 1 --2- 172.21.15.102:0/3348407284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.574+0000 7f77d8a00640 1 --2- 172.21.15.102:0/3348407284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 0x7f77d40720e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.574+0000 7f77d8a00640 1 -- 172.21.15.102:0/3348407284 >> 172.21.15.102:0/3348407284 conn(0x7f77d40cb340 msgr2=0x7f77d40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.576+0000 7f34d9a00640 1 Processor -- start 2024-03-25T05:38:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.576+0000 7f34d9a00640 1 -- start start 2024-03-25T05:38:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.578+0000 7f34d9a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34d4167560 0x7f34d40722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.578+0000 7f34d9a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.579+0000 7f34d2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.579+0000 7f34d2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d406e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58228/0 (socket says 172.21.15.102:58228) 2024-03-25T05:38:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.579+0000 7f34d2a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34d4167560 0x7f34d40722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.579+0000 7f34d2a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34d4167560 0x7f34d40722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48616/0 (socket says 172.21.15.102:48616) 2024-03-25T05:38:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.579+0000 7f77d8a00640 1 -- 172.21.15.102:0/3348407284 shutdown_connections 2024-03-25T05:38:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.579+0000 7f77d8a00640 1 -- 172.21.15.102:0/3348407284 wait complete. 2024-03-25T05:38:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.579+0000 7f34d2000640 1 -- 172.21.15.102:0/2799841974 learned_addr learned my addr 172.21.15.102:0/2799841974 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.580+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d406f2b0 con 0x7f34d406e880 2024-03-25T05:38:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.580+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d40714f0 con 0x7f34d4167560 2024-03-25T05:38:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.580+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40717d0 con 0x7f34d40727f0 2024-03-25T05:38:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.581+0000 7f34d2000640 1 -- 172.21.15.102:0/2799841974 >> v2:172.21.15.187:3300/0 conn(0x7f34d4167560 msgr2=0x7f34d40722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.581+0000 7f34d2000640 1 --2- 172.21.15.102:0/2799841974 >> v2:172.21.15.187:3300/0 conn(0x7f34d4167560 0x7f34d40722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.581+0000 7f34d2000640 1 -- 172.21.15.102:0/2799841974 >> v1:172.21.15.102:6789/0 conn(0x7f34d406e880 legacy=0x7f34d40c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.581+0000 7f34d2000640 1 -- 172.21.15.102:0/2799841974 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4071ab0 con 0x7f34d40727f0 2024-03-25T05:38:01.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.583+0000 7f34d2a00640 1 --2- 172.21.15.102:0/2799841974 >> v2:172.21.15.187:3300/0 conn(0x7f34d4167560 0x7f34d40722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-03-25T05:38:01.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.583+0000 7f34d2000640 1 --2- 172.21.15.102:0/2799841974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d406e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34c00090e0 tx=0x7f34c002cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44f113d7cad8501b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.585+0000 7f34d1600640 1 -- 172.21.15.102:0/2799841974 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c002e900 con 0x7f34d40727f0 2024-03-25T05:38:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.586+0000 7f34d1600640 1 -- 172.21.15.102:0/2799841974 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c002ea60 con 0x7f34d40727f0 2024-03-25T05:38:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.587+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 msgr2=0x7f34d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.587+0000 7f34d1600640 1 -- 172.21.15.102:0/2799841974 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c002e900 con 0x7f34d40727f0 2024-03-25T05:38:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.588+0000 7f34d9a00640 1 --2- 172.21.15.102:0/2799841974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d406e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34c00090e0 tx=0x7f34c002cb40 comp rx=0 tx=0).stop 2024-03-25T05:38:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.588+0000 7f77d8a00640 1 Processor -- start 2024-03-25T05:38:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.588+0000 7f77d8a00640 1 -- start start 2024-03-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.590+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 shutdown_connections 2024-03-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.590+0000 7f34d9a00640 1 --2- 172.21.15.102:0/2799841974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d406e340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.590+0000 7f34d9a00640 1 --2- 172.21.15.102:0/2799841974 >> v2:172.21.15.187:3300/0 conn(0x7f34d4167560 0x7f34d40722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.590+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 >> 172.21.15.102:0/2799841974 conn(0x7f34d40c7dd0 msgr2=0x7f34d40c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.592+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 shutdown_connections 2024-03-25T05:38:01.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.593+0000 7f34d9a00640 1 -- 172.21.15.102:0/2799841974 wait complete. 2024-03-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.595+0000 7f77d8a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d406f400 0x7f77d414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.595+0000 7f77d8a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 0x7f77d41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.596+0000 7f77d8a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.596+0000 7f77d1e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d406f400 0x7f77d414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.596+0000 7f77d8a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4152760 con 0x7f77d4158420 2024-03-25T05:38:01.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.596+0000 7f77d8a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4152970 con 0x7f77d406f400 2024-03-25T05:38:01.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.596+0000 7f77d8a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4152c50 con 0x7f77d415ec30 2024-03-25T05:38:01.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.596+0000 7f77d1e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d406f400 0x7f77d414d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48630/0 (socket says 172.21.15.102:48630) 2024-03-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.596+0000 7f77d1e00640 1 -- 172.21.15.102:0/714975247 learned_addr learned my addr 172.21.15.102:0/714975247 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.597+0000 7f77d2800640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.597+0000 7f77d1e00640 1 -- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 msgr2=0x7f77d40c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.597+0000 7f77d1e00640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.597+0000 7f77d1e00640 1 -- 172.21.15.102:0/714975247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 msgr2=0x7f77d41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.597+0000 7f77d1e00640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 0x7f77d41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.597+0000 7f77d1e00640 1 -- 172.21.15.102:0/714975247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc009400 con 0x7f77d406f400 2024-03-25T05:38:01.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.602+0000 7f77d1e00640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d406f400 0x7f77d414d160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77bc000c00 tx=0x7f77bc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.605+0000 7f77ca000640 1 -- 172.21.15.102:0/714975247 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc003810 con 0x7f77d406f400 2024-03-25T05:38:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.605+0000 7f77ca000640 1 -- 172.21.15.102:0/714975247 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc003990 con 0x7f77d406f400 2024-03-25T05:38:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.605+0000 7f77ca000640 1 -- 172.21.15.102:0/714975247 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc003d40 con 0x7f77d406f400 2024-03-25T05:38:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.605+0000 7f77d8a00640 1 -- 172.21.15.102:0/714975247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d41520a0 con 0x7f77d406f400 2024-03-25T05:38:01.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.598+0000 7f34d9a00640 1 Processor -- start 2024-03-25T05:38:01.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.609+0000 7f77d8a00640 1 -- 172.21.15.102:0/714975247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d40cad90 con 0x7f77d406f400 2024-03-25T05:38:01.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.607+0000 7f34d9a00640 1 -- start start 2024-03-25T05:38:01.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.610+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a4005290 con 0x7f77d406f400 2024-03-25T05:38:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.613+0000 7f34d9a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d406e880 0x7f34d420dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.613+0000 7f34d9a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d40c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.618+0000 7f34d9a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d4167560 0x7f34d4168740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.618+0000 7f34d9a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d420e400 con 0x7f34d406e880 2024-03-25T05:38:01.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.618+0000 7f34d9a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d42011f0 con 0x7f34d4167560 2024-03-25T05:38:01.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.618+0000 7f34d9a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4163250 con 0x7f34d40727f0 2024-03-25T05:38:01.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.618+0000 7f34d3400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d4167560 0x7f34d4168740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.619+0000 7f34d3400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d4167560 0x7f34d4168740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48636/0 (socket says 172.21.15.102:48636) 2024-03-25T05:38:01.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.619+0000 7f34d3400640 1 -- 172.21.15.102:0/1128219226 learned_addr learned my addr 172.21.15.102:0/1128219226 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.619+0000 7f34d2a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d406e880 0x7f34d420dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.622+0000 7f34d2000640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d40c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.622+0000 7f34d3400640 1 -- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 msgr2=0x7f34d40c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.622+0000 7f34d3400640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d40c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.622+0000 7f34d3400640 1 -- 172.21.15.102:0/1128219226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d406e880 msgr2=0x7f34d420dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.622+0000 7f34d3400640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d406e880 0x7f34d420dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.622+0000 7f34d3400640 1 -- 172.21.15.102:0/1128219226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0009d60 con 0x7f34d4167560 2024-03-25T05:38:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.623+0000 7f77ca000640 1 -- 172.21.15.102:0/714975247 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77bc041470 con 0x7f77d406f400 2024-03-25T05:38:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.625+0000 7f34d3400640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d4167560 0x7f34d4168740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c710 tx=0x7f34cc00cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.629+0000 7f77ca000640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f77b006b910 0x7f77b006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.629+0000 7f34caa00640 1 -- 172.21.15.102:0/1128219226 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc006d50 con 0x7f34d4167560 2024-03-25T05:38:01.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.630+0000 7f34caa00640 1 -- 172.21.15.102:0/1128219226 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00ce20 con 0x7f34d4167560 2024-03-25T05:38:01.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.630+0000 7f34caa00640 1 -- 172.21.15.102:0/1128219226 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc003bb0 con 0x7f34d4167560 2024-03-25T05:38:01.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.629+0000 7f77ca000640 1 -- 172.21.15.102:0/714975247 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f77bc031070 con 0x7f77d406f400 2024-03-25T05:38:01.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.629+0000 7f77ca000640 1 -- 172.21.15.102:0/714975247 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f77bc0dae90 con 0x7f77d406f400 2024-03-25T05:38:01.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.635+0000 7f77d1400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f77b006b910 0x7f77b006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.636+0000 7f77d1400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f77b006b910 0x7f77b006ddd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f77c4006fd0 tx=0x7f77c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.631+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d41628e0 con 0x7f34d4167560 2024-03-25T05:38:01.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.631+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d4201440 con 0x7f34d4167560 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.637+0000 7f0861a00640 1 Processor -- start 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.637+0000 7f0861a00640 1 -- start start 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.639+0000 7f0861a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f085c06e5b0 0x7f085c0c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.640+0000 7f0861a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f085c06f660 0x7f085c0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.640+0000 7f0861a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085c0c63c0 con 0x7f085c06e990 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.640+0000 7f0861a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c06f480 con 0x7f085c06e5b0 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.640+0000 7f0861a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c162300 con 0x7f085c06f660 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.640+0000 7f085aa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f085c06e5b0 0x7f085c0c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.640+0000 7f085a000640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f085c06e990 0x7f085c157f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:32828/0 (socket says 172.21.15.102:32828) 2024-03-25T05:38:01.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.641+0000 7f085a000640 1 -- 172.21.15.102:0/3707199935 learned_addr learned my addr 172.21.15.102:0/3707199935 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:01.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.642+0000 7f085b400640 1 --2- 172.21.15.102:0/3707199935 >> v2:172.21.15.187:3300/0 conn(0x7f085c06f660 0x7f085c0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.642+0000 7f0859600640 1 -- 172.21.15.102:0/3707199935 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162734001 0 0) 0x7f085c0c63c0 con 0x7f085c06e990 2024-03-25T05:38:01.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.642+0000 7f085aa00640 1 -- 172.21.15.102:0/3707199935 >> v2:172.21.15.187:3300/0 conn(0x7f085c06f660 msgr2=0x7f085c0c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.642+0000 7f085aa00640 1 --2- 172.21.15.102:0/3707199935 >> v2:172.21.15.187:3300/0 conn(0x7f085c06f660 0x7f085c0c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.642+0000 7f085aa00640 1 -- 172.21.15.102:0/3707199935 >> v1:172.21.15.102:6789/0 conn(0x7f085c06e990 legacy=0x7f085c157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.642+0000 7f085aa00640 1 -- 172.21.15.102:0/3707199935 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0c5d70 con 0x7f085c06e5b0 2024-03-25T05:38:01.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.641+0000 7f34caa00640 1 -- 172.21.15.102:0/1128219226 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34cc003d10 con 0x7f34d4167560 2024-03-25T05:38:01.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.642+0000 7f34caa00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f34b406b910 0x7f34b406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.643+0000 7f34caa00640 1 -- 172.21.15.102:0/1128219226 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f34cc08a0d0 con 0x7f34d4167560 2024-03-25T05:38:01.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.643+0000 7f34d2a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f34b406b910 0x7f34b406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.644+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4072e20 con 0x7f34d4167560 2024-03-25T05:38:01.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.645+0000 7f34d2a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f34b406b910 0x7f34b406ddd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34c400a950 tx=0x7f34c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.646+0000 7f085aa00640 1 --2- 172.21.15.102:0/3707199935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06e5b0 0x7f085c0c6850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f085c073530 tx=0x7f085402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7d411d2888b505 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.647+0000 7f0859600640 1 -- 172.21.15.102:0/3707199935 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085402cd00 con 0x7f085c06e5b0 2024-03-25T05:38:01.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.647+0000 7f0859600640 1 -- 172.21.15.102:0/3707199935 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085402ce60 con 0x7f085c06e5b0 2024-03-25T05:38:01.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.648+0000 7f0861a00640 1 -- 172.21.15.102:0/3707199935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06e5b0 msgr2=0x7f085c0c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.648+0000 7f0861a00640 1 --2- 172.21.15.102:0/3707199935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06e5b0 0x7f085c0c6850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f085c073530 tx=0x7f085402bf50 comp rx=0 tx=0).stop 2024-03-25T05:38:01.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.648+0000 7f0861a00640 1 -- 172.21.15.102:0/3707199935 shutdown_connections 2024-03-25T05:38:01.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.648+0000 7f0861a00640 1 --2- 172.21.15.102:0/3707199935 >> v2:172.21.15.187:3300/0 conn(0x7f085c06f660 0x7f085c0c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.648+0000 7f0861a00640 1 --2- 172.21.15.102:0/3707199935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06e5b0 0x7f085c0c6850 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f085c073530 tx=0x7f085402bf50 comp rx=0 tx=0).stop 2024-03-25T05:38:01.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.648+0000 7f0861a00640 1 -- 172.21.15.102:0/3707199935 >> 172.21.15.102:0/3707199935 conn(0x7f085c0c7dd0 msgr2=0x7f085c0c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.650+0000 7f34caa00640 1 -- 172.21.15.102:0/1128219226 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f34cc0582c0 con 0x7f34d4167560 2024-03-25T05:38:01.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.654+0000 7f0861a00640 1 -- 172.21.15.102:0/3707199935 shutdown_connections 2024-03-25T05:38:01.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.658+0000 7f0861a00640 1 -- 172.21.15.102:0/3707199935 wait complete. 2024-03-25T05:38:01.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.660+0000 7f0861a00640 1 Processor -- start 2024-03-25T05:38:01.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.675+0000 7f0861a00640 1 -- start start 2024-03-25T05:38:01.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.683+0000 7f0861a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085c06e990 0x7f085c135060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.683+0000 7f0861a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06f660 0x7f085c146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.683+0000 7f0861a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085c14a9d0 0x7f085c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.684+0000 7f085a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06f660 0x7f085c146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.684+0000 7f085a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06f660 0x7f085c146350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56680/0 (socket says 172.21.15.102:56680) 2024-03-25T05:38:01.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.684+0000 7f085aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085c06e990 0x7f085c135060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.684+0000 7f085aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085c06e990 0x7f085c135060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58258/0 (socket says 172.21.15.102:58258) 2024-03-25T05:38:01.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.688+0000 7f085b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085c14a9d0 0x7f085c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.688+0000 7f085a000640 1 -- 172.21.15.102:0/4279937936 learned_addr learned my addr 172.21.15.102:0/4279937936 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.688+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15f370 con 0x7f085c06f660 2024-03-25T05:38:01.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.688+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c13d140 con 0x7f085c14a9d0 2024-03-25T05:38:01.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.688+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c1355a0 con 0x7f085c06e990 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.691+0000 7f085b400640 1 -- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085c06e990 msgr2=0x7f085c135060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.691+0000 7f085b400640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085c06e990 0x7f085c135060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.691+0000 7f085b400640 1 -- 172.21.15.102:0/4279937936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06f660 msgr2=0x7f085c146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.691+0000 7f085b400640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06f660 0x7f085c146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.692+0000 7f085b400640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854009a70 con 0x7f085c14a9d0 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.692+0000 7f085aa00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085c06e990 0x7f085c135060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.692+0000 7f085a000640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06f660 0x7f085c146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.695+0000 7f085b400640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085c14a9d0 0x7f085c14ae80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f084800d530 tx=0x7f084800d9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.695+0000 7f0852a00640 1 -- 172.21.15.102:0/4279937936 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848004020 con 0x7f085c14a9d0 2024-03-25T05:38:01.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.695+0000 7f0852a00640 1 -- 172.21.15.102:0/4279937936 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480041a0 con 0x7f085c14a9d0 2024-03-25T05:38:01.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.695+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c13c530 con 0x7f085c14a9d0 2024-03-25T05:38:01.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.695+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c13caf0 con 0x7f085c14a9d0 2024-03-25T05:38:01.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.696+0000 7f0852a00640 1 -- 172.21.15.102:0/4279937936 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848004350 con 0x7f085c14a9d0 2024-03-25T05:38:01.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.701+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0834005290 con 0x7f085c14a9d0 2024-03-25T05:38:01.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.716+0000 7f0852a00640 1 -- 172.21.15.102:0/4279937936 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0848014620 con 0x7f085c14a9d0 2024-03-25T05:38:01.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.723+0000 7f0852a00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f083c06b910 0x7f083c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.723+0000 7f0852a00640 1 -- 172.21.15.102:0/4279937936 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f084808a670 con 0x7f085c14a9d0 2024-03-25T05:38:01.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.723+0000 7f085aa00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f083c06b910 0x7f083c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.730+0000 7f0852a00640 1 -- 172.21.15.102:0/4279937936 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f084808cbe0 con 0x7f085c14a9d0 2024-03-25T05:38:01.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.732+0000 7f085aa00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f083c06b910 0x7f083c06ddd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0854036000 tx=0x7f0854030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.772+0000 7fda66e00640 1 Processor -- start 2024-03-25T05:38:01.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.773+0000 7fda66e00640 1 -- start start 2024-03-25T05:38:01.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda66e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fda600c5210 0x7fda600c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda66e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda601688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda66e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda600c4e70 con 0x7fda60158420 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda66e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6006bc20 con 0x7fda600c5210 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda66e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda600c6ad0 con 0x7fda6015e050 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda64e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda601688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda64e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda601688f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58270/0 (socket says 172.21.15.102:58270) 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.775+0000 7fda64e00640 1 -- 172.21.15.102:0/633724629 learned_addr learned my addr 172.21.15.102:0/633724629 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.776+0000 7fda64e00640 1 -- 172.21.15.102:0/633724629 >> v2:172.21.15.102:3300/0 conn(0x7fda600c5210 msgr2=0x7fda600c6f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.776+0000 7fda64e00640 1 --2- 172.21.15.102:0/633724629 >> v2:172.21.15.102:3300/0 conn(0x7fda600c5210 0x7fda600c6f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.776+0000 7fda64e00640 1 -- 172.21.15.102:0/633724629 >> v1:172.21.15.102:6789/0 conn(0x7fda60158420 legacy=0x7fda60071510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:38:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.776+0000 7fda64e00640 1 -- 172.21.15.102:0/633724629 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60158800 con 0x7fda6015e050 2024-03-25T05:38:01.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.792+0000 7fda64e00640 1 --2- 172.21.15.102:0/633724629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda601688f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda58009e50 tx=0x7fda5802bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=407387dc3fec224d server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.796+0000 7fda5ea00640 1 -- 172.21.15.102:0/633724629 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5802cb20 con 0x7fda6015e050 2024-03-25T05:38:01.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.796+0000 7fda5ea00640 1 -- 172.21.15.102:0/633724629 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5802cc80 con 0x7fda6015e050 2024-03-25T05:38:01.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.796+0000 7fda5ea00640 1 -- 172.21.15.102:0/633724629 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580343f0 con 0x7fda6015e050 2024-03-25T05:38:01.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.798+0000 7fda66e00640 1 -- 172.21.15.102:0/633724629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 msgr2=0x7fda601688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.799+0000 7fda66e00640 1 --2- 172.21.15.102:0/633724629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda601688f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda58009e50 tx=0x7fda5802bf80 comp rx=0 tx=0).stop 2024-03-25T05:38:01.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.803+0000 7fda66e00640 1 -- 172.21.15.102:0/633724629 shutdown_connections 2024-03-25T05:38:01.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.803+0000 7fda66e00640 1 --2- 172.21.15.102:0/633724629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda601688f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.803+0000 7fda66e00640 1 --2- 172.21.15.102:0/633724629 >> v2:172.21.15.102:3300/0 conn(0x7fda600c5210 0x7fda600c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.803+0000 7fda66e00640 1 -- 172.21.15.102:0/633724629 >> 172.21.15.102:0/633724629 conn(0x7fda600cb340 msgr2=0x7fda600cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.807+0000 7fda66e00640 1 -- 172.21.15.102:0/633724629 shutdown_connections 2024-03-25T05:38:01.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.807+0000 7fda66e00640 1 -- 172.21.15.102:0/633724629 wait complete. 2024-03-25T05:38:01.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.809+0000 7fda66e00640 1 Processor -- start 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.810+0000 7fda66e00640 1 -- start start 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.811+0000 7fda66e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda600c5210 0x7fda6015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.811+0000 7fda66e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda60158420 0x7fda60139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.811+0000 7fda66e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda60161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.811+0000 7fda66e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60146550 con 0x7fda60158420 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.811+0000 7fda66e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601ffb60 con 0x7fda600c5210 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.811+0000 7fda66e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6015b380 con 0x7fda6015e050 2024-03-25T05:38:01.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.817+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda600c5210 0x7fda6015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.819+0000 7f7b0a200640 1 Processor -- start 2024-03-25T05:38:01.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.819+0000 7f7b0a200640 1 -- start start 2024-03-25T05:38:01.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.817+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda600c5210 0x7fda6015aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48660/0 (socket says 172.21.15.102:48660) 2024-03-25T05:38:01.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.817+0000 7fda5fe00640 1 -- 172.21.15.102:0/2029030522 learned_addr learned my addr 172.21.15.102:0/2029030522 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.817+0000 7fda64e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda60161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.818+0000 7fda5f400640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda60158420 0x7fda60139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.820+0000 7f7b0a200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c5940 0x7f7b040ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.821+0000 7f7b0a200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b040c7940 0x7f7b040c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.821+0000 7f7b0a200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040c8310 con 0x7f7b040c6240 2024-03-25T05:38:01.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.821+0000 7f7b0a200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040caa10 con 0x7f7b040c7940 2024-03-25T05:38:01.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.821+0000 7f7b0a200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0415a060 con 0x7f7b040c5940 2024-03-25T05:38:01.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.821+0000 7f7b03e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b040c7940 0x7f7b040c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.821+0000 7f7b03e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b040c7940 0x7f7b040c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48670/0 (socket says 172.21.15.102:48670) 2024-03-25T05:38:01.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.821+0000 7f7b03e00640 1 -- 172.21.15.102:0/3548733198 learned_addr learned my addr 172.21.15.102:0/3548733198 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.822+0000 7fda5f400640 1 -- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 msgr2=0x7fda60161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.822+0000 7fda5f400640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda60161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.822+0000 7fda5f400640 1 -- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda600c5210 msgr2=0x7fda6015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.822+0000 7fda5f400640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda600c5210 0x7fda6015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.822+0000 7fda5f400640 1 -- 172.21.15.102:0/2029030522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda58009b30 con 0x7fda60158420 2024-03-25T05:38:01.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.822+0000 7fda5f400640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda60158420 0x7fda60139e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00b750 tx=0x7fda4c00bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.823+0000 7f7b02000640 1 -- 172.21.15.102:0/3548733198 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014810549 0 0) 0x7f7b040c8310 con 0x7f7b040c6240 2024-03-25T05:38:01.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.823+0000 7f7b02000640 1 -- 172.21.15.102:0/3548733198 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ae8003520 con 0x7f7b040c6240 2024-03-25T05:38:01.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.824+0000 7f7b03e00640 1 -- 172.21.15.102:0/3548733198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c5940 msgr2=0x7f7b040ca4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T05:38:01.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.824+0000 7f7b03e00640 1 --2- 172.21.15.102:0/3548733198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c5940 0x7f7b040ca4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.824+0000 7f7b03e00640 1 -- 172.21.15.102:0/3548733198 >> v1:172.21.15.102:6789/0 conn(0x7f7b040c6240 legacy=0x7f7b040cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.824+0000 7f7b03e00640 1 -- 172.21.15.102:0/3548733198 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0415a340 con 0x7f7b040c7940 2024-03-25T05:38:01.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.827+0000 7fda57e00640 1 -- 172.21.15.102:0/2029030522 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00c720 con 0x7fda60158420 2024-03-25T05:38:01.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.827+0000 7fda57e00640 1 -- 172.21.15.102:0/2029030522 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c00c880 con 0x7fda60158420 2024-03-25T05:38:01.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.827+0000 7fda57e00640 1 -- 172.21.15.102:0/2029030522 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00cc90 con 0x7fda60158420 2024-03-25T05:38:01.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.828+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda601ffdb0 con 0x7fda60158420 2024-03-25T05:38:01.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.831+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda60200370 con 0x7fda60158420 2024-03-25T05:38:01.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.832+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6004f2f0 con 0x7fda60158420 2024-03-25T05:38:01.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.838+0000 7fda57e00640 1 -- 172.21.15.102:0/2029030522 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda4c014440 con 0x7fda60158420 2024-03-25T05:38:01.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.839+0000 7f7b03e00640 1 --2- 172.21.15.102:0/3548733198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c7940 0x7f7b040c7dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009870 tx=0x7f7af402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf6a6df0cb08ec33 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.839+0000 7fda57e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fda4006b890 0x7fda4006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.839+0000 7fda5fe00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fda4006b890 0x7fda4006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.841+0000 7fda57e00640 1 -- 172.21.15.102:0/2029030522 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda4c058880 con 0x7fda60158420 2024-03-25T05:38:01.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.842+0000 7f7b02000640 1 -- 172.21.15.102:0/3548733198 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4030860 con 0x7f7b040c7940 2024-03-25T05:38:01.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.842+0000 7f7b02000640 1 -- 172.21.15.102:0/3548733198 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40309c0 con 0x7f7b040c7940 2024-03-25T05:38:01.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.842+0000 7f7b02000640 1 -- 172.21.15.102:0/3548733198 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4030d50 con 0x7f7b040c7940 2024-03-25T05:38:01.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.843+0000 7f7b0a200640 1 -- 172.21.15.102:0/3548733198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c7940 msgr2=0x7f7b040c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.843+0000 7fda5fe00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fda4006b890 0x7fda4006dd50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda50006fd0 tx=0x7fda50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.843+0000 7f7b0a200640 1 --2- 172.21.15.102:0/3548733198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c7940 0x7f7b040c7dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009870 tx=0x7f7af402b9a0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.845+0000 7f7b0a200640 1 -- 172.21.15.102:0/3548733198 shutdown_connections 2024-03-25T05:38:01.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.845+0000 7f7b0a200640 1 --2- 172.21.15.102:0/3548733198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c7940 0x7f7b040c7dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.845+0000 7f7b0a200640 1 --2- 172.21.15.102:0/3548733198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c5940 0x7f7b040ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.845+0000 7f7b0a200640 1 -- 172.21.15.102:0/3548733198 >> 172.21.15.102:0/3548733198 conn(0x7f7b040728c0 msgr2=0x7f7b0406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.851+0000 7f7b0a200640 1 -- 172.21.15.102:0/3548733198 shutdown_connections 2024-03-25T05:38:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.851+0000 7f7b0a200640 1 -- 172.21.15.102:0/3548733198 wait complete. 2024-03-25T05:38:01.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.853+0000 7f7b0a200640 1 Processor -- start 2024-03-25T05:38:01.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.864+0000 7fb94cc00640 1 Processor -- start 2024-03-25T05:38:01.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.864+0000 7fb94cc00640 1 -- start start 2024-03-25T05:38:01.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.859+0000 7f7b0a200640 1 -- start start 2024-03-25T05:38:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.868+0000 7f7b0a200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c5940 0x7f7b04156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.872+0000 7f7b03400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c5940 0x7f7b04156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.872+0000 7f7b03400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c5940 0x7f7b04156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48688/0 (socket says 172.21.15.102:48688) 2024-03-25T05:38:01.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.873+0000 7f7b03400640 1 -- 172.21.15.102:0/2463898400 learned_addr learned my addr 172.21.15.102:0/2463898400 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.874+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b040c6240 0x7f7b041e0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.875+0000 7fda57e00640 1 -- 172.21.15.102:0/2029030522 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fda4c054b20 con 0x7fda60158420 2024-03-25T05:38:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.876+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c7940 0x7f7b04153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb94cc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb948153f70 0x7fb948159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb94cc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb9480c7160 0x7fb94806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb94cc00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb948072150 con 0x7fb9480c54a0 2024-03-25T05:38:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb94cc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94806f860 con 0x7fb948153f70 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb94cc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb948071b00 con 0x7fb9480c7160 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb946a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb9480c7160 0x7fb94806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb946a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb9480c7160 0x7fb94806afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:48672/0 (socket says 172.21.15.102:48672) 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.866+0000 7fb946a00640 1 -- 172.21.15.102:0/2027220618 learned_addr learned my addr 172.21.15.102:0/2027220618 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.867+0000 7fb946a00640 1 -- 172.21.15.102:0/2027220618 >> v2:172.21.15.102:3300/0 conn(0x7fb948153f70 msgr2=0x7fb948159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.867+0000 7fb946a00640 1 --2- 172.21.15.102:0/2027220618 >> v2:172.21.15.102:3300/0 conn(0x7fb948153f70 0x7fb948159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.867+0000 7fb946a00640 1 -- 172.21.15.102:0/2027220618 >> v1:172.21.15.102:6789/0 conn(0x7fb9480c54a0 legacy=0x7fb94815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.867+0000 7fb946a00640 1 -- 172.21.15.102:0/2027220618 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948154350 con 0x7fb9480c7160 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.875+0000 7fb946a00640 1 --2- 172.21.15.102:0/2027220618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9480c7160 0x7fb94806afb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9480c59d0 tx=0x7fb94002be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e026df56afad716 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.876+0000 7fb946000640 1 -- 172.21.15.102:0/2027220618 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94002ca10 con 0x7fb9480c7160 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.876+0000 7fb946000640 1 -- 172.21.15.102:0/2027220618 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94002cb70 con 0x7fb9480c7160 2024-03-25T05:38:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.876+0000 7fb946000640 1 -- 172.21.15.102:0/2027220618 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400343f0 con 0x7fb9480c7160 2024-03-25T05:38:01.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.876+0000 7f7b02a00640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b040c6240 0x7f7b041e0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.879+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041e1bb0 con 0x7f7b040c6240 2024-03-25T05:38:01.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.879+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04155910 con 0x7f7b040c5940 2024-03-25T05:38:01.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.879+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041e2d90 con 0x7f7b040c7940 2024-03-25T05:38:01.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.878+0000 7f7b03e00640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c7940 0x7f7b04153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.881+0000 7f7b03400640 1 -- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c7940 msgr2=0x7f7b04153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.881+0000 7f7b03400640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c7940 0x7f7b04153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.881+0000 7f7b03400640 1 -- 172.21.15.102:0/2463898400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b040c6240 msgr2=0x7f7b041e0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.881+0000 7f7b03400640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b040c6240 0x7f7b041e0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.881+0000 7f7b03400640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40094d0 con 0x7f7b040c5940 2024-03-25T05:38:01.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.883+0000 7fb94cc00640 1 -- 172.21.15.102:0/2027220618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9480c7160 msgr2=0x7fb94806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.883+0000 7fb94cc00640 1 --2- 172.21.15.102:0/2027220618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9480c7160 0x7fb94806afb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9480c59d0 tx=0x7fb94002be70 comp rx=0 tx=0).stop 2024-03-25T05:38:01.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.884+0000 7f7b03400640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c5940 0x7f7b04156920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00bab0 tx=0x7f7afc00bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.884+0000 7f7afb400640 1 -- 172.21.15.102:0/2463898400 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc00cc60 con 0x7f7b040c5940 2024-03-25T05:38:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.884+0000 7f7afb400640 1 -- 172.21.15.102:0/2463898400 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00cde0 con 0x7f7b040c5940 2024-03-25T05:38:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.884+0000 7f7afb400640 1 -- 172.21.15.102:0/2463898400 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc014680 con 0x7f7b040c5940 2024-03-25T05:38:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.888+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b04156e60 con 0x7f7b040c5940 2024-03-25T05:38:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.888+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b041e18d0 con 0x7f7b040c5940 2024-03-25T05:38:01.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.892+0000 7fb94cc00640 1 -- 172.21.15.102:0/2027220618 shutdown_connections 2024-03-25T05:38:01.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.892+0000 7fb94cc00640 1 --2- 172.21.15.102:0/2027220618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9480c7160 0x7fb94806afb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.892+0000 7fb94cc00640 1 --2- 172.21.15.102:0/2027220618 >> v2:172.21.15.102:3300/0 conn(0x7fb948153f70 0x7fb948159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.892+0000 7fb94cc00640 1 -- 172.21.15.102:0/2027220618 >> 172.21.15.102:0/2027220618 conn(0x7fb9480cb340 msgr2=0x7fb9480cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.894+0000 7fb94cc00640 1 -- 172.21.15.102:0/2027220618 shutdown_connections 2024-03-25T05:38:01.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.894+0000 7fb94cc00640 1 -- 172.21.15.102:0/2027220618 wait complete. 2024-03-25T05:38:01.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.896+0000 7fb94cc00640 1 Processor -- start 2024-03-25T05:38:01.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.893+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b040cb9e0 con 0x7f7b040c5940 2024-03-25T05:38:01.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.904+0000 7fb94cc00640 1 -- start start 2024-03-25T05:38:01.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.902+0000 7f7afb400640 1 -- 172.21.15.102:0/2463898400 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7afc01c360 con 0x7f7b040c5940 2024-03-25T05:38:01.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.906+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9ff8152190 con 0x7f9ff814d800 2024-03-25T05:38:01.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.907+0000 7f9fee000640 1 -- 172.21.15.102:0/3801644518 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ff8152190 con 0x7f9ff814d800 2024-03-25T05:38:01.902 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:38:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.909+0000 7f7afb400640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7ae406b910 0x7f7ae406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.910+0000 7f7afb400640 1 -- 172.21.15.102:0/2463898400 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7afc08a030 con 0x7f7b040c5940 2024-03-25T05:38:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.910+0000 7f7b02a00640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7ae406b910 0x7f7ae406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.911+0000 7f7b02a00640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7ae406b910 0x7f7ae406ddd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b040d0160 tx=0x7f7af0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.911+0000 7f7afb400640 1 -- 172.21.15.102:0/2463898400 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7afc0bde10 con 0x7f7b040c5940 2024-03-25T05:38:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.906+0000 7fb94cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9480c54a0 0x7fb9481e5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.906+0000 7fb94cc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9480c7160 0x7fb94814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.906+0000 7fb94cc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb948153f70 0x7fb94814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.906+0000 7fb94cc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c5120 con 0x7fb9480c7160 2024-03-25T05:38:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.906+0000 7fb94cc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94806f230 con 0x7fb948153f70 2024-03-25T05:38:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.906+0000 7fb94cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94806ef50 con 0x7fb9480c54a0 2024-03-25T05:38:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.910+0000 7fb946a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9480c7160 0x7fb94814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.913+0000 7fb947400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9480c54a0 0x7fb9481e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.914+0000 7fb946a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9480c7160 0x7fb94814c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56716/0 (socket says 172.21.15.102:56716) 2024-03-25T05:38:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.914+0000 7fb946a00640 1 -- 172.21.15.102:0/3534392735 learned_addr learned my addr 172.21.15.102:0/3534392735 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.914+0000 7fb946a00640 1 -- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9480c54a0 msgr2=0x7fb9481e5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.914+0000 7fb946a00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9480c54a0 0x7fb9481e5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.914+0000 7fb946a00640 1 -- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb948153f70 msgr2=0x7fb94814ca10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-25T05:38:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.914+0000 7fb946a00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb948153f70 0x7fb94814ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.914+0000 7fb946a00640 1 -- 172.21.15.102:0/3534392735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940009b30 con 0x7fb9480c7160 2024-03-25T05:38:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.919+0000 7fb946a00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9480c7160 0x7fb94814c4d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb940036040 tx=0x7fb940004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.920+0000 7fb93f400640 1 -- 172.21.15.102:0/3534392735 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940009510 con 0x7fb9480c7160 2024-03-25T05:38:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.920+0000 7fb93f400640 1 -- 172.21.15.102:0/3534392735 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94003e450 con 0x7fb9480c7160 2024-03-25T05:38:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.920+0000 7fb93f400640 1 -- 172.21.15.102:0/3534392735 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94003e800 con 0x7fb9480c7160 2024-03-25T05:38:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9fd806b810 msgr2=0x7f9fd806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9fd806b810 0x7f9fd806dcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4001820 tx=0x7f9fe4009040 comp rx=0 tx=0).stop 2024-03-25T05:38:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff814d800 msgr2=0x7f9ff814fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff814d800 0x7f9ff814fd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80c2680 tx=0x7f9ff000cf00 comp rx=0 tx=0).stop 2024-03-25T05:38:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 shutdown_connections 2024-03-25T05:38:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9fd806b810 0x7f9fd806dcd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff814d800 0x7f9ff814fd60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ff814d3e0 0x7f9ff81ef070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 --2- 172.21.15.102:0/3801644518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fdc0047c0 0x7f9ff815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.922+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 >> 172.21.15.102:0/3801644518 conn(0x7f9ff80c7dd0 msgr2=0x7f9ff80c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.925+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 shutdown_connections 2024-03-25T05:38:01.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.931+0000 7f9ffce00640 1 -- 172.21.15.102:0/3801644518 wait complete. 2024-03-25T05:38:01.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.926+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb948159450 con 0x7fb9480c7160 2024-03-25T05:38:01.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.926+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb948159a10 con 0x7fb9480c7160 2024-03-25T05:38:01.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.929+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94804f2f0 con 0x7fb9480c7160 2024-03-25T05:38:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.941+0000 7fb93f400640 1 -- 172.21.15.102:0/3534392735 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb94003e960 con 0x7fb9480c7160 2024-03-25T05:38:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.943+0000 7fb93f400640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb92806b860 0x7fb92806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.943+0000 7fb93f400640 1 -- 172.21.15.102:0/3534392735 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb9400ad2c0 con 0x7fb9480c7160 2024-03-25T05:38:01.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.955+0000 7fb947400640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb92806b860 0x7fb92806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:01.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.958+0000 7fb947400640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb92806b860 0x7fb92806dd20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb938009990 tx=0x7fb938009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:01.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.973+0000 7fb93f400640 1 -- 172.21.15.102:0/3534392735 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb940077a80 con 0x7fb9480c7160 2024-03-25T05:38:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.979+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff22c005540 con 0x7ff25806b250 2024-03-25T05:38:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.980+0000 7ff255600640 1 -- 172.21.15.102:0/1859066279 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff244049070 con 0x7ff25806b250 2024-03-25T05:38:01.977 INFO:teuthology.orchestra.run.smithi102.stdout:55834574858 2024-03-25T05:38:01.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.987+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff23806b910 msgr2=0x7ff23806ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.987+0000 7ff24aa00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff23806b910 0x7ff23806ddd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff258153df0 tx=0x7ff250009240 comp rx=0 tx=0).stop 2024-03-25T05:38:01.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.987+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25806b250 msgr2=0x7ff258156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:01.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.987+0000 7ff24aa00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25806b250 0x7ff258156940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2581620f0 tx=0x7ff244004730 comp rx=0 tx=0).stop 2024-03-25T05:38:01.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2024-03-25T05:38:01.982 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:01.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.989+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 shutdown_connections 2024-03-25T05:38:01.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.989+0000 7ff24aa00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff23806b910 0x7ff23806ddd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.989+0000 7ff24aa00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff258158230 0x7ff2581f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.989+0000 7ff24aa00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2580cb1f0 0x7ff2581f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.989+0000 7ff24aa00640 1 --2- 172.21.15.102:0/1859066279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25806b250 0x7ff258156940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:01.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.989+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 >> 172.21.15.102:0/1859066279 conn(0x7ff2580cf3e0 msgr2=0x7ff2580cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:01.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.989+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 shutdown_connections 2024-03-25T05:38:01.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:01.990+0000 7ff24aa00640 1 -- 172.21.15.102:0/1859066279 wait complete. 2024-03-25T05:38:02.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2024-03-25T05:38:02.022 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:02.023 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:38:02.030+0000 7f9ada000640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-25T05:38:02.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.130+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f34d406dd00 con 0x7f34d4167560 2024-03-25T05:38:02.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.131+0000 7f34caa00640 1 -- 172.21.15.102:0/1128219226 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34cc057e50 con 0x7f34d4167560 2024-03-25T05:38:02.127 INFO:teuthology.orchestra.run.smithi102.stdout:55834574858 2024-03-25T05:38:02.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.141+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f34b406b910 msgr2=0x7f34b406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.141+0000 7f34d9a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f34b406b910 0x7f34b406ddd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34c400a950 tx=0x7f34c4008040 comp rx=0 tx=0).stop 2024-03-25T05:38:02.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.141+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d4167560 msgr2=0x7f34d4168740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.141+0000 7f34d9a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d4167560 0x7f34d4168740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c710 tx=0x7f34cc00cbd0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.142+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 shutdown_connections 2024-03-25T05:38:02.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.142+0000 7f34d9a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f34b406b910 0x7f34b406ddd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.142+0000 7f34d9a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d4167560 0x7f34d4168740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.142+0000 7f34d9a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d40727f0 0x7f34d40c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.142+0000 7f34d9a00640 1 --2- 172.21.15.102:0/1128219226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d406e880 0x7f34d420dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.142+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 >> 172.21.15.102:0/1128219226 conn(0x7f34d40c7dd0 msgr2=0x7f34d40c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.143+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 shutdown_connections 2024-03-25T05:38:02.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.143+0000 7f34d9a00640 1 -- 172.21.15.102:0/1128219226 wait complete. 2024-03-25T05:38:02.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.175+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0834005540 con 0x7f085c14a9d0 2024-03-25T05:38:02.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.175+0000 7f0852a00640 1 -- 172.21.15.102:0/4279937936 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0848054ca0 con 0x7f085c14a9d0 2024-03-25T05:38:02.168 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:38:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f083c06b910 msgr2=0x7f083c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f083c06b910 0x7f083c06ddd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0854036000 tx=0x7f0854030000 comp rx=0 tx=0).stop 2024-03-25T05:38:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085c14a9d0 msgr2=0x7f085c14ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085c14a9d0 0x7f085c14ae80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f084800d530 tx=0x7f084800d9f0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 shutdown_connections 2024-03-25T05:38:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f083c06b910 0x7f083c06ddd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085c14a9d0 0x7f085c14ae80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f085c06f660 0x7f085c146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 --2- 172.21.15.102:0/4279937936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085c06e990 0x7f085c135060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.179+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 >> 172.21.15.102:0/4279937936 conn(0x7f085c0c7dd0 msgr2=0x7f085c0ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.183+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 shutdown_connections 2024-03-25T05:38:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.183+0000 7f0861a00640 1 -- 172.21.15.102:0/4279937936 wait complete. 2024-03-25T05:38:02.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2024-03-25T05:38:02.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.186+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77a4005810 con 0x7f77d406f400 2024-03-25T05:38:02.180 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:02.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.187+0000 7f77ca000640 1 -- 172.21.15.102:0/714975247 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77bc078170 con 0x7f77d406f400 2024-03-25T05:38:02.180 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:38:02.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.191+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f77b006b910 msgr2=0x7f77b006ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.191+0000 7f77c3400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f77b006b910 0x7f77b006ddd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f77c4006fd0 tx=0x7f77c4008040 comp rx=0 tx=0).stop 2024-03-25T05:38:02.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.191+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d406f400 msgr2=0x7f77d414d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.191+0000 7f77c3400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d406f400 0x7f77d414d160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77bc000c00 tx=0x7f77bc0046c0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.194+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 shutdown_connections 2024-03-25T05:38:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.194+0000 7f77c3400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f77b006b910 0x7f77b006ddd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.194+0000 7f77c3400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d415ec30 0x7f77d40c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.194+0000 7f77c3400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77d4158420 0x7f77d41534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.194+0000 7f77c3400640 1 --2- 172.21.15.102:0/714975247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d406f400 0x7f77d414d160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.194+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 >> 172.21.15.102:0/714975247 conn(0x7f77d40cb340 msgr2=0x7f77d415c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.194+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 shutdown_connections 2024-03-25T05:38:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.195+0000 7f77c3400640 1 -- 172.21.15.102:0/714975247 wait complete. 2024-03-25T05:38:02.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2024-03-25T05:38:02.206 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:02.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.0 2024-03-25T05:38:02.214 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:02.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.319+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fda600cba00 con 0x7fda60158420 2024-03-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.320+0000 7fda57e00640 1 -- 172.21.15.102:0/2029030522 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda4c023090 con 0x7fda60158420 2024-03-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:38:02.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fda4006b890 msgr2=0x7fda4006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fda4006b890 0x7fda4006dd50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda50006fd0 tx=0x7fda50008040 comp rx=0 tx=0).stop 2024-03-25T05:38:02.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda60158420 msgr2=0x7fda60139e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda60158420 0x7fda60139e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00b750 tx=0x7fda4c00bc10 comp rx=0 tx=0).stop 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 shutdown_connections 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fda4006b890 0x7fda4006dd50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda6015e050 0x7fda60161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda60158420 0x7fda60139e00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 --2- 172.21.15.102:0/2029030522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda600c5210 0x7fda6015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 >> 172.21.15.102:0/2029030522 conn(0x7fda600cb340 msgr2=0x7fda6015d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 shutdown_connections 2024-03-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.322+0000 7fda66e00640 1 -- 172.21.15.102:0/2029030522 wait complete. 2024-03-25T05:38:02.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2024-03-25T05:38:02.331 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:02.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.379+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb948157890 con 0x7fb9480c7160 2024-03-25T05:38:02.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.380+0000 7fb93f400640 1 -- 172.21.15.102:0/3534392735 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb94007b140 con 0x7fb9480c7160 2024-03-25T05:38:02.373 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:38:02.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.381+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7b04067fb0 con 0x7f7b040c5940 2024-03-25T05:38:02.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.381+0000 7f7afb400640 1 -- 172.21.15.102:0/2463898400 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7afc054780 con 0x7f7b040c5940 2024-03-25T05:38:02.375 INFO:teuthology.orchestra.run.smithi102.stdout:55834574857 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.382+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb92806b860 msgr2=0x7fb92806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.382+0000 7fb94cc00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb92806b860 0x7fb92806dd20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb938009990 tx=0x7fb938009110 comp rx=0 tx=0).stop 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.382+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9480c7160 msgr2=0x7fb94814c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.382+0000 7fb94cc00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9480c7160 0x7fb94814c4d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb940036040 tx=0x7fb940004a40 comp rx=0 tx=0).stop 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 shutdown_connections 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb92806b860 0x7fb92806dd20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb948153f70 0x7fb94814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9480c7160 0x7fb94814c4d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 --2- 172.21.15.102:0/3534392735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9480c54a0 0x7fb9481e5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 >> 172.21.15.102:0/3534392735 conn(0x7fb9480cb340 msgr2=0x7fb9481ea680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 shutdown_connections 2024-03-25T05:38:02.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.383+0000 7fb94cc00640 1 -- 172.21.15.102:0/3534392735 wait complete. 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7ae406b910 msgr2=0x7f7ae406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7ae406b910 0x7f7ae406ddd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b040d0160 tx=0x7f7af0009040 comp rx=0 tx=0).stop 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c5940 msgr2=0x7f7b04156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c5940 0x7f7b04156920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00bab0 tx=0x7f7afc00bf70 comp rx=0 tx=0).stop 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 shutdown_connections 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7ae406b910 0x7f7ae406ddd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b040c7940 0x7f7b04153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b040c6240 0x7f7b041e0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 --2- 172.21.15.102:0/2463898400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b040c5940 0x7f7b04156920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 >> 172.21.15.102:0/2463898400 conn(0x7f7b040728c0 msgr2=0x7f7b041e61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.384+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 shutdown_connections 2024-03-25T05:38:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.385+0000 7f7b0a200640 1 -- 172.21.15.102:0/2463898400 wait complete. 2024-03-25T05:38:02.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.3 2024-03-25T05:38:02.393 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:02.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2024-03-25T05:38:02.396 DEBUG:teuthology.parallel:result is None 2024-03-25T05:38:02.396 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-25T05:38:02.396 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T05:38:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.623+0000 7fcac4e00640 1 Processor -- start 2024-03-25T05:38:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.624+0000 7fcac4e00640 1 -- start start 2024-03-25T05:38:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.625+0000 7fcac4e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcac00726d0 0x7fcac0070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcac4e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac0159ea0 con 0x7fcac006bcb0 2024-03-25T05:38:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcac4e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac00c2840 con 0x7fcac0150c90 2024-03-25T05:38:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcac4e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac0151070 con 0x7fcac00726d0 2024-03-25T05:38:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabf400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fcac0150c90 0x7fcac00c4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34566/0 (socket says 172.21.15.102:34566) 2024-03-25T05:38:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabf400640 1 -- 172.21.15.102:0/2114555031 learned_addr learned my addr 172.21.15.102:0/2114555031 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabea00640 1 --2- 172.21.15.102:0/2114555031 >> v2:172.21.15.187:3300/0 conn(0x7fcac00726d0 0x7fcac0070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabe000640 1 -- 172.21.15.102:0/2114555031 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692075507 0 0) 0x7fcac00c2840 con 0x7fcac0150c90 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabe000640 1 -- 172.21.15.102:0/2114555031 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaa4005730 con 0x7fcac0150c90 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabe000640 1 -- 172.21.15.102:0/2114555031 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898448327 0 0) 0x7fcac0159ea0 con 0x7fcac006bcb0 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabea00640 1 -- 172.21.15.102:0/2114555031 >> v1:172.21.15.187:6789/0 conn(0x7fcac0150c90 legacy=0x7fcac00c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabea00640 1 -- 172.21.15.102:0/2114555031 >> v1:172.21.15.102:6789/0 conn(0x7fcac006bcb0 legacy=0x7fcac0161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.626+0000 7fcabea00640 1 -- 172.21.15.102:0/2114555031 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac015a140 con 0x7fcac00726d0 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.627+0000 7fcabea00640 1 --2- 172.21.15.102:0/2114555031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0070de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0097a0 tx=0x7fcaac02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395de85b230cbb18 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:02.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcabe000640 1 -- 172.21.15.102:0/2114555031 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac030610 con 0x7fcac00726d0 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcabe000640 1 -- 172.21.15.102:0/2114555031 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac030770 con 0x7fcac00726d0 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcabe000640 1 -- 172.21.15.102:0/2114555031 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac030b00 con 0x7fcac00726d0 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcac4e00640 1 -- 172.21.15.102:0/2114555031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 msgr2=0x7fcac0070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcac4e00640 1 --2- 172.21.15.102:0/2114555031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0070de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0097a0 tx=0x7fcaac02b960 comp rx=0 tx=0).stop 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcac4e00640 1 -- 172.21.15.102:0/2114555031 shutdown_connections 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcac4e00640 1 --2- 172.21.15.102:0/2114555031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0070de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.628+0000 7fcac4e00640 1 -- 172.21.15.102:0/2114555031 >> 172.21.15.102:0/2114555031 conn(0x7fcac00cb340 msgr2=0x7fcac00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.629+0000 7fcac4e00640 1 -- 172.21.15.102:0/2114555031 shutdown_connections 2024-03-25T05:38:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.629+0000 7fcac4e00640 1 -- 172.21.15.102:0/2114555031 wait complete. 2024-03-25T05:38:02.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.630+0000 7fcac4e00640 1 Processor -- start 2024-03-25T05:38:02.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.631+0000 7fcac4e00640 1 -- start start 2024-03-25T05:38:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcac4e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcac006bcb0 0x7fcac01e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcac4e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcac4e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac0150c90 0x7fcac01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcac4e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac01dff90 con 0x7fcac0150c90 2024-03-25T05:38:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcac4e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac01537c0 con 0x7fcac00726d0 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcac4e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0159720 con 0x7fcac006bcb0 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcabf400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcac006bcb0 0x7fcac01e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcabea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcabf400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcac006bcb0 0x7fcac01e0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:58308/0 (socket says 172.21.15.102:58308) 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.632+0000 7fcabf400640 1 -- 172.21.15.102:0/1974415724 learned_addr learned my addr 172.21.15.102:0/1974415724 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabfe00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac0150c90 0x7fcac01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabf400640 1 -- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 msgr2=0x7fcac0158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabf400640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabf400640 1 -- 172.21.15.102:0/1974415724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac0150c90 msgr2=0x7fcac01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabf400640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac0150c90 0x7fcac01591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabf400640 1 -- 172.21.15.102:0/1974415724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac009400 con 0x7fcac006bcb0 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabfe00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac0150c90 0x7fcac01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabea00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcabf400640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcac006bcb0 0x7fcac01e0e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c440 tx=0x7fcab000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcab7400640 1 -- 172.21.15.102:0/1974415724 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0005ce0 con 0x7fcac006bcb0 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcab7400640 1 -- 172.21.15.102:0/1974415724 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab0005e40 con 0x7fcac006bcb0 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcab7400640 1 -- 172.21.15.102:0/1974415724 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab00072b0 con 0x7fcac006bcb0 2024-03-25T05:38:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.633+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac0152590 con 0x7fcac006bcb0 2024-03-25T05:38:02.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.634+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0152e90 con 0x7fcac006bcb0 2024-03-25T05:38:02.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.635+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac00c5160 con 0x7fcac006bcb0 2024-03-25T05:38:02.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.636+0000 7fcab7400640 1 -- 172.21.15.102:0/1974415724 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcab0007410 con 0x7fcac006bcb0 2024-03-25T05:38:02.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.637+0000 7fcab7400640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcaa006b810 0x7fcaa006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:02.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.637+0000 7fcab7400640 1 -- 172.21.15.102:0/1974415724 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcab0089ae0 con 0x7fcac006bcb0 2024-03-25T05:38:02.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.638+0000 7fcabea00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcaa006b810 0x7fcaa006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:02.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.638+0000 7fcabea00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcaa006b810 0x7fcaa006dcd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcaac036000 tx=0x7fcaac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:02.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.646+0000 7fcab7400640 1 -- 172.21.15.102:0/1974415724 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcab0054200 con 0x7fcac006bcb0 2024-03-25T05:38:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.830+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcac015a9e0 con 0x7fcaa006b810 2024-03-25T05:38:02.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.839+0000 7fcab7400640 1 -- 172.21.15.102:0/1974415724 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332711 (secure 0 0 0) 0x7fcaac03f040 con 0x7fcaa006b810 2024-03-25T05:38:02.836 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:02.838 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcaa006b810 msgr2=0x7fcaa006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcaa006b810 0x7fcaa006dcd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcaac036000 tx=0x7fcaac008030 comp rx=0 tx=0).stop 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcac006bcb0 msgr2=0x7fcac01e0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcac006bcb0 0x7fcac01e0e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c440 tx=0x7fcab000c900 comp rx=0 tx=0).stop 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 shutdown_connections 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcaa006b810 0x7fcaa006dcd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac0150c90 0x7fcac01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcac00726d0 0x7fcac0158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 --2- 172.21.15.102:0/1974415724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcac006bcb0 0x7fcac01e0e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 >> 172.21.15.102:0/1974415724 conn(0x7fcac00cb340 msgr2=0x7fcac014fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:02.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 shutdown_connections 2024-03-25T05:38:02.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:02.844+0000 7fcac4e00640 1 -- 172.21.15.102:0/1974415724 wait complete. 2024-03-25T05:38:02.855 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-03-25T05:38:01.012111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":368,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":2523136,"data_stored":2060408,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5765,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002791"},"pg_stats":[{"pgid":"2.1f","version":"25'13","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562236+0000","last_change":"2024-03-25T05:37:30.423912+0000","last_active":"2024-03-25T05:37:56.562236+0000","last_peered":"2024-03-25T05:37:56.562236+0000","last_clean":"2024-03-25T05:37:56.562236+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T05:37:56.562236+0000","last_undegraded":"2024-03-25T05:37:56.562236+0000","last_fullsized":"2024-03-25T05:37:56.562236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433740+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T05:37:37.433740+0000","last_peered":"2024-03-25T05:37:37.433740+0000","last_clean":"2024-03-25T05:37:37.433740+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T05:37:37.433740+0000","last_undegraded":"2024-03-25T05:37:37.433740+0000","last_fullsized":"2024-03-25T05:37:37.433740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431653+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T05:37:37.431653+0000","last_peered":"2024-03-25T05:37:37.431653+0000","last_clean":"2024-03-25T05:37:37.431653+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T05:37:37.431653+0000","last_undegraded":"2024-03-25T05:37:37.431653+0000","last_fullsized":"2024-03-25T05:37:37.431653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:43:49.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433909+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T05:37:37.433909+0000","last_peered":"2024-03-25T05:37:37.433909+0000","last_clean":"2024-03-25T05:37:37.433909+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T05:37:37.433909+0000","last_undegraded":"2024-03-25T05:37:37.433909+0000","last_fullsized":"2024-03-25T05:37:37.433909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585751+0000","last_change":"2024-03-25T05:37:31.155929+0000","last_active":"2024-03-25T05:37:38.585751+0000","last_peered":"2024-03-25T05:37:38.585751+0000","last_clean":"2024-03-25T05:37:38.585751+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T05:37:38.585751+0000","last_undegraded":"2024-03-25T05:37:38.585751+0000","last_fullsized":"2024-03-25T05:37:38.585751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432218+0000","last_change":"2024-03-25T05:37:35.459531+0000","last_active":"2024-03-25T05:37:37.432218+0000","last_peered":"2024-03-25T05:37:37.432218+0000","last_clean":"2024-03-25T05:37:37.432218+0000","last_became_active":"2024-03-25T05:37:35.459127+0000","last_became_peered":"2024-03-25T05:37:35.459127+0000","last_unstale":"2024-03-25T05:37:37.432218+0000","last_undegraded":"2024-03-25T05:37:37.432218+0000","last_fullsized":"2024-03-25T05:37:37.432218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'12","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562779+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T05:37:56.562779+0000","last_peered":"2024-03-25T05:37:56.562779+0000","last_clean":"2024-03-25T05:37:56.562779+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T05:37:56.562779+0000","last_undegraded":"2024-03-25T05:37:56.562779+0000","last_fullsized":"2024-03-25T05:37:56.562779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221959+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T05:37:38.221959+0000","last_peered":"2024-03-25T05:37:38.221959+0000","last_clean":"2024-03-25T05:37:38.221959+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T05:37:38.221959+0000","last_undegraded":"2024-03-25T05:37:38.221959+0000","last_fullsized":"2024-03-25T05:37:38.221959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432708+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T05:37:37.432708+0000","last_peered":"2024-03-25T05:37:37.432708+0000","last_clean":"2024-03-25T05:37:37.432708+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T05:37:37.432708+0000","last_undegraded":"2024-03-25T05:37:37.432708+0000","last_fullsized":"2024-03-25T05:37:37.432708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.559331+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T05:37:56.559331+0000","last_peered":"2024-03-25T05:37:56.559331+0000","last_clean":"2024-03-25T05:37:56.559331+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T05:37:56.559331+0000","last_undegraded":"2024-03-25T05:37:56.559331+0000","last_fullsized":"2024-03-25T05:37:56.559331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222108+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T05:37:38.222108+0000","last_peered":"2024-03-25T05:37:38.222108+0000","last_clean":"2024-03-25T05:37:38.222108+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T05:37:38.222108+0000","last_undegraded":"2024-03-25T05:37:38.222108+0000","last_fullsized":"2024-03-25T05:37:38.222108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432306+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T05:37:37.432306+0000","last_peered":"2024-03-25T05:37:37.432306+0000","last_clean":"2024-03-25T05:37:37.432306+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T05:37:37.432306+0000","last_undegraded":"2024-03-25T05:37:37.432306+0000","last_fullsized":"2024-03-25T05:37:37.432306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805582+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T05:37:38.805582+0000","last_peered":"2024-03-25T05:37:38.805582+0000","last_clean":"2024-03-25T05:37:38.805582+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T05:37:38.805582+0000","last_undegraded":"2024-03-25T05:37:38.805582+0000","last_fullsized":"2024-03-25T05:37:38.805582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.520789+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T05:37:53.520789+0000","last_peered":"2024-03-25T05:37:53.520789+0000","last_clean":"2024-03-25T05:37:53.520789+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T05:37:53.520789+0000","last_undegraded":"2024-03-25T05:37:53.520789+0000","last_fullsized":"2024-03-25T05:37:53.520789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432841+0000","last_change":"2024-03-25T05:37:35.462815+0000","last_active":"2024-03-25T05:37:37.432841+0000","last_peered":"2024-03-25T05:37:37.432841+0000","last_clean":"2024-03-25T05:37:37.432841+0000","last_became_active":"2024-03-25T05:37:35.462293+0000","last_became_peered":"2024-03-25T05:37:35.462293+0000","last_unstale":"2024-03-25T05:37:37.432841+0000","last_undegraded":"2024-03-25T05:37:37.432841+0000","last_fullsized":"2024-03-25T05:37:37.432841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433456+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T05:37:37.433456+0000","last_peered":"2024-03-25T05:37:37.433456+0000","last_clean":"2024-03-25T05:37:37.433456+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T05:37:37.433456+0000","last_undegraded":"2024-03-25T05:37:37.433456+0000","last_fullsized":"2024-03-25T05:37:37.433456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.549609+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T05:37:55.549609+0000","last_peered":"2024-03-25T05:37:55.549609+0000","last_clean":"2024-03-25T05:37:55.549609+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T05:37:55.549609+0000","last_undegraded":"2024-03-25T05:37:55.549609+0000","last_fullsized":"2024-03-25T05:37:55.549609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433020+0000","last_change":"2024-03-25T05:37:35.463326+0000","last_active":"2024-03-25T05:37:37.433020+0000","last_peered":"2024-03-25T05:37:37.433020+0000","last_clean":"2024-03-25T05:37:37.433020+0000","last_became_active":"2024-03-25T05:37:35.462618+0000","last_became_peered":"2024-03-25T05:37:35.462618+0000","last_unstale":"2024-03-25T05:37:37.433020+0000","last_undegraded":"2024-03-25T05:37:37.433020+0000","last_fullsized":"2024-03-25T05:37:37.433020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431690+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T05:37:37.431690+0000","last_peered":"2024-03-25T05:37:37.431690+0000","last_clean":"2024-03-25T05:37:37.431690+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T05:37:37.431690+0000","last_undegraded":"2024-03-25T05:37:37.431690+0000","last_fullsized":"2024-03-25T05:37:37.431690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.557525+0000","last_change":"2024-03-25T05:37:30.422594+0000","last_active":"2024-03-25T05:37:56.557525+0000","last_peered":"2024-03-25T05:37:56.557525+0000","last_clean":"2024-03-25T05:37:56.557525+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T05:37:56.557525+0000","last_undegraded":"2024-03-25T05:37:56.557525+0000","last_fullsized":"2024-03-25T05:37:56.557525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435022+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T05:37:37.435022+0000","last_peered":"2024-03-25T05:37:37.435022+0000","last_clean":"2024-03-25T05:37:37.435022+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T05:37:37.435022+0000","last_undegraded":"2024-03-25T05:37:37.435022+0000","last_fullsized":"2024-03-25T05:37:37.435022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432539+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T05:37:37.432539+0000","last_peered":"2024-03-25T05:37:37.432539+0000","last_clean":"2024-03-25T05:37:37.432539+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T05:37:37.432539+0000","last_undegraded":"2024-03-25T05:37:37.432539+0000","last_fullsized":"2024-03-25T05:37:37.432539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.526401+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T05:37:53.526401+0000","last_peered":"2024-03-25T05:37:53.526401+0000","last_clean":"2024-03-25T05:37:53.526401+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T05:37:53.526401+0000","last_undegraded":"2024-03-25T05:37:53.526401+0000","last_fullsized":"2024-03-25T05:37:53.526401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432590+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T05:37:37.432590+0000","last_peered":"2024-03-25T05:37:37.432590+0000","last_clean":"2024-03-25T05:37:37.432590+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T05:37:37.432590+0000","last_undegraded":"2024-03-25T05:37:37.432590+0000","last_fullsized":"2024-03-25T05:37:37.432590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585863+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T05:37:38.585863+0000","last_peered":"2024-03-25T05:37:38.585863+0000","last_clean":"2024-03-25T05:37:38.585863+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T05:37:38.585863+0000","last_undegraded":"2024-03-25T05:37:38.585863+0000","last_fullsized":"2024-03-25T05:37:38.585863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.558487+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T05:37:56.558487+0000","last_peered":"2024-03-25T05:37:56.558487+0000","last_clean":"2024-03-25T05:37:56.558487+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T05:37:56.558487+0000","last_undegraded":"2024-03-25T05:37:56.558487+0000","last_fullsized":"2024-03-25T05:37:56.558487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432209+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T05:37:37.432209+0000","last_peered":"2024-03-25T05:37:37.432209+0000","last_clean":"2024-03-25T05:37:37.432209+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T05:37:37.432209+0000","last_undegraded":"2024-03-25T05:37:37.432209+0000","last_fullsized":"2024-03-25T05:37:37.432209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433971+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T05:37:37.433971+0000","last_peered":"2024-03-25T05:37:37.433971+0000","last_clean":"2024-03-25T05:37:37.433971+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T05:37:37.433971+0000","last_undegraded":"2024-03-25T05:37:37.433971+0000","last_fullsized":"2024-03-25T05:37:37.433971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.557437+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T05:37:55.557437+0000","last_peered":"2024-03-25T05:37:55.557437+0000","last_clean":"2024-03-25T05:37:55.557437+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T05:37:55.557437+0000","last_undegraded":"2024-03-25T05:37:55.557437+0000","last_fullsized":"2024-03-25T05:37:55.557437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431411+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T05:37:37.431411+0000","last_peered":"2024-03-25T05:37:37.431411+0000","last_clean":"2024-03-25T05:37:37.431411+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T05:37:37.431411+0000","last_undegraded":"2024-03-25T05:37:37.431411+0000","last_fullsized":"2024-03-25T05:37:37.431411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:43:13.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431535+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T05:37:37.431535+0000","last_peered":"2024-03-25T05:37:37.431535+0000","last_clean":"2024-03-25T05:37:37.431535+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T05:37:37.431535+0000","last_undegraded":"2024-03-25T05:37:37.431535+0000","last_fullsized":"2024-03-25T05:37:37.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.548670+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T05:37:55.548670+0000","last_peered":"2024-03-25T05:37:55.548670+0000","last_clean":"2024-03-25T05:37:55.548670+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T05:37:55.548670+0000","last_undegraded":"2024-03-25T05:37:55.548670+0000","last_fullsized":"2024-03-25T05:37:55.548670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585184+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T05:37:38.585184+0000","last_peered":"2024-03-25T05:37:38.585184+0000","last_clean":"2024-03-25T05:37:38.585184+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T05:37:38.585184+0000","last_undegraded":"2024-03-25T05:37:38.585184+0000","last_fullsized":"2024-03-25T05:37:38.585184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222226+0000","last_change":"2024-03-25T05:37:31.164193+0000","last_active":"2024-03-25T05:37:38.222226+0000","last_peered":"2024-03-25T05:37:38.222226+0000","last_clean":"2024-03-25T05:37:38.222226+0000","last_became_active":"2024-03-25T05:37:31.163899+0000","last_became_peered":"2024-03-25T05:37:31.163899+0000","last_unstale":"2024-03-25T05:37:38.222226+0000","last_undegraded":"2024-03-25T05:37:38.222226+0000","last_fullsized":"2024-03-25T05:37:38.222226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431605+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T05:37:37.431605+0000","last_peered":"2024-03-25T05:37:37.431605+0000","last_clean":"2024-03-25T05:37:37.431605+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T05:37:37.431605+0000","last_undegraded":"2024-03-25T05:37:37.431605+0000","last_fullsized":"2024-03-25T05:37:37.431605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431836+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T05:37:37.431836+0000","last_peered":"2024-03-25T05:37:37.431836+0000","last_clean":"2024-03-25T05:37:37.431836+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T05:37:37.431836+0000","last_undegraded":"2024-03-25T05:37:37.431836+0000","last_fullsized":"2024-03-25T05:37:37.431836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432936+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T05:37:37.432936+0000","last_peered":"2024-03-25T05:37:37.432936+0000","last_clean":"2024-03-25T05:37:37.432936+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T05:37:37.432936+0000","last_undegraded":"2024-03-25T05:37:37.432936+0000","last_fullsized":"2024-03-25T05:37:37.432936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.564146+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T05:37:56.564146+0000","last_peered":"2024-03-25T05:37:56.564146+0000","last_clean":"2024-03-25T05:37:56.564146+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T05:37:56.564146+0000","last_undegraded":"2024-03-25T05:37:56.564146+0000","last_fullsized":"2024-03-25T05:37:56.564146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431467+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T05:37:37.431467+0000","last_peered":"2024-03-25T05:37:37.431467+0000","last_clean":"2024-03-25T05:37:37.431467+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T05:37:37.431467+0000","last_undegraded":"2024-03-25T05:37:37.431467+0000","last_fullsized":"2024-03-25T05:37:37.431467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431111+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T05:37:37.431111+0000","last_peered":"2024-03-25T05:37:37.431111+0000","last_clean":"2024-03-25T05:37:37.431111+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T05:37:37.431111+0000","last_undegraded":"2024-03-25T05:37:37.431111+0000","last_fullsized":"2024-03-25T05:37:37.431111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.544985+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T05:37:54.544985+0000","last_peered":"2024-03-25T05:37:54.544985+0000","last_clean":"2024-03-25T05:37:54.544985+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T05:37:54.544985+0000","last_undegraded":"2024-03-25T05:37:54.544985+0000","last_fullsized":"2024-03-25T05:37:54.544985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435112+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T05:37:37.435112+0000","last_peered":"2024-03-25T05:37:37.435112+0000","last_clean":"2024-03-25T05:37:37.435112+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T05:37:37.435112+0000","last_undegraded":"2024-03-25T05:37:37.435112+0000","last_fullsized":"2024-03-25T05:37:37.435112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.584741+0000","last_change":"2024-03-25T05:37:31.148439+0000","last_active":"2024-03-25T05:37:38.584741+0000","last_peered":"2024-03-25T05:37:38.584741+0000","last_clean":"2024-03-25T05:37:38.584741+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T05:37:38.584741+0000","last_undegraded":"2024-03-25T05:37:38.584741+0000","last_fullsized":"2024-03-25T05:37:38.584741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:53:17.257529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.534185+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T05:37:54.534185+0000","last_peered":"2024-03-25T05:37:54.534185+0000","last_clean":"2024-03-25T05:37:54.534185+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T05:37:54.534185+0000","last_undegraded":"2024-03-25T05:37:54.534185+0000","last_fullsized":"2024-03-25T05:37:54.534185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585707+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T05:37:38.585707+0000","last_peered":"2024-03-25T05:37:38.585707+0000","last_clean":"2024-03-25T05:37:38.585707+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T05:37:38.585707+0000","last_undegraded":"2024-03-25T05:37:38.585707+0000","last_fullsized":"2024-03-25T05:37:38.585707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433259+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T05:37:37.433259+0000","last_peered":"2024-03-25T05:37:37.433259+0000","last_clean":"2024-03-25T05:37:37.433259+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T05:37:37.433259+0000","last_undegraded":"2024-03-25T05:37:37.433259+0000","last_fullsized":"2024-03-25T05:37:37.433259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'6","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.553183+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T05:37:55.553183+0000","last_peered":"2024-03-25T05:37:55.553183+0000","last_clean":"2024-03-25T05:37:55.553183+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T05:37:55.553183+0000","last_undegraded":"2024-03-25T05:37:55.553183+0000","last_fullsized":"2024-03-25T05:37:55.553183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309433+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T05:37:38.309433+0000","last_peered":"2024-03-25T05:37:38.309433+0000","last_clean":"2024-03-25T05:37:38.309433+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T05:37:38.309433+0000","last_undegraded":"2024-03-25T05:37:38.309433+0000","last_fullsized":"2024-03-25T05:37:38.309433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309757+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T05:37:38.309757+0000","last_peered":"2024-03-25T05:37:38.309757+0000","last_clean":"2024-03-25T05:37:38.309757+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T05:37:38.309757+0000","last_undegraded":"2024-03-25T05:37:38.309757+0000","last_fullsized":"2024-03-25T05:37:38.309757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.549080+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T05:37:55.549080+0000","last_peered":"2024-03-25T05:37:55.549080+0000","last_clean":"2024-03-25T05:37:55.549080+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T05:37:55.549080+0000","last_undegraded":"2024-03-25T05:37:55.549080+0000","last_fullsized":"2024-03-25T05:37:55.549080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805783+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T05:37:38.805783+0000","last_peered":"2024-03-25T05:37:38.805783+0000","last_clean":"2024-03-25T05:37:38.805783+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T05:37:38.805783+0000","last_undegraded":"2024-03-25T05:37:38.805783+0000","last_fullsized":"2024-03-25T05:37:38.805783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222175+0000","last_change":"2024-03-25T05:37:31.167109+0000","last_active":"2024-03-25T05:37:38.222175+0000","last_peered":"2024-03-25T05:37:38.222175+0000","last_clean":"2024-03-25T05:37:38.222175+0000","last_became_active":"2024-03-25T05:37:31.166757+0000","last_became_peered":"2024-03-25T05:37:31.166757+0000","last_unstale":"2024-03-25T05:37:38.222175+0000","last_undegraded":"2024-03-25T05:37:38.222175+0000","last_fullsized":"2024-03-25T05:37:38.222175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.554638+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T05:37:55.554638+0000","last_peered":"2024-03-25T05:37:55.554638+0000","last_clean":"2024-03-25T05:37:55.554638+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T05:37:55.554638+0000","last_undegraded":"2024-03-25T05:37:55.554638+0000","last_fullsized":"2024-03-25T05:37:55.554638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585200+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T05:37:38.585200+0000","last_peered":"2024-03-25T05:37:38.585200+0000","last_clean":"2024-03-25T05:37:38.585200+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T05:37:38.585200+0000","last_undegraded":"2024-03-25T05:37:38.585200+0000","last_fullsized":"2024-03-25T05:37:38.585200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310218+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T05:37:38.310218+0000","last_peered":"2024-03-25T05:37:38.310218+0000","last_clean":"2024-03-25T05:37:38.310218+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T05:37:38.310218+0000","last_undegraded":"2024-03-25T05:37:38.310218+0000","last_fullsized":"2024-03-25T05:37:38.310218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.564768+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T05:37:56.564768+0000","last_peered":"2024-03-25T05:37:56.564768+0000","last_clean":"2024-03-25T05:37:56.564768+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T05:37:56.564768+0000","last_undegraded":"2024-03-25T05:37:56.564768+0000","last_fullsized":"2024-03-25T05:37:56.564768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221545+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T05:37:38.221545+0000","last_peered":"2024-03-25T05:37:38.221545+0000","last_clean":"2024-03-25T05:37:38.221545+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T05:37:38.221545+0000","last_undegraded":"2024-03-25T05:37:38.221545+0000","last_fullsized":"2024-03-25T05:37:38.221545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309922+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T05:37:38.309922+0000","last_peered":"2024-03-25T05:37:38.309922+0000","last_clean":"2024-03-25T05:37:38.309922+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T05:37:38.309922+0000","last_undegraded":"2024-03-25T05:37:38.309922+0000","last_fullsized":"2024-03-25T05:37:38.309922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433073+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T05:37:37.433073+0000","last_peered":"2024-03-25T05:37:37.433073+0000","last_clean":"2024-03-25T05:37:37.433073+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T05:37:37.433073+0000","last_undegraded":"2024-03-25T05:37:37.433073+0000","last_fullsized":"2024-03-25T05:37:37.433073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432138+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T05:37:37.432138+0000","last_peered":"2024-03-25T05:37:37.432138+0000","last_clean":"2024-03-25T05:37:37.432138+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T05:37:37.432138+0000","last_undegraded":"2024-03-25T05:37:37.432138+0000","last_fullsized":"2024-03-25T05:37:37.432138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309589+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T05:37:38.309589+0000","last_peered":"2024-03-25T05:37:38.309589+0000","last_clean":"2024-03-25T05:37:38.309589+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T05:37:38.309589+0000","last_undegraded":"2024-03-25T05:37:38.309589+0000","last_fullsized":"2024-03-25T05:37:38.309589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'17","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.550891+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T05:37:55.550891+0000","last_peered":"2024-03-25T05:37:55.550891+0000","last_clean":"2024-03-25T05:37:55.550891+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T05:37:55.550891+0000","last_undegraded":"2024-03-25T05:37:55.550891+0000","last_fullsized":"2024-03-25T05:37:55.550891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585552+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T05:37:38.585552+0000","last_peered":"2024-03-25T05:37:38.585552+0000","last_clean":"2024-03-25T05:37:38.585552+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T05:37:38.585552+0000","last_undegraded":"2024-03-25T05:37:38.585552+0000","last_fullsized":"2024-03-25T05:37:38.585552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805642+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T05:37:38.805642+0000","last_peered":"2024-03-25T05:37:38.805642+0000","last_clean":"2024-03-25T05:37:38.805642+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T05:37:38.805642+0000","last_undegraded":"2024-03-25T05:37:38.805642+0000","last_fullsized":"2024-03-25T05:37:38.805642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.550054+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T05:37:55.550054+0000","last_peered":"2024-03-25T05:37:55.550054+0000","last_clean":"2024-03-25T05:37:55.550054+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T05:37:55.550054+0000","last_undegraded":"2024-03-25T05:37:55.550054+0000","last_fullsized":"2024-03-25T05:37:55.550054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433845+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T05:37:37.433845+0000","last_peered":"2024-03-25T05:37:37.433845+0000","last_clean":"2024-03-25T05:37:37.433845+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T05:37:37.433845+0000","last_undegraded":"2024-03-25T05:37:37.433845+0000","last_fullsized":"2024-03-25T05:37:37.433845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:50.989171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309666+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T05:37:38.309666+0000","last_peered":"2024-03-25T05:37:38.309666+0000","last_clean":"2024-03-25T05:37:38.309666+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T05:37:38.309666+0000","last_undegraded":"2024-03-25T05:37:38.309666+0000","last_fullsized":"2024-03-25T05:37:38.309666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.551128+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T05:37:55.551128+0000","last_peered":"2024-03-25T05:37:55.551128+0000","last_clean":"2024-03-25T05:37:55.551128+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T05:37:55.551128+0000","last_undegraded":"2024-03-25T05:37:55.551128+0000","last_fullsized":"2024-03-25T05:37:55.551128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433594+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T05:37:37.433594+0000","last_peered":"2024-03-25T05:37:37.433594+0000","last_clean":"2024-03-25T05:37:37.433594+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T05:37:37.433594+0000","last_undegraded":"2024-03-25T05:37:37.433594+0000","last_fullsized":"2024-03-25T05:37:37.433594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:14:50.068275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585076+0000","last_change":"2024-03-25T05:37:31.149941+0000","last_active":"2024-03-25T05:37:38.585076+0000","last_peered":"2024-03-25T05:37:38.585076+0000","last_clean":"2024-03-25T05:37:38.585076+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T05:37:38.585076+0000","last_undegraded":"2024-03-25T05:37:38.585076+0000","last_fullsized":"2024-03-25T05:37:38.585076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:24:40.019842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562368+0000","last_change":"2024-03-25T05:37:30.419153+0000","last_active":"2024-03-25T05:37:56.562368+0000","last_peered":"2024-03-25T05:37:56.562368+0000","last_clean":"2024-03-25T05:37:56.562368+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T05:37:56.562368+0000","last_undegraded":"2024-03-25T05:37:56.562368+0000","last_fullsized":"2024-03-25T05:37:56.562368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:16:01.889443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222103+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T05:37:38.222103+0000","last_peered":"2024-03-25T05:37:38.222103+0000","last_clean":"2024-03-25T05:37:38.222103+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T05:37:38.222103+0000","last_undegraded":"2024-03-25T05:37:38.222103+0000","last_fullsized":"2024-03-25T05:37:38.222103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309669+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T05:37:38.309669+0000","last_peered":"2024-03-25T05:37:38.309669+0000","last_clean":"2024-03-25T05:37:38.309669+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T05:37:38.309669+0000","last_undegraded":"2024-03-25T05:37:38.309669+0000","last_fullsized":"2024-03-25T05:37:38.309669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.561078+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T05:37:56.561078+0000","last_peered":"2024-03-25T05:37:56.561078+0000","last_clean":"2024-03-25T05:37:56.561078+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T05:37:56.561078+0000","last_undegraded":"2024-03-25T05:37:56.561078+0000","last_fullsized":"2024-03-25T05:37:56.561078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432193+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T05:37:37.432193+0000","last_peered":"2024-03-25T05:37:37.432193+0000","last_clean":"2024-03-25T05:37:37.432193+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T05:37:37.432193+0000","last_undegraded":"2024-03-25T05:37:37.432193+0000","last_fullsized":"2024-03-25T05:37:37.432193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432777+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T05:37:37.432777+0000","last_peered":"2024-03-25T05:37:37.432777+0000","last_clean":"2024-03-25T05:37:37.432777+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T05:37:37.432777+0000","last_undegraded":"2024-03-25T05:37:37.432777+0000","last_fullsized":"2024-03-25T05:37:37.432777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.525174+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T05:37:53.525174+0000","last_peered":"2024-03-25T05:37:53.525174+0000","last_clean":"2024-03-25T05:37:53.525174+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T05:37:53.525174+0000","last_undegraded":"2024-03-25T05:37:53.525174+0000","last_fullsized":"2024-03-25T05:37:53.525174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432399+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T05:37:37.432399+0000","last_peered":"2024-03-25T05:37:37.432399+0000","last_clean":"2024-03-25T05:37:37.432399+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T05:37:37.432399+0000","last_undegraded":"2024-03-25T05:37:37.432399+0000","last_fullsized":"2024-03-25T05:37:37.432399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586024+0000","last_change":"2024-03-25T05:37:31.156173+0000","last_active":"2024-03-25T05:37:38.586024+0000","last_peered":"2024-03-25T05:37:38.586024+0000","last_clean":"2024-03-25T05:37:38.586024+0000","last_became_active":"2024-03-25T05:37:31.155640+0000","last_became_peered":"2024-03-25T05:37:31.155640+0000","last_unstale":"2024-03-25T05:37:38.586024+0000","last_undegraded":"2024-03-25T05:37:38.586024+0000","last_fullsized":"2024-03-25T05:37:38.586024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562285+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T05:37:56.562285+0000","last_peered":"2024-03-25T05:37:56.562285+0000","last_clean":"2024-03-25T05:37:56.562285+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T05:37:56.562285+0000","last_undegraded":"2024-03-25T05:37:56.562285+0000","last_fullsized":"2024-03-25T05:37:56.562285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431609+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T05:37:37.431609+0000","last_peered":"2024-03-25T05:37:37.431609+0000","last_clean":"2024-03-25T05:37:37.431609+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T05:37:37.431609+0000","last_undegraded":"2024-03-25T05:37:37.431609+0000","last_fullsized":"2024-03-25T05:37:37.431609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:27:40.435483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221996+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T05:37:38.221996+0000","last_peered":"2024-03-25T05:37:38.221996+0000","last_clean":"2024-03-25T05:37:38.221996+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T05:37:38.221996+0000","last_undegraded":"2024-03-25T05:37:38.221996+0000","last_fullsized":"2024-03-25T05:37:38.221996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522837+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T05:37:53.522837+0000","last_peered":"2024-03-25T05:37:53.522837+0000","last_clean":"2024-03-25T05:37:53.522837+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T05:37:53.522837+0000","last_undegraded":"2024-03-25T05:37:53.522837+0000","last_fullsized":"2024-03-25T05:37:53.522837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431779+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T05:37:37.431779+0000","last_peered":"2024-03-25T05:37:37.431779+0000","last_clean":"2024-03-25T05:37:37.431779+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T05:37:37.431779+0000","last_undegraded":"2024-03-25T05:37:37.431779+0000","last_fullsized":"2024-03-25T05:37:37.431779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:25:03.802329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586404+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T05:37:38.586404+0000","last_peered":"2024-03-25T05:37:38.586404+0000","last_clean":"2024-03-25T05:37:38.586404+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T05:37:38.586404+0000","last_undegraded":"2024-03-25T05:37:38.586404+0000","last_fullsized":"2024-03-25T05:37:38.586404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431019+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T05:37:37.431019+0000","last_peered":"2024-03-25T05:37:37.431019+0000","last_clean":"2024-03-25T05:37:37.431019+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T05:37:37.431019+0000","last_undegraded":"2024-03-25T05:37:37.431019+0000","last_fullsized":"2024-03-25T05:37:37.431019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.549971+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T05:37:55.549971+0000","last_peered":"2024-03-25T05:37:55.549971+0000","last_clean":"2024-03-25T05:37:55.549971+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T05:37:55.549971+0000","last_undegraded":"2024-03-25T05:37:55.549971+0000","last_fullsized":"2024-03-25T05:37:55.549971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806142+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T05:37:38.806142+0000","last_peered":"2024-03-25T05:37:38.806142+0000","last_clean":"2024-03-25T05:37:38.806142+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T05:37:38.806142+0000","last_undegraded":"2024-03-25T05:37:38.806142+0000","last_fullsized":"2024-03-25T05:37:38.806142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431606+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T05:37:37.431606+0000","last_peered":"2024-03-25T05:37:37.431606+0000","last_clean":"2024-03-25T05:37:37.431606+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T05:37:37.431606+0000","last_undegraded":"2024-03-25T05:37:37.431606+0000","last_fullsized":"2024-03-25T05:37:37.431606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.544088+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T05:37:54.544088+0000","last_peered":"2024-03-25T05:37:54.544088+0000","last_clean":"2024-03-25T05:37:54.544088+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T05:37:54.544088+0000","last_undegraded":"2024-03-25T05:37:54.544088+0000","last_fullsized":"2024-03-25T05:37:54.544088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.550209+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T05:37:55.550209+0000","last_peered":"2024-03-25T05:37:55.550209+0000","last_clean":"2024-03-25T05:37:55.550209+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T05:37:55.550209+0000","last_undegraded":"2024-03-25T05:37:55.550209+0000","last_fullsized":"2024-03-25T05:37:55.550209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585400+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T05:37:38.585400+0000","last_peered":"2024-03-25T05:37:38.585400+0000","last_clean":"2024-03-25T05:37:38.585400+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T05:37:38.585400+0000","last_undegraded":"2024-03-25T05:37:38.585400+0000","last_fullsized":"2024-03-25T05:37:38.585400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:24.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.529480+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T05:37:53.529480+0000","last_peered":"2024-03-25T05:37:53.529480+0000","last_clean":"2024-03-25T05:37:53.529480+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T05:37:53.529480+0000","last_undegraded":"2024-03-25T05:37:53.529480+0000","last_fullsized":"2024-03-25T05:37:53.529480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432552+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T05:37:37.432552+0000","last_peered":"2024-03-25T05:37:37.432552+0000","last_clean":"2024-03-25T05:37:37.432552+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T05:37:37.432552+0000","last_undegraded":"2024-03-25T05:37:37.432552+0000","last_fullsized":"2024-03-25T05:37:37.432552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433789+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T05:37:37.433789+0000","last_peered":"2024-03-25T05:37:37.433789+0000","last_clean":"2024-03-25T05:37:37.433789+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T05:37:37.433789+0000","last_undegraded":"2024-03-25T05:37:37.433789+0000","last_fullsized":"2024-03-25T05:37:37.433789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:08:02.386273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805476+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T05:37:38.805476+0000","last_peered":"2024-03-25T05:37:38.805476+0000","last_clean":"2024-03-25T05:37:38.805476+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T05:37:38.805476+0000","last_undegraded":"2024-03-25T05:37:38.805476+0000","last_fullsized":"2024-03-25T05:37:38.805476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:31.170943+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:31.170199+0000","last_became_peered":"2024-03-25T05:37:31.170199+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221825+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T05:37:38.221825+0000","last_peered":"2024-03-25T05:37:38.221825+0000","last_clean":"2024-03-25T05:37:38.221825+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T05:37:38.221825+0000","last_undegraded":"2024-03-25T05:37:38.221825+0000","last_fullsized":"2024-03-25T05:37:38.221825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585300+0000","last_change":"2024-03-25T05:37:31.164026+0000","last_active":"2024-03-25T05:37:38.585300+0000","last_peered":"2024-03-25T05:37:38.585300+0000","last_clean":"2024-03-25T05:37:38.585300+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T05:37:38.585300+0000","last_undegraded":"2024-03-25T05:37:38.585300+0000","last_fullsized":"2024-03-25T05:37:38.585300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433660+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T05:37:37.433660+0000","last_peered":"2024-03-25T05:37:37.433660+0000","last_clean":"2024-03-25T05:37:37.433660+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T05:37:37.433660+0000","last_undegraded":"2024-03-25T05:37:37.433660+0000","last_fullsized":"2024-03-25T05:37:37.433660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432470+0000","last_change":"2024-03-25T05:37:31.166178+0000","last_active":"2024-03-25T05:37:37.432470+0000","last_peered":"2024-03-25T05:37:37.432470+0000","last_clean":"2024-03-25T05:37:37.432470+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T05:37:37.432470+0000","last_undegraded":"2024-03-25T05:37:37.432470+0000","last_fullsized":"2024-03-25T05:37:37.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806144+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T05:37:38.806144+0000","last_peered":"2024-03-25T05:37:38.806144+0000","last_clean":"2024-03-25T05:37:38.806144+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T05:37:38.806144+0000","last_undegraded":"2024-03-25T05:37:38.806144+0000","last_fullsized":"2024-03-25T05:37:38.806144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433913+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T05:37:37.433913+0000","last_peered":"2024-03-25T05:37:37.433913+0000","last_clean":"2024-03-25T05:37:37.433913+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T05:37:37.433913+0000","last_undegraded":"2024-03-25T05:37:37.433913+0000","last_fullsized":"2024-03-25T05:37:37.433913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221686+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T05:37:38.221686+0000","last_peered":"2024-03-25T05:37:38.221686+0000","last_clean":"2024-03-25T05:37:38.221686+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T05:37:38.221686+0000","last_undegraded":"2024-03-25T05:37:38.221686+0000","last_fullsized":"2024-03-25T05:37:38.221686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431855+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T05:37:37.431855+0000","last_peered":"2024-03-25T05:37:37.431855+0000","last_clean":"2024-03-25T05:37:37.431855+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T05:37:37.431855+0000","last_undegraded":"2024-03-25T05:37:37.431855+0000","last_fullsized":"2024-03-25T05:37:37.431855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221685+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T05:37:38.221685+0000","last_peered":"2024-03-25T05:37:38.221685+0000","last_clean":"2024-03-25T05:37:38.221685+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T05:37:38.221685+0000","last_undegraded":"2024-03-25T05:37:38.221685+0000","last_fullsized":"2024-03-25T05:37:38.221685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585021+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T05:37:38.585021+0000","last_peered":"2024-03-25T05:37:38.585021+0000","last_clean":"2024-03-25T05:37:38.585021+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T05:37:38.585021+0000","last_undegraded":"2024-03-25T05:37:38.585021+0000","last_fullsized":"2024-03-25T05:37:38.585021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310003+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T05:37:38.310003+0000","last_peered":"2024-03-25T05:37:38.310003+0000","last_clean":"2024-03-25T05:37:38.310003+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T05:37:38.310003+0000","last_undegraded":"2024-03-25T05:37:38.310003+0000","last_fullsized":"2024-03-25T05:37:38.310003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576738+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T05:37:38.576738+0000","last_peered":"2024-03-25T05:37:38.576738+0000","last_clean":"2024-03-25T05:37:38.576738+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T05:37:38.576738+0000","last_undegraded":"2024-03-25T05:37:38.576738+0000","last_fullsized":"2024-03-25T05:37:38.576738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222245+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T05:37:38.222245+0000","last_peered":"2024-03-25T05:37:38.222245+0000","last_clean":"2024-03-25T05:37:38.222245+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T05:37:38.222245+0000","last_undegraded":"2024-03-25T05:37:38.222245+0000","last_fullsized":"2024-03-25T05:37:38.222245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221566+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T05:37:38.221566+0000","last_peered":"2024-03-25T05:37:38.221566+0000","last_clean":"2024-03-25T05:37:38.221566+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T05:37:38.221566+0000","last_undegraded":"2024-03-25T05:37:38.221566+0000","last_fullsized":"2024-03-25T05:37:38.221566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431208+0000","last_change":"2024-03-25T05:37:31.160433+0000","last_active":"2024-03-25T05:37:37.431208+0000","last_peered":"2024-03-25T05:37:37.431208+0000","last_clean":"2024-03-25T05:37:37.431208+0000","last_became_active":"2024-03-25T05:37:31.159183+0000","last_became_peered":"2024-03-25T05:37:31.159183+0000","last_unstale":"2024-03-25T05:37:37.431208+0000","last_undegraded":"2024-03-25T05:37:37.431208+0000","last_fullsized":"2024-03-25T05:37:37.431208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585101+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T05:37:38.585101+0000","last_peered":"2024-03-25T05:37:38.585101+0000","last_clean":"2024-03-25T05:37:38.585101+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T05:37:38.585101+0000","last_undegraded":"2024-03-25T05:37:38.585101+0000","last_fullsized":"2024-03-25T05:37:38.585101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:20.495852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433449+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T05:37:37.433449+0000","last_peered":"2024-03-25T05:37:37.433449+0000","last_clean":"2024-03-25T05:37:37.433449+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T05:37:37.433449+0000","last_undegraded":"2024-03-25T05:37:37.433449+0000","last_fullsized":"2024-03-25T05:37:37.433449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432681+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T05:37:37.432681+0000","last_peered":"2024-03-25T05:37:37.432681+0000","last_clean":"2024-03-25T05:37:37.432681+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T05:37:37.432681+0000","last_undegraded":"2024-03-25T05:37:37.432681+0000","last_fullsized":"2024-03-25T05:37:37.432681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806103+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T05:37:38.806103+0000","last_peered":"2024-03-25T05:37:38.806103+0000","last_clean":"2024-03-25T05:37:38.806103+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T05:37:38.806103+0000","last_undegraded":"2024-03-25T05:37:38.806103+0000","last_fullsized":"2024-03-25T05:37:38.806103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310166+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T05:37:38.310166+0000","last_peered":"2024-03-25T05:37:38.310166+0000","last_clean":"2024-03-25T05:37:38.310166+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T05:37:38.310166+0000","last_undegraded":"2024-03-25T05:37:38.310166+0000","last_fullsized":"2024-03-25T05:37:38.310166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431511+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T05:37:37.431511+0000","last_peered":"2024-03-25T05:37:37.431511+0000","last_clean":"2024-03-25T05:37:37.431511+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T05:37:37.431511+0000","last_undegraded":"2024-03-25T05:37:37.431511+0000","last_fullsized":"2024-03-25T05:37:37.431511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309508+0000","last_change":"2024-03-25T05:37:31.164888+0000","last_active":"2024-03-25T05:37:38.309508+0000","last_peered":"2024-03-25T05:37:38.309508+0000","last_clean":"2024-03-25T05:37:38.309508+0000","last_became_active":"2024-03-25T05:37:31.164658+0000","last_became_peered":"2024-03-25T05:37:31.164658+0000","last_unstale":"2024-03-25T05:37:38.309508+0000","last_undegraded":"2024-03-25T05:37:38.309508+0000","last_fullsized":"2024-03-25T05:37:38.309508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221663+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T05:37:38.221663+0000","last_peered":"2024-03-25T05:37:38.221663+0000","last_clean":"2024-03-25T05:37:38.221663+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T05:37:38.221663+0000","last_undegraded":"2024-03-25T05:37:38.221663+0000","last_fullsized":"2024-03-25T05:37:38.221663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309565+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T05:37:38.309565+0000","last_peered":"2024-03-25T05:37:38.309565+0000","last_clean":"2024-03-25T05:37:38.309565+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T05:37:38.309565+0000","last_undegraded":"2024-03-25T05:37:38.309565+0000","last_fullsized":"2024-03-25T05:37:38.309565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222105+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T05:37:38.222105+0000","last_peered":"2024-03-25T05:37:38.222105+0000","last_clean":"2024-03-25T05:37:38.222105+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T05:37:38.222105+0000","last_undegraded":"2024-03-25T05:37:38.222105+0000","last_fullsized":"2024-03-25T05:37:38.222105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585511+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T05:37:38.585511+0000","last_peered":"2024-03-25T05:37:38.585511+0000","last_clean":"2024-03-25T05:37:38.585511+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T05:37:38.585511+0000","last_undegraded":"2024-03-25T05:37:38.585511+0000","last_fullsized":"2024-03-25T05:37:38.585511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435035+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T05:37:37.435035+0000","last_peered":"2024-03-25T05:37:37.435035+0000","last_clean":"2024-03-25T05:37:37.435035+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T05:37:37.435035+0000","last_undegraded":"2024-03-25T05:37:37.435035+0000","last_fullsized":"2024-03-25T05:37:37.435035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310094+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T05:37:38.310094+0000","last_peered":"2024-03-25T05:37:38.310094+0000","last_clean":"2024-03-25T05:37:38.310094+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T05:37:38.310094+0000","last_undegraded":"2024-03-25T05:37:38.310094+0000","last_fullsized":"2024-03-25T05:37:38.310094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":699861,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":112025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":111325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":108723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":112059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":108855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":108925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":698635,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T05:38:02.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T05:38:03.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.095+0000 7f6cb3200640 1 Processor -- start 2024-03-25T05:38:03.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.095+0000 7f6cb3200640 1 -- start start 2024-03-25T05:38:03.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb3200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6cb40c8fe0 0x7f6cb40c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb3200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c93c0 0x7f6cb4153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb3200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40c78b0 con 0x7f6cb40c6440 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb3200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb40c8280 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb3200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4072680 con 0x7f6cb40c93c0 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c93c0 0x7f6cb4153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb1e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6cb40c8fe0 0x7f6cb40c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c93c0 0x7f6cb4153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53260/0 (socket says 172.21.15.102:53260) 2024-03-25T05:38:03.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.097+0000 7f6cb1400640 1 -- 172.21.15.102:0/3650194341 learned_addr learned my addr 172.21.15.102:0/3650194341 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:03.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.098+0000 7f6cb1e00640 1 -- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c93c0 msgr2=0x7f6cb4153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:03.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.098+0000 7f6cb1e00640 1 --2- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c93c0 0x7f6cb4153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.098+0000 7f6cb1e00640 1 -- 172.21.15.102:0/3650194341 >> v1:172.21.15.102:6789/0 conn(0x7f6cb40c6440 legacy=0x7f6cb406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.098+0000 7f6cb1e00640 1 -- 172.21.15.102:0/3650194341 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4070420 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.098+0000 7f6cb1400640 1 --2- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c93c0 0x7f6cb4153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:03.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.099+0000 7f6cb1e00640 1 --2- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c8fe0 0x7f6cb40c7d40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40097a0 tx=0x7f6ca402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62005dad840c896c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:03.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.099+0000 7f6cb0a00640 1 -- 172.21.15.102:0/3650194341 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca402d040 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.099+0000 7f6cb0a00640 1 -- 172.21.15.102:0/3650194341 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4031810 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.099+0000 7f6cb0a00640 1 -- 172.21.15.102:0/3650194341 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4031ba0 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 -- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c8fe0 msgr2=0x7f6cb40c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c8fe0 0x7f6cb40c7d40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40097a0 tx=0x7f6ca402b8b0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 -- 172.21.15.102:0/3650194341 shutdown_connections 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c93c0 0x7f6cb4153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3650194341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c8fe0 0x7f6cb40c7d40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 -- 172.21.15.102:0/3650194341 >> 172.21.15.102:0/3650194341 conn(0x7f6cb406c0c0 msgr2=0x7f6cb406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 -- 172.21.15.102:0/3650194341 shutdown_connections 2024-03-25T05:38:03.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.100+0000 7f6cb3200640 1 -- 172.21.15.102:0/3650194341 wait complete. 2024-03-25T05:38:03.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.102+0000 7f6cb3200640 1 Processor -- start 2024-03-25T05:38:03.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.102+0000 7f6cb3200640 1 -- start start 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.102+0000 7f6cb3200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb40c6440 0x7f6cb40c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb3200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c8fe0 0x7f6cb414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb3200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c93c0 0x7f6cb414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb3200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41eff00 con 0x7f6cb40c6440 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb3200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb414dce0 con 0x7f6cb40c93c0 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb3200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb414d9a0 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c8fe0 0x7f6cb414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c8fe0 0x7f6cb414e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53270/0 (socket says 172.21.15.102:53270) 2024-03-25T05:38:03.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 -- 172.21.15.102:0/3804722880 learned_addr learned my addr 172.21.15.102:0/3804722880 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:03.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb2800640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c93c0 0x7f6cb414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1e00640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb40c6440 0x7f6cb40c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 -- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c93c0 msgr2=0x7f6cb414e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c93c0 0x7f6cb414e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 -- 172.21.15.102:0/3804722880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb40c6440 msgr2=0x7f6cb40c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb40c6440 0x7f6cb40c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb1400640 1 -- 172.21.15.102:0/3804722880 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00094d0 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.103+0000 7f6cb2800640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c93c0 0x7f6cb414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.104+0000 7f6cb1400640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c8fe0 0x7f6cb414e170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000e9e0 tx=0x7f6ca000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:03.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.104+0000 7f6caa000640 1 -- 172.21.15.102:0/3804722880 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000c9d0 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.104+0000 7f6caa000640 1 -- 172.21.15.102:0/3804722880 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca000cb30 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.104+0000 7f6caa000640 1 -- 172.21.15.102:0/3804722880 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000cea0 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.104+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca4009400 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.104+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb41ef660 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.105+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb404f2f0 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.106+0000 7f6caa000640 1 -- 172.21.15.102:0/3804722880 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ca0013470 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.107+0000 7f6caa000640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6c9406b810 0x7f6c9406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.107+0000 7f6caa000640 1 -- 172.21.15.102:0/3804722880 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6ca008ab90 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.107+0000 7f6cb1e00640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6c9406b810 0x7f6c9406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.108+0000 7f6cb1e00640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6c9406b810 0x7f6c9406dcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4036000 tx=0x7f6ca403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:03.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.115+0000 7f6caa000640 1 -- 172.21.15.102:0/3804722880 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6ca00551f0 con 0x7f6cb40c8fe0 2024-03-25T05:38:03.220 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:38:03.226 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:38:03.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.335+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6cb4070700 con 0x7f6c9406b810 2024-03-25T05:38:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.344+0000 7f6caa000640 1 -- 172.21.15.102:0/3804722880 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332711 (secure 0 0 0) 0x7f6ca4044400 con 0x7f6c9406b810 2024-03-25T05:38:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T05:38:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6c9406b810 msgr2=0x7f6c9406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6c9406b810 0x7f6c9406dcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4036000 tx=0x7f6ca403c040 comp rx=0 tx=0).stop 2024-03-25T05:38:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c8fe0 msgr2=0x7f6cb414e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c8fe0 0x7f6cb414e170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000e9e0 tx=0x7f6ca000eea0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 shutdown_connections 2024-03-25T05:38:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6c9406b810 0x7f6c9406dcd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cb40c93c0 0x7f6cb414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cb40c8fe0 0x7f6cb414e170 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 --2- 172.21.15.102:0/3804722880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cb40c6440 0x7f6cb40c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 >> 172.21.15.102:0/3804722880 conn(0x7f6cb406c0c0 msgr2=0x7f6cb4152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 shutdown_connections 2024-03-25T05:38:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.349+0000 7f6cb3200640 1 -- 172.21.15.102:0/3804722880 wait complete. 2024-03-25T05:38:03.359 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-03-25T05:38:03.012571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":368,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":2523136,"data_stored":2060408,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5765,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002625"},"pg_stats":[{"pgid":"2.1f","version":"25'13","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562236+0000","last_change":"2024-03-25T05:37:30.423912+0000","last_active":"2024-03-25T05:37:56.562236+0000","last_peered":"2024-03-25T05:37:56.562236+0000","last_clean":"2024-03-25T05:37:56.562236+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T05:37:56.562236+0000","last_undegraded":"2024-03-25T05:37:56.562236+0000","last_fullsized":"2024-03-25T05:37:56.562236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433740+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T05:37:37.433740+0000","last_peered":"2024-03-25T05:37:37.433740+0000","last_clean":"2024-03-25T05:37:37.433740+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T05:37:37.433740+0000","last_undegraded":"2024-03-25T05:37:37.433740+0000","last_fullsized":"2024-03-25T05:37:37.433740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431653+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T05:37:37.431653+0000","last_peered":"2024-03-25T05:37:37.431653+0000","last_clean":"2024-03-25T05:37:37.431653+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T05:37:37.431653+0000","last_undegraded":"2024-03-25T05:37:37.431653+0000","last_fullsized":"2024-03-25T05:37:37.431653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:43:49.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433909+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T05:37:37.433909+0000","last_peered":"2024-03-25T05:37:37.433909+0000","last_clean":"2024-03-25T05:37:37.433909+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T05:37:37.433909+0000","last_undegraded":"2024-03-25T05:37:37.433909+0000","last_fullsized":"2024-03-25T05:37:37.433909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585751+0000","last_change":"2024-03-25T05:37:31.155929+0000","last_active":"2024-03-25T05:37:38.585751+0000","last_peered":"2024-03-25T05:37:38.585751+0000","last_clean":"2024-03-25T05:37:38.585751+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T05:37:38.585751+0000","last_undegraded":"2024-03-25T05:37:38.585751+0000","last_fullsized":"2024-03-25T05:37:38.585751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432218+0000","last_change":"2024-03-25T05:37:35.459531+0000","last_active":"2024-03-25T05:37:37.432218+0000","last_peered":"2024-03-25T05:37:37.432218+0000","last_clean":"2024-03-25T05:37:37.432218+0000","last_became_active":"2024-03-25T05:37:35.459127+0000","last_became_peered":"2024-03-25T05:37:35.459127+0000","last_unstale":"2024-03-25T05:37:37.432218+0000","last_undegraded":"2024-03-25T05:37:37.432218+0000","last_fullsized":"2024-03-25T05:37:37.432218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'12","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562779+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T05:37:56.562779+0000","last_peered":"2024-03-25T05:37:56.562779+0000","last_clean":"2024-03-25T05:37:56.562779+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T05:37:56.562779+0000","last_undegraded":"2024-03-25T05:37:56.562779+0000","last_fullsized":"2024-03-25T05:37:56.562779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221959+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T05:37:38.221959+0000","last_peered":"2024-03-25T05:37:38.221959+0000","last_clean":"2024-03-25T05:37:38.221959+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T05:37:38.221959+0000","last_undegraded":"2024-03-25T05:37:38.221959+0000","last_fullsized":"2024-03-25T05:37:38.221959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432708+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T05:37:37.432708+0000","last_peered":"2024-03-25T05:37:37.432708+0000","last_clean":"2024-03-25T05:37:37.432708+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T05:37:37.432708+0000","last_undegraded":"2024-03-25T05:37:37.432708+0000","last_fullsized":"2024-03-25T05:37:37.432708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.559331+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T05:37:56.559331+0000","last_peered":"2024-03-25T05:37:56.559331+0000","last_clean":"2024-03-25T05:37:56.559331+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T05:37:56.559331+0000","last_undegraded":"2024-03-25T05:37:56.559331+0000","last_fullsized":"2024-03-25T05:37:56.559331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222108+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T05:37:38.222108+0000","last_peered":"2024-03-25T05:37:38.222108+0000","last_clean":"2024-03-25T05:37:38.222108+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T05:37:38.222108+0000","last_undegraded":"2024-03-25T05:37:38.222108+0000","last_fullsized":"2024-03-25T05:37:38.222108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432306+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T05:37:37.432306+0000","last_peered":"2024-03-25T05:37:37.432306+0000","last_clean":"2024-03-25T05:37:37.432306+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T05:37:37.432306+0000","last_undegraded":"2024-03-25T05:37:37.432306+0000","last_fullsized":"2024-03-25T05:37:37.432306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805582+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T05:37:38.805582+0000","last_peered":"2024-03-25T05:37:38.805582+0000","last_clean":"2024-03-25T05:37:38.805582+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T05:37:38.805582+0000","last_undegraded":"2024-03-25T05:37:38.805582+0000","last_fullsized":"2024-03-25T05:37:38.805582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.520789+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T05:37:53.520789+0000","last_peered":"2024-03-25T05:37:53.520789+0000","last_clean":"2024-03-25T05:37:53.520789+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T05:37:53.520789+0000","last_undegraded":"2024-03-25T05:37:53.520789+0000","last_fullsized":"2024-03-25T05:37:53.520789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432841+0000","last_change":"2024-03-25T05:37:35.462815+0000","last_active":"2024-03-25T05:37:37.432841+0000","last_peered":"2024-03-25T05:37:37.432841+0000","last_clean":"2024-03-25T05:37:37.432841+0000","last_became_active":"2024-03-25T05:37:35.462293+0000","last_became_peered":"2024-03-25T05:37:35.462293+0000","last_unstale":"2024-03-25T05:37:37.432841+0000","last_undegraded":"2024-03-25T05:37:37.432841+0000","last_fullsized":"2024-03-25T05:37:37.432841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433456+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T05:37:37.433456+0000","last_peered":"2024-03-25T05:37:37.433456+0000","last_clean":"2024-03-25T05:37:37.433456+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T05:37:37.433456+0000","last_undegraded":"2024-03-25T05:37:37.433456+0000","last_fullsized":"2024-03-25T05:37:37.433456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.549609+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T05:37:55.549609+0000","last_peered":"2024-03-25T05:37:55.549609+0000","last_clean":"2024-03-25T05:37:55.549609+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T05:37:55.549609+0000","last_undegraded":"2024-03-25T05:37:55.549609+0000","last_fullsized":"2024-03-25T05:37:55.549609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433020+0000","last_change":"2024-03-25T05:37:35.463326+0000","last_active":"2024-03-25T05:37:37.433020+0000","last_peered":"2024-03-25T05:37:37.433020+0000","last_clean":"2024-03-25T05:37:37.433020+0000","last_became_active":"2024-03-25T05:37:35.462618+0000","last_became_peered":"2024-03-25T05:37:35.462618+0000","last_unstale":"2024-03-25T05:37:37.433020+0000","last_undegraded":"2024-03-25T05:37:37.433020+0000","last_fullsized":"2024-03-25T05:37:37.433020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431690+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T05:37:37.431690+0000","last_peered":"2024-03-25T05:37:37.431690+0000","last_clean":"2024-03-25T05:37:37.431690+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T05:37:37.431690+0000","last_undegraded":"2024-03-25T05:37:37.431690+0000","last_fullsized":"2024-03-25T05:37:37.431690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.557525+0000","last_change":"2024-03-25T05:37:30.422594+0000","last_active":"2024-03-25T05:37:56.557525+0000","last_peered":"2024-03-25T05:37:56.557525+0000","last_clean":"2024-03-25T05:37:56.557525+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T05:37:56.557525+0000","last_undegraded":"2024-03-25T05:37:56.557525+0000","last_fullsized":"2024-03-25T05:37:56.557525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435022+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T05:37:37.435022+0000","last_peered":"2024-03-25T05:37:37.435022+0000","last_clean":"2024-03-25T05:37:37.435022+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T05:37:37.435022+0000","last_undegraded":"2024-03-25T05:37:37.435022+0000","last_fullsized":"2024-03-25T05:37:37.435022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432539+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T05:37:37.432539+0000","last_peered":"2024-03-25T05:37:37.432539+0000","last_clean":"2024-03-25T05:37:37.432539+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T05:37:37.432539+0000","last_undegraded":"2024-03-25T05:37:37.432539+0000","last_fullsized":"2024-03-25T05:37:37.432539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.526401+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T05:37:53.526401+0000","last_peered":"2024-03-25T05:37:53.526401+0000","last_clean":"2024-03-25T05:37:53.526401+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T05:37:53.526401+0000","last_undegraded":"2024-03-25T05:37:53.526401+0000","last_fullsized":"2024-03-25T05:37:53.526401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432590+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T05:37:37.432590+0000","last_peered":"2024-03-25T05:37:37.432590+0000","last_clean":"2024-03-25T05:37:37.432590+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T05:37:37.432590+0000","last_undegraded":"2024-03-25T05:37:37.432590+0000","last_fullsized":"2024-03-25T05:37:37.432590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585863+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T05:37:38.585863+0000","last_peered":"2024-03-25T05:37:38.585863+0000","last_clean":"2024-03-25T05:37:38.585863+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T05:37:38.585863+0000","last_undegraded":"2024-03-25T05:37:38.585863+0000","last_fullsized":"2024-03-25T05:37:38.585863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.558487+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T05:37:56.558487+0000","last_peered":"2024-03-25T05:37:56.558487+0000","last_clean":"2024-03-25T05:37:56.558487+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T05:37:56.558487+0000","last_undegraded":"2024-03-25T05:37:56.558487+0000","last_fullsized":"2024-03-25T05:37:56.558487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432209+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T05:37:37.432209+0000","last_peered":"2024-03-25T05:37:37.432209+0000","last_clean":"2024-03-25T05:37:37.432209+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T05:37:37.432209+0000","last_undegraded":"2024-03-25T05:37:37.432209+0000","last_fullsized":"2024-03-25T05:37:37.432209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433971+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T05:37:37.433971+0000","last_peered":"2024-03-25T05:37:37.433971+0000","last_clean":"2024-03-25T05:37:37.433971+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T05:37:37.433971+0000","last_undegraded":"2024-03-25T05:37:37.433971+0000","last_fullsized":"2024-03-25T05:37:37.433971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.557437+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T05:37:55.557437+0000","last_peered":"2024-03-25T05:37:55.557437+0000","last_clean":"2024-03-25T05:37:55.557437+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T05:37:55.557437+0000","last_undegraded":"2024-03-25T05:37:55.557437+0000","last_fullsized":"2024-03-25T05:37:55.557437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431411+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T05:37:37.431411+0000","last_peered":"2024-03-25T05:37:37.431411+0000","last_clean":"2024-03-25T05:37:37.431411+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T05:37:37.431411+0000","last_undegraded":"2024-03-25T05:37:37.431411+0000","last_fullsized":"2024-03-25T05:37:37.431411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:43:13.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431535+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T05:37:37.431535+0000","last_peered":"2024-03-25T05:37:37.431535+0000","last_clean":"2024-03-25T05:37:37.431535+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T05:37:37.431535+0000","last_undegraded":"2024-03-25T05:37:37.431535+0000","last_fullsized":"2024-03-25T05:37:37.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.548670+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T05:37:55.548670+0000","last_peered":"2024-03-25T05:37:55.548670+0000","last_clean":"2024-03-25T05:37:55.548670+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T05:37:55.548670+0000","last_undegraded":"2024-03-25T05:37:55.548670+0000","last_fullsized":"2024-03-25T05:37:55.548670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585184+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T05:37:38.585184+0000","last_peered":"2024-03-25T05:37:38.585184+0000","last_clean":"2024-03-25T05:37:38.585184+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T05:37:38.585184+0000","last_undegraded":"2024-03-25T05:37:38.585184+0000","last_fullsized":"2024-03-25T05:37:38.585184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222226+0000","last_change":"2024-03-25T05:37:31.164193+0000","last_active":"2024-03-25T05:37:38.222226+0000","last_peered":"2024-03-25T05:37:38.222226+0000","last_clean":"2024-03-25T05:37:38.222226+0000","last_became_active":"2024-03-25T05:37:31.163899+0000","last_became_peered":"2024-03-25T05:37:31.163899+0000","last_unstale":"2024-03-25T05:37:38.222226+0000","last_undegraded":"2024-03-25T05:37:38.222226+0000","last_fullsized":"2024-03-25T05:37:38.222226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431605+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T05:37:37.431605+0000","last_peered":"2024-03-25T05:37:37.431605+0000","last_clean":"2024-03-25T05:37:37.431605+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T05:37:37.431605+0000","last_undegraded":"2024-03-25T05:37:37.431605+0000","last_fullsized":"2024-03-25T05:37:37.431605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431836+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T05:37:37.431836+0000","last_peered":"2024-03-25T05:37:37.431836+0000","last_clean":"2024-03-25T05:37:37.431836+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T05:37:37.431836+0000","last_undegraded":"2024-03-25T05:37:37.431836+0000","last_fullsized":"2024-03-25T05:37:37.431836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432936+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T05:37:37.432936+0000","last_peered":"2024-03-25T05:37:37.432936+0000","last_clean":"2024-03-25T05:37:37.432936+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T05:37:37.432936+0000","last_undegraded":"2024-03-25T05:37:37.432936+0000","last_fullsized":"2024-03-25T05:37:37.432936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.564146+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T05:37:56.564146+0000","last_peered":"2024-03-25T05:37:56.564146+0000","last_clean":"2024-03-25T05:37:56.564146+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T05:37:56.564146+0000","last_undegraded":"2024-03-25T05:37:56.564146+0000","last_fullsized":"2024-03-25T05:37:56.564146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431467+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T05:37:37.431467+0000","last_peered":"2024-03-25T05:37:37.431467+0000","last_clean":"2024-03-25T05:37:37.431467+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T05:37:37.431467+0000","last_undegraded":"2024-03-25T05:37:37.431467+0000","last_fullsized":"2024-03-25T05:37:37.431467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431111+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T05:37:37.431111+0000","last_peered":"2024-03-25T05:37:37.431111+0000","last_clean":"2024-03-25T05:37:37.431111+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T05:37:37.431111+0000","last_undegraded":"2024-03-25T05:37:37.431111+0000","last_fullsized":"2024-03-25T05:37:37.431111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.544985+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T05:37:54.544985+0000","last_peered":"2024-03-25T05:37:54.544985+0000","last_clean":"2024-03-25T05:37:54.544985+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T05:37:54.544985+0000","last_undegraded":"2024-03-25T05:37:54.544985+0000","last_fullsized":"2024-03-25T05:37:54.544985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435112+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T05:37:37.435112+0000","last_peered":"2024-03-25T05:37:37.435112+0000","last_clean":"2024-03-25T05:37:37.435112+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T05:37:37.435112+0000","last_undegraded":"2024-03-25T05:37:37.435112+0000","last_fullsized":"2024-03-25T05:37:37.435112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.584741+0000","last_change":"2024-03-25T05:37:31.148439+0000","last_active":"2024-03-25T05:37:38.584741+0000","last_peered":"2024-03-25T05:37:38.584741+0000","last_clean":"2024-03-25T05:37:38.584741+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T05:37:38.584741+0000","last_undegraded":"2024-03-25T05:37:38.584741+0000","last_fullsized":"2024-03-25T05:37:38.584741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:53:17.257529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.534185+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T05:37:54.534185+0000","last_peered":"2024-03-25T05:37:54.534185+0000","last_clean":"2024-03-25T05:37:54.534185+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T05:37:54.534185+0000","last_undegraded":"2024-03-25T05:37:54.534185+0000","last_fullsized":"2024-03-25T05:37:54.534185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585707+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T05:37:38.585707+0000","last_peered":"2024-03-25T05:37:38.585707+0000","last_clean":"2024-03-25T05:37:38.585707+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T05:37:38.585707+0000","last_undegraded":"2024-03-25T05:37:38.585707+0000","last_fullsized":"2024-03-25T05:37:38.585707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433259+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T05:37:37.433259+0000","last_peered":"2024-03-25T05:37:37.433259+0000","last_clean":"2024-03-25T05:37:37.433259+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T05:37:37.433259+0000","last_undegraded":"2024-03-25T05:37:37.433259+0000","last_fullsized":"2024-03-25T05:37:37.433259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'6","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.553183+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T05:37:55.553183+0000","last_peered":"2024-03-25T05:37:55.553183+0000","last_clean":"2024-03-25T05:37:55.553183+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T05:37:55.553183+0000","last_undegraded":"2024-03-25T05:37:55.553183+0000","last_fullsized":"2024-03-25T05:37:55.553183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309433+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T05:37:38.309433+0000","last_peered":"2024-03-25T05:37:38.309433+0000","last_clean":"2024-03-25T05:37:38.309433+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T05:37:38.309433+0000","last_undegraded":"2024-03-25T05:37:38.309433+0000","last_fullsized":"2024-03-25T05:37:38.309433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309757+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T05:37:38.309757+0000","last_peered":"2024-03-25T05:37:38.309757+0000","last_clean":"2024-03-25T05:37:38.309757+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T05:37:38.309757+0000","last_undegraded":"2024-03-25T05:37:38.309757+0000","last_fullsized":"2024-03-25T05:37:38.309757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.549080+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T05:37:55.549080+0000","last_peered":"2024-03-25T05:37:55.549080+0000","last_clean":"2024-03-25T05:37:55.549080+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T05:37:55.549080+0000","last_undegraded":"2024-03-25T05:37:55.549080+0000","last_fullsized":"2024-03-25T05:37:55.549080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805783+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T05:37:38.805783+0000","last_peered":"2024-03-25T05:37:38.805783+0000","last_clean":"2024-03-25T05:37:38.805783+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T05:37:38.805783+0000","last_undegraded":"2024-03-25T05:37:38.805783+0000","last_fullsized":"2024-03-25T05:37:38.805783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222175+0000","last_change":"2024-03-25T05:37:31.167109+0000","last_active":"2024-03-25T05:37:38.222175+0000","last_peered":"2024-03-25T05:37:38.222175+0000","last_clean":"2024-03-25T05:37:38.222175+0000","last_became_active":"2024-03-25T05:37:31.166757+0000","last_became_peered":"2024-03-25T05:37:31.166757+0000","last_unstale":"2024-03-25T05:37:38.222175+0000","last_undegraded":"2024-03-25T05:37:38.222175+0000","last_fullsized":"2024-03-25T05:37:38.222175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.554638+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T05:37:55.554638+0000","last_peered":"2024-03-25T05:37:55.554638+0000","last_clean":"2024-03-25T05:37:55.554638+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T05:37:55.554638+0000","last_undegraded":"2024-03-25T05:37:55.554638+0000","last_fullsized":"2024-03-25T05:37:55.554638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585200+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T05:37:38.585200+0000","last_peered":"2024-03-25T05:37:38.585200+0000","last_clean":"2024-03-25T05:37:38.585200+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T05:37:38.585200+0000","last_undegraded":"2024-03-25T05:37:38.585200+0000","last_fullsized":"2024-03-25T05:37:38.585200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310218+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T05:37:38.310218+0000","last_peered":"2024-03-25T05:37:38.310218+0000","last_clean":"2024-03-25T05:37:38.310218+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T05:37:38.310218+0000","last_undegraded":"2024-03-25T05:37:38.310218+0000","last_fullsized":"2024-03-25T05:37:38.310218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.564768+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T05:37:56.564768+0000","last_peered":"2024-03-25T05:37:56.564768+0000","last_clean":"2024-03-25T05:37:56.564768+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T05:37:56.564768+0000","last_undegraded":"2024-03-25T05:37:56.564768+0000","last_fullsized":"2024-03-25T05:37:56.564768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221545+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T05:37:38.221545+0000","last_peered":"2024-03-25T05:37:38.221545+0000","last_clean":"2024-03-25T05:37:38.221545+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T05:37:38.221545+0000","last_undegraded":"2024-03-25T05:37:38.221545+0000","last_fullsized":"2024-03-25T05:37:38.221545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309922+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T05:37:38.309922+0000","last_peered":"2024-03-25T05:37:38.309922+0000","last_clean":"2024-03-25T05:37:38.309922+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T05:37:38.309922+0000","last_undegraded":"2024-03-25T05:37:38.309922+0000","last_fullsized":"2024-03-25T05:37:38.309922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433073+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T05:37:37.433073+0000","last_peered":"2024-03-25T05:37:37.433073+0000","last_clean":"2024-03-25T05:37:37.433073+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T05:37:37.433073+0000","last_undegraded":"2024-03-25T05:37:37.433073+0000","last_fullsized":"2024-03-25T05:37:37.433073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432138+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T05:37:37.432138+0000","last_peered":"2024-03-25T05:37:37.432138+0000","last_clean":"2024-03-25T05:37:37.432138+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T05:37:37.432138+0000","last_undegraded":"2024-03-25T05:37:37.432138+0000","last_fullsized":"2024-03-25T05:37:37.432138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309589+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T05:37:38.309589+0000","last_peered":"2024-03-25T05:37:38.309589+0000","last_clean":"2024-03-25T05:37:38.309589+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T05:37:38.309589+0000","last_undegraded":"2024-03-25T05:37:38.309589+0000","last_fullsized":"2024-03-25T05:37:38.309589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'17","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.550891+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T05:37:55.550891+0000","last_peered":"2024-03-25T05:37:55.550891+0000","last_clean":"2024-03-25T05:37:55.550891+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T05:37:55.550891+0000","last_undegraded":"2024-03-25T05:37:55.550891+0000","last_fullsized":"2024-03-25T05:37:55.550891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585552+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T05:37:38.585552+0000","last_peered":"2024-03-25T05:37:38.585552+0000","last_clean":"2024-03-25T05:37:38.585552+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T05:37:38.585552+0000","last_undegraded":"2024-03-25T05:37:38.585552+0000","last_fullsized":"2024-03-25T05:37:38.585552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805642+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T05:37:38.805642+0000","last_peered":"2024-03-25T05:37:38.805642+0000","last_clean":"2024-03-25T05:37:38.805642+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T05:37:38.805642+0000","last_undegraded":"2024-03-25T05:37:38.805642+0000","last_fullsized":"2024-03-25T05:37:38.805642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.550054+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T05:37:55.550054+0000","last_peered":"2024-03-25T05:37:55.550054+0000","last_clean":"2024-03-25T05:37:55.550054+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T05:37:55.550054+0000","last_undegraded":"2024-03-25T05:37:55.550054+0000","last_fullsized":"2024-03-25T05:37:55.550054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433845+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T05:37:37.433845+0000","last_peered":"2024-03-25T05:37:37.433845+0000","last_clean":"2024-03-25T05:37:37.433845+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T05:37:37.433845+0000","last_undegraded":"2024-03-25T05:37:37.433845+0000","last_fullsized":"2024-03-25T05:37:37.433845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:50.989171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309666+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T05:37:38.309666+0000","last_peered":"2024-03-25T05:37:38.309666+0000","last_clean":"2024-03-25T05:37:38.309666+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T05:37:38.309666+0000","last_undegraded":"2024-03-25T05:37:38.309666+0000","last_fullsized":"2024-03-25T05:37:38.309666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.551128+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T05:37:55.551128+0000","last_peered":"2024-03-25T05:37:55.551128+0000","last_clean":"2024-03-25T05:37:55.551128+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T05:37:55.551128+0000","last_undegraded":"2024-03-25T05:37:55.551128+0000","last_fullsized":"2024-03-25T05:37:55.551128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433594+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T05:37:37.433594+0000","last_peered":"2024-03-25T05:37:37.433594+0000","last_clean":"2024-03-25T05:37:37.433594+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T05:37:37.433594+0000","last_undegraded":"2024-03-25T05:37:37.433594+0000","last_fullsized":"2024-03-25T05:37:37.433594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:14:50.068275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585076+0000","last_change":"2024-03-25T05:37:31.149941+0000","last_active":"2024-03-25T05:37:38.585076+0000","last_peered":"2024-03-25T05:37:38.585076+0000","last_clean":"2024-03-25T05:37:38.585076+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T05:37:38.585076+0000","last_undegraded":"2024-03-25T05:37:38.585076+0000","last_fullsized":"2024-03-25T05:37:38.585076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:24:40.019842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562368+0000","last_change":"2024-03-25T05:37:30.419153+0000","last_active":"2024-03-25T05:37:56.562368+0000","last_peered":"2024-03-25T05:37:56.562368+0000","last_clean":"2024-03-25T05:37:56.562368+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T05:37:56.562368+0000","last_undegraded":"2024-03-25T05:37:56.562368+0000","last_fullsized":"2024-03-25T05:37:56.562368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:16:01.889443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222103+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T05:37:38.222103+0000","last_peered":"2024-03-25T05:37:38.222103+0000","last_clean":"2024-03-25T05:37:38.222103+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T05:37:38.222103+0000","last_undegraded":"2024-03-25T05:37:38.222103+0000","last_fullsized":"2024-03-25T05:37:38.222103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309669+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T05:37:38.309669+0000","last_peered":"2024-03-25T05:37:38.309669+0000","last_clean":"2024-03-25T05:37:38.309669+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T05:37:38.309669+0000","last_undegraded":"2024-03-25T05:37:38.309669+0000","last_fullsized":"2024-03-25T05:37:38.309669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.561078+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T05:37:56.561078+0000","last_peered":"2024-03-25T05:37:56.561078+0000","last_clean":"2024-03-25T05:37:56.561078+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T05:37:56.561078+0000","last_undegraded":"2024-03-25T05:37:56.561078+0000","last_fullsized":"2024-03-25T05:37:56.561078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432193+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T05:37:37.432193+0000","last_peered":"2024-03-25T05:37:37.432193+0000","last_clean":"2024-03-25T05:37:37.432193+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T05:37:37.432193+0000","last_undegraded":"2024-03-25T05:37:37.432193+0000","last_fullsized":"2024-03-25T05:37:37.432193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432777+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T05:37:37.432777+0000","last_peered":"2024-03-25T05:37:37.432777+0000","last_clean":"2024-03-25T05:37:37.432777+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T05:37:37.432777+0000","last_undegraded":"2024-03-25T05:37:37.432777+0000","last_fullsized":"2024-03-25T05:37:37.432777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.525174+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T05:37:53.525174+0000","last_peered":"2024-03-25T05:37:53.525174+0000","last_clean":"2024-03-25T05:37:53.525174+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T05:37:53.525174+0000","last_undegraded":"2024-03-25T05:37:53.525174+0000","last_fullsized":"2024-03-25T05:37:53.525174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432399+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T05:37:37.432399+0000","last_peered":"2024-03-25T05:37:37.432399+0000","last_clean":"2024-03-25T05:37:37.432399+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T05:37:37.432399+0000","last_undegraded":"2024-03-25T05:37:37.432399+0000","last_fullsized":"2024-03-25T05:37:37.432399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586024+0000","last_change":"2024-03-25T05:37:31.156173+0000","last_active":"2024-03-25T05:37:38.586024+0000","last_peered":"2024-03-25T05:37:38.586024+0000","last_clean":"2024-03-25T05:37:38.586024+0000","last_became_active":"2024-03-25T05:37:31.155640+0000","last_became_peered":"2024-03-25T05:37:31.155640+0000","last_unstale":"2024-03-25T05:37:38.586024+0000","last_undegraded":"2024-03-25T05:37:38.586024+0000","last_fullsized":"2024-03-25T05:37:38.586024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:56.562285+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T05:37:56.562285+0000","last_peered":"2024-03-25T05:37:56.562285+0000","last_clean":"2024-03-25T05:37:56.562285+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T05:37:56.562285+0000","last_undegraded":"2024-03-25T05:37:56.562285+0000","last_fullsized":"2024-03-25T05:37:56.562285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431609+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T05:37:37.431609+0000","last_peered":"2024-03-25T05:37:37.431609+0000","last_clean":"2024-03-25T05:37:37.431609+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T05:37:37.431609+0000","last_undegraded":"2024-03-25T05:37:37.431609+0000","last_fullsized":"2024-03-25T05:37:37.431609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:27:40.435483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221996+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T05:37:38.221996+0000","last_peered":"2024-03-25T05:37:38.221996+0000","last_clean":"2024-03-25T05:37:38.221996+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T05:37:38.221996+0000","last_undegraded":"2024-03-25T05:37:38.221996+0000","last_fullsized":"2024-03-25T05:37:38.221996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.522837+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T05:37:53.522837+0000","last_peered":"2024-03-25T05:37:53.522837+0000","last_clean":"2024-03-25T05:37:53.522837+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T05:37:53.522837+0000","last_undegraded":"2024-03-25T05:37:53.522837+0000","last_fullsized":"2024-03-25T05:37:53.522837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431779+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T05:37:37.431779+0000","last_peered":"2024-03-25T05:37:37.431779+0000","last_clean":"2024-03-25T05:37:37.431779+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T05:37:37.431779+0000","last_undegraded":"2024-03-25T05:37:37.431779+0000","last_fullsized":"2024-03-25T05:37:37.431779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:25:03.802329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.586404+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T05:37:38.586404+0000","last_peered":"2024-03-25T05:37:38.586404+0000","last_clean":"2024-03-25T05:37:38.586404+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T05:37:38.586404+0000","last_undegraded":"2024-03-25T05:37:38.586404+0000","last_fullsized":"2024-03-25T05:37:38.586404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431019+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T05:37:37.431019+0000","last_peered":"2024-03-25T05:37:37.431019+0000","last_clean":"2024-03-25T05:37:37.431019+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T05:37:37.431019+0000","last_undegraded":"2024-03-25T05:37:37.431019+0000","last_fullsized":"2024-03-25T05:37:37.431019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.549971+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T05:37:55.549971+0000","last_peered":"2024-03-25T05:37:55.549971+0000","last_clean":"2024-03-25T05:37:55.549971+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T05:37:55.549971+0000","last_undegraded":"2024-03-25T05:37:55.549971+0000","last_fullsized":"2024-03-25T05:37:55.549971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806142+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T05:37:38.806142+0000","last_peered":"2024-03-25T05:37:38.806142+0000","last_clean":"2024-03-25T05:37:38.806142+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T05:37:38.806142+0000","last_undegraded":"2024-03-25T05:37:38.806142+0000","last_fullsized":"2024-03-25T05:37:38.806142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431606+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T05:37:37.431606+0000","last_peered":"2024-03-25T05:37:37.431606+0000","last_clean":"2024-03-25T05:37:37.431606+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T05:37:37.431606+0000","last_undegraded":"2024-03-25T05:37:37.431606+0000","last_fullsized":"2024-03-25T05:37:37.431606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:54.544088+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T05:37:54.544088+0000","last_peered":"2024-03-25T05:37:54.544088+0000","last_clean":"2024-03-25T05:37:54.544088+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T05:37:54.544088+0000","last_undegraded":"2024-03-25T05:37:54.544088+0000","last_fullsized":"2024-03-25T05:37:54.544088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:55.550209+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T05:37:55.550209+0000","last_peered":"2024-03-25T05:37:55.550209+0000","last_clean":"2024-03-25T05:37:55.550209+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T05:37:55.550209+0000","last_undegraded":"2024-03-25T05:37:55.550209+0000","last_fullsized":"2024-03-25T05:37:55.550209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585400+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T05:37:38.585400+0000","last_peered":"2024-03-25T05:37:38.585400+0000","last_clean":"2024-03-25T05:37:38.585400+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T05:37:38.585400+0000","last_undegraded":"2024-03-25T05:37:38.585400+0000","last_fullsized":"2024-03-25T05:37:38.585400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:24.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:53.529480+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T05:37:53.529480+0000","last_peered":"2024-03-25T05:37:53.529480+0000","last_clean":"2024-03-25T05:37:53.529480+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T05:37:53.529480+0000","last_undegraded":"2024-03-25T05:37:53.529480+0000","last_fullsized":"2024-03-25T05:37:53.529480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432552+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T05:37:37.432552+0000","last_peered":"2024-03-25T05:37:37.432552+0000","last_clean":"2024-03-25T05:37:37.432552+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T05:37:37.432552+0000","last_undegraded":"2024-03-25T05:37:37.432552+0000","last_fullsized":"2024-03-25T05:37:37.432552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433789+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T05:37:37.433789+0000","last_peered":"2024-03-25T05:37:37.433789+0000","last_clean":"2024-03-25T05:37:37.433789+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T05:37:37.433789+0000","last_undegraded":"2024-03-25T05:37:37.433789+0000","last_fullsized":"2024-03-25T05:37:37.433789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:08:02.386273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805476+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T05:37:38.805476+0000","last_peered":"2024-03-25T05:37:38.805476+0000","last_clean":"2024-03-25T05:37:38.805476+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T05:37:38.805476+0000","last_undegraded":"2024-03-25T05:37:38.805476+0000","last_fullsized":"2024-03-25T05:37:38.805476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576355+0000","last_change":"2024-03-25T05:37:31.170943+0000","last_active":"2024-03-25T05:37:38.576355+0000","last_peered":"2024-03-25T05:37:38.576355+0000","last_clean":"2024-03-25T05:37:38.576355+0000","last_became_active":"2024-03-25T05:37:31.170199+0000","last_became_peered":"2024-03-25T05:37:31.170199+0000","last_unstale":"2024-03-25T05:37:38.576355+0000","last_undegraded":"2024-03-25T05:37:38.576355+0000","last_fullsized":"2024-03-25T05:37:38.576355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221825+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T05:37:38.221825+0000","last_peered":"2024-03-25T05:37:38.221825+0000","last_clean":"2024-03-25T05:37:38.221825+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T05:37:38.221825+0000","last_undegraded":"2024-03-25T05:37:38.221825+0000","last_fullsized":"2024-03-25T05:37:38.221825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585300+0000","last_change":"2024-03-25T05:37:31.164026+0000","last_active":"2024-03-25T05:37:38.585300+0000","last_peered":"2024-03-25T05:37:38.585300+0000","last_clean":"2024-03-25T05:37:38.585300+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T05:37:38.585300+0000","last_undegraded":"2024-03-25T05:37:38.585300+0000","last_fullsized":"2024-03-25T05:37:38.585300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433660+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T05:37:37.433660+0000","last_peered":"2024-03-25T05:37:37.433660+0000","last_clean":"2024-03-25T05:37:37.433660+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T05:37:37.433660+0000","last_undegraded":"2024-03-25T05:37:37.433660+0000","last_fullsized":"2024-03-25T05:37:37.433660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432470+0000","last_change":"2024-03-25T05:37:31.166178+0000","last_active":"2024-03-25T05:37:37.432470+0000","last_peered":"2024-03-25T05:37:37.432470+0000","last_clean":"2024-03-25T05:37:37.432470+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T05:37:37.432470+0000","last_undegraded":"2024-03-25T05:37:37.432470+0000","last_fullsized":"2024-03-25T05:37:37.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806144+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T05:37:38.806144+0000","last_peered":"2024-03-25T05:37:38.806144+0000","last_clean":"2024-03-25T05:37:38.806144+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T05:37:38.806144+0000","last_undegraded":"2024-03-25T05:37:38.806144+0000","last_fullsized":"2024-03-25T05:37:38.806144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433913+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T05:37:37.433913+0000","last_peered":"2024-03-25T05:37:37.433913+0000","last_clean":"2024-03-25T05:37:37.433913+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T05:37:37.433913+0000","last_undegraded":"2024-03-25T05:37:37.433913+0000","last_fullsized":"2024-03-25T05:37:37.433913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221686+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T05:37:38.221686+0000","last_peered":"2024-03-25T05:37:38.221686+0000","last_clean":"2024-03-25T05:37:38.221686+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T05:37:38.221686+0000","last_undegraded":"2024-03-25T05:37:38.221686+0000","last_fullsized":"2024-03-25T05:37:38.221686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431855+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T05:37:37.431855+0000","last_peered":"2024-03-25T05:37:37.431855+0000","last_clean":"2024-03-25T05:37:37.431855+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T05:37:37.431855+0000","last_undegraded":"2024-03-25T05:37:37.431855+0000","last_fullsized":"2024-03-25T05:37:37.431855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221685+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T05:37:38.221685+0000","last_peered":"2024-03-25T05:37:38.221685+0000","last_clean":"2024-03-25T05:37:38.221685+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T05:37:38.221685+0000","last_undegraded":"2024-03-25T05:37:38.221685+0000","last_fullsized":"2024-03-25T05:37:38.221685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585021+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T05:37:38.585021+0000","last_peered":"2024-03-25T05:37:38.585021+0000","last_clean":"2024-03-25T05:37:38.585021+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T05:37:38.585021+0000","last_undegraded":"2024-03-25T05:37:38.585021+0000","last_fullsized":"2024-03-25T05:37:38.585021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310003+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T05:37:38.310003+0000","last_peered":"2024-03-25T05:37:38.310003+0000","last_clean":"2024-03-25T05:37:38.310003+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T05:37:38.310003+0000","last_undegraded":"2024-03-25T05:37:38.310003+0000","last_fullsized":"2024-03-25T05:37:38.310003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.576738+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T05:37:38.576738+0000","last_peered":"2024-03-25T05:37:38.576738+0000","last_clean":"2024-03-25T05:37:38.576738+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T05:37:38.576738+0000","last_undegraded":"2024-03-25T05:37:38.576738+0000","last_fullsized":"2024-03-25T05:37:38.576738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222245+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T05:37:38.222245+0000","last_peered":"2024-03-25T05:37:38.222245+0000","last_clean":"2024-03-25T05:37:38.222245+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T05:37:38.222245+0000","last_undegraded":"2024-03-25T05:37:38.222245+0000","last_fullsized":"2024-03-25T05:37:38.222245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221566+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T05:37:38.221566+0000","last_peered":"2024-03-25T05:37:38.221566+0000","last_clean":"2024-03-25T05:37:38.221566+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T05:37:38.221566+0000","last_undegraded":"2024-03-25T05:37:38.221566+0000","last_fullsized":"2024-03-25T05:37:38.221566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431208+0000","last_change":"2024-03-25T05:37:31.160433+0000","last_active":"2024-03-25T05:37:37.431208+0000","last_peered":"2024-03-25T05:37:37.431208+0000","last_clean":"2024-03-25T05:37:37.431208+0000","last_became_active":"2024-03-25T05:37:31.159183+0000","last_became_peered":"2024-03-25T05:37:31.159183+0000","last_unstale":"2024-03-25T05:37:37.431208+0000","last_undegraded":"2024-03-25T05:37:37.431208+0000","last_fullsized":"2024-03-25T05:37:37.431208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585101+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T05:37:38.585101+0000","last_peered":"2024-03-25T05:37:38.585101+0000","last_clean":"2024-03-25T05:37:38.585101+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T05:37:38.585101+0000","last_undegraded":"2024-03-25T05:37:38.585101+0000","last_fullsized":"2024-03-25T05:37:38.585101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:20.495852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.433449+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T05:37:37.433449+0000","last_peered":"2024-03-25T05:37:37.433449+0000","last_clean":"2024-03-25T05:37:37.433449+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T05:37:37.433449+0000","last_undegraded":"2024-03-25T05:37:37.433449+0000","last_fullsized":"2024-03-25T05:37:37.433449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.432681+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T05:37:37.432681+0000","last_peered":"2024-03-25T05:37:37.432681+0000","last_clean":"2024-03-25T05:37:37.432681+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T05:37:37.432681+0000","last_undegraded":"2024-03-25T05:37:37.432681+0000","last_fullsized":"2024-03-25T05:37:37.432681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.805912+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T05:37:38.805912+0000","last_peered":"2024-03-25T05:37:38.805912+0000","last_clean":"2024-03-25T05:37:38.805912+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T05:37:38.805912+0000","last_undegraded":"2024-03-25T05:37:38.805912+0000","last_fullsized":"2024-03-25T05:37:38.805912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.806103+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T05:37:38.806103+0000","last_peered":"2024-03-25T05:37:38.806103+0000","last_clean":"2024-03-25T05:37:38.806103+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T05:37:38.806103+0000","last_undegraded":"2024-03-25T05:37:38.806103+0000","last_fullsized":"2024-03-25T05:37:38.806103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310166+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T05:37:38.310166+0000","last_peered":"2024-03-25T05:37:38.310166+0000","last_clean":"2024-03-25T05:37:38.310166+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T05:37:38.310166+0000","last_undegraded":"2024-03-25T05:37:38.310166+0000","last_fullsized":"2024-03-25T05:37:38.310166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.431511+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T05:37:37.431511+0000","last_peered":"2024-03-25T05:37:37.431511+0000","last_clean":"2024-03-25T05:37:37.431511+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T05:37:37.431511+0000","last_undegraded":"2024-03-25T05:37:37.431511+0000","last_fullsized":"2024-03-25T05:37:37.431511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309508+0000","last_change":"2024-03-25T05:37:31.164888+0000","last_active":"2024-03-25T05:37:38.309508+0000","last_peered":"2024-03-25T05:37:38.309508+0000","last_clean":"2024-03-25T05:37:38.309508+0000","last_became_active":"2024-03-25T05:37:31.164658+0000","last_became_peered":"2024-03-25T05:37:31.164658+0000","last_unstale":"2024-03-25T05:37:38.309508+0000","last_undegraded":"2024-03-25T05:37:38.309508+0000","last_fullsized":"2024-03-25T05:37:38.309508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.221663+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T05:37:38.221663+0000","last_peered":"2024-03-25T05:37:38.221663+0000","last_clean":"2024-03-25T05:37:38.221663+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T05:37:38.221663+0000","last_undegraded":"2024-03-25T05:37:38.221663+0000","last_fullsized":"2024-03-25T05:37:38.221663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.309565+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T05:37:38.309565+0000","last_peered":"2024-03-25T05:37:38.309565+0000","last_clean":"2024-03-25T05:37:38.309565+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T05:37:38.309565+0000","last_undegraded":"2024-03-25T05:37:38.309565+0000","last_fullsized":"2024-03-25T05:37:38.309565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.222105+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T05:37:38.222105+0000","last_peered":"2024-03-25T05:37:38.222105+0000","last_clean":"2024-03-25T05:37:38.222105+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T05:37:38.222105+0000","last_undegraded":"2024-03-25T05:37:38.222105+0000","last_fullsized":"2024-03-25T05:37:38.222105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.585511+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T05:37:38.585511+0000","last_peered":"2024-03-25T05:37:38.585511+0000","last_clean":"2024-03-25T05:37:38.585511+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T05:37:38.585511+0000","last_undegraded":"2024-03-25T05:37:38.585511+0000","last_fullsized":"2024-03-25T05:37:38.585511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:37.435035+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T05:37:37.435035+0000","last_peered":"2024-03-25T05:37:37.435035+0000","last_clean":"2024-03-25T05:37:37.435035+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T05:37:37.435035+0000","last_undegraded":"2024-03-25T05:37:37.435035+0000","last_fullsized":"2024-03-25T05:37:37.435035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-25T05:37:38.310094+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T05:37:38.310094+0000","last_peered":"2024-03-25T05:37:38.310094+0000","last_clean":"2024-03-25T05:37:38.310094+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T05:37:38.310094+0000","last_undegraded":"2024-03-25T05:37:38.310094+0000","last_fullsized":"2024-03-25T05:37:38.310094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":699861,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":112025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":111325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":108723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":112059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":108855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":108925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":698635,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T05:38:03.365 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-25T05:38:03.365 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-25T05:38:03.365 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-25T05:38:03.365 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-25T05:38:03.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.591+0000 7f4f22a00640 1 Processor -- start 2024-03-25T05:38:03.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.591+0000 7f4f22a00640 1 -- start start 2024-03-25T05:38:03.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.592+0000 7f4f22a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f1c0c9e00 0x7f4f1c06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.592+0000 7f4f22a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c0ca240 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.592+0000 7f4f22a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c154290 con 0x7f4f1c153eb0 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.592+0000 7f4f22a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c0c5720 con 0x7f4f1c0c9e00 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f21600640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4f1c153eb0 0x7f4f1c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40458/0 (socket says 172.21.15.102:40458) 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f21600640 1 -- 172.21.15.102:0/2912899629 learned_addr learned my addr 172.21.15.102:0/2912899629 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f20c00640 1 --2- 172.21.15.102:0/2912899629 >> v2:172.21.15.102:3300/0 conn(0x7f4f1c0c9e00 0x7f4f1c06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541907687 0 0) 0x7f4f1c154290 con 0x7f4f1c153eb0 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f04003520 con 0x7f4f1c153eb0 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242799414 0 0) 0x7f4f14001490 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f1c154290 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.594+0000 7f4f20c00640 1 -- 172.21.15.102:0/2912899629 >> v1:172.21.15.187:6789/0 conn(0x7f4f1c153eb0 legacy=0x7f4f1c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.593+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449929572 0 0) 0x7f4f04003520 con 0x7f4f1c153eb0 2024-03-25T05:38:03.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.594+0000 7f4f20c00640 1 -- 172.21.15.102:0/2912899629 >> v1:172.21.15.102:6789/0 conn(0x7f4f1c06c1e0 legacy=0x7f4f1c0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.594+0000 7f4f20c00640 1 -- 172.21.15.102:0/2912899629 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c0c43a0 con 0x7f4f1c0c9e00 2024-03-25T05:38:03.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.595+0000 7f4f20c00640 1 --2- 172.21.15.102:0/2912899629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c0c9e00 0x7f4f1c06bca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009720 tx=0x7f4f0802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a12487d8467c13 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:03.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.595+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10001670 con 0x7f4f1c0c9e00 2024-03-25T05:38:03.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.595+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08031520 con 0x7f4f1c0c9e00 2024-03-25T05:38:03.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.595+0000 7f4f1be00640 1 -- 172.21.15.102:0/2912899629 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08031690 con 0x7f4f1c0c9e00 2024-03-25T05:38:03.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.595+0000 7f4f22a00640 1 -- 172.21.15.102:0/2912899629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c0c9e00 msgr2=0x7f4f1c06bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.595+0000 7f4f22a00640 1 --2- 172.21.15.102:0/2912899629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c0c9e00 0x7f4f1c06bca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009720 tx=0x7f4f0802b7c0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.596+0000 7f4f22a00640 1 -- 172.21.15.102:0/2912899629 shutdown_connections 2024-03-25T05:38:03.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.596+0000 7f4f22a00640 1 --2- 172.21.15.102:0/2912899629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c0c9e00 0x7f4f1c06bca0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.596+0000 7f4f22a00640 1 -- 172.21.15.102:0/2912899629 >> 172.21.15.102:0/2912899629 conn(0x7f4f1c06d890 msgr2=0x7f4f1c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:03.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.596+0000 7f4f22a00640 1 -- 172.21.15.102:0/2912899629 shutdown_connections 2024-03-25T05:38:03.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.596+0000 7f4f22a00640 1 -- 172.21.15.102:0/2912899629 wait complete. 2024-03-25T05:38:03.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.597+0000 7f4f22a00640 1 Processor -- start 2024-03-25T05:38:03.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.597+0000 7f4f22a00640 1 -- start start 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.598+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f1c06c1e0 0x7f4f1c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.598+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f1c0c9e00 0x7f4f1c14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.598+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c153eb0 0x7f4f1c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.598+0000 7f4f22a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c150750 con 0x7f4f1c153eb0 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.598+0000 7f4f22a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c1ef980 con 0x7f4f1c0c9e00 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.598+0000 7f4f22a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0cbef0 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f1c06c1e0 0x7f4f1c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f1c06c1e0 0x7f4f1c14b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53274/0 (socket says 172.21.15.102:53274) 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 -- 172.21.15.102:0/244519464 learned_addr learned my addr 172.21.15.102:0/244519464 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f20c00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f1c0c9e00 0x7f4f1c14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f22000640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c153eb0 0x7f4f1c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 -- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f1c0c9e00 msgr2=0x7f4f1c14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f1c0c9e00 0x7f4f1c14f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 -- 172.21.15.102:0/244519464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c153eb0 msgr2=0x7f4f1c1597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c153eb0 0x7f4f1c1597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.599+0000 7f4f21600640 1 -- 172.21.15.102:0/244519464 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08009400 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.600+0000 7f4f21600640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f1c06c1e0 0x7f4f1c14b230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000c780 tx=0x7f4f1000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:03.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.600+0000 7f4f19600640 1 -- 172.21.15.102:0/244519464 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100072d0 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.600+0000 7f4f19600640 1 -- 172.21.15.102:0/244519464 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10007450 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.600+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c0cc1b0 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.600+0000 7f4f19600640 1 -- 172.21.15.102:0/244519464 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100047e0 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.600+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c0cc770 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.601+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c06d080 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.602+0000 7f4f19600640 1 -- 172.21.15.102:0/244519464 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f10004960 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.603+0000 7f4f19600640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4efc06b810 0x7f4efc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:03.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.603+0000 7f4f19600640 1 -- 172.21.15.102:0/244519464 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4f1008a240 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.603+0000 7f4f20c00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4efc06b810 0x7f4efc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:03.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.604+0000 7f4f20c00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4efc06b810 0x7f4efc06dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f08035000 tx=0x7f4f08030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.610+0000 7f4f19600640 1 -- 172.21.15.102:0/244519464 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4f10054b40 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.880+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4f1c04f2f0 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.881+0000 7f4f19600640 1 -- 172.21.15.102:0/244519464 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4f10058200 con 0x7f4f1c06c1e0 2024-03-25T05:38:03.874 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:03.875 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4efc06b810 msgr2=0x7f4efc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4efc06b810 0x7f4efc06dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f08035000 tx=0x7f4f08030000 comp rx=0 tx=0).stop 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f1c06c1e0 msgr2=0x7f4f1c14b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f1c06c1e0 0x7f4f1c14b230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000c780 tx=0x7f4f1000cc40 comp rx=0 tx=0).stop 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 shutdown_connections 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4efc06b810 0x7f4efc06dcd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1c153eb0 0x7f4f1c1597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f1c0c9e00 0x7f4f1c14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 --2- 172.21.15.102:0/244519464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f1c06c1e0 0x7f4f1c14b230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.883+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 >> 172.21.15.102:0/244519464 conn(0x7f4f1c06d890 msgr2=0x7f4f1c1515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.884+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 shutdown_connections 2024-03-25T05:38:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:03.884+0000 7f4f22a00640 1 -- 172.21.15.102:0/244519464 wait complete. 2024-03-25T05:38:03.900 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-25T05:38:03.900 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:38:04.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.089+0000 7f2b7f200640 1 Processor -- start 2024-03-25T05:38:04.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.089+0000 7f2b7f200640 1 -- start start 2024-03-25T05:38:04.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.090+0000 7f2b7f200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2b80070de0 0x7f2b80163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.090+0000 7f2b7f200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b800724e0 con 0x7f2b8014e3d0 2024-03-25T05:38:04.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.090+0000 7f2b7f200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b80071250 con 0x7f2b800c5d40 2024-03-25T05:38:04.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.090+0000 7f2b7f200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b80072970 con 0x7f2b80070de0 2024-03-25T05:38:04.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7de00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2b8014e3d0 0x7f2b8015afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50324/0 (socket says 172.21.15.102:50324) 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7e800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2b80070de0 0x7f2b80163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7de00640 1 -- 172.21.15.102:0/3900029841 learned_addr learned my addr 172.21.15.102:0/3900029841 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7d400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f2b800c5d40 0x7f2b800c4a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40466/0 (socket says 172.21.15.102:40466) 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7ca00640 1 -- 172.21.15.102:0/3900029841 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214010387 0 0) 0x7f2b80071250 con 0x7f2b800c5d40 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7ca00640 1 -- 172.21.15.102:0/3900029841 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b64003520 con 0x7f2b800c5d40 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7e800640 1 -- 172.21.15.102:0/3900029841 >> v1:172.21.15.187:6789/0 conn(0x7f2b800c5d40 legacy=0x7f2b800c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7e800640 1 -- 172.21.15.102:0/3900029841 >> v1:172.21.15.102:6789/0 conn(0x7f2b8014e3d0 legacy=0x7f2b8015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.091+0000 7f2b7e800640 1 -- 172.21.15.102:0/3900029841 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800c6250 con 0x7f2b80070de0 2024-03-25T05:38:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.093+0000 7f2b7e800640 1 --2- 172.21.15.102:0/3900029841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b80163340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009d90 tx=0x7f2b7802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a6cda07570e5a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.093+0000 7f2b7ca00640 1 -- 172.21.15.102:0/3900029841 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7802cd80 con 0x7f2b80070de0 2024-03-25T05:38:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.093+0000 7f2b7ca00640 1 -- 172.21.15.102:0/3900029841 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78034440 con 0x7f2b80070de0 2024-03-25T05:38:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.093+0000 7f2b7ca00640 1 -- 172.21.15.102:0/3900029841 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780347d0 con 0x7f2b80070de0 2024-03-25T05:38:04.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.094+0000 7f2b7f200640 1 -- 172.21.15.102:0/3900029841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 msgr2=0x7f2b80163340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.094+0000 7f2b7f200640 1 --2- 172.21.15.102:0/3900029841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b80163340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009d90 tx=0x7f2b7802bfd0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.094+0000 7f2b7f200640 1 -- 172.21.15.102:0/3900029841 shutdown_connections 2024-03-25T05:38:04.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.094+0000 7f2b7f200640 1 --2- 172.21.15.102:0/3900029841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b80163340 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.094+0000 7f2b7f200640 1 -- 172.21.15.102:0/3900029841 >> 172.21.15.102:0/3900029841 conn(0x7f2b800cb340 msgr2=0x7f2b800cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:04.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.094+0000 7f2b7f200640 1 -- 172.21.15.102:0/3900029841 shutdown_connections 2024-03-25T05:38:04.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.094+0000 7f2b7f200640 1 -- 172.21.15.102:0/3900029841 wait complete. 2024-03-25T05:38:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.097+0000 7f2b7f200640 1 Processor -- start 2024-03-25T05:38:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.097+0000 7f2b7f200640 1 -- start start 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b800c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7f200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b800c5d40 0x7f2b8014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b8014e3d0 0x7f2b80150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7f200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b801f3b60 con 0x7f2b800c5d40 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8014fa30 con 0x7f2b80070de0 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b801f3000 con 0x7f2b8014e3d0 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b800c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b800c3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35556/0 (socket says 172.21.15.102:35556) 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.098+0000 7f2b7de00640 1 -- 172.21.15.102:0/670515785 learned_addr learned my addr 172.21.15.102:0/670515785 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.099+0000 7f2b7e800640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b8014e3d0 0x7f2b80150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.099+0000 7f2b7d400640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b800c5d40 0x7f2b8014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.099+0000 7f2b7e800640 1 -- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 msgr2=0x7f2b800c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.099+0000 7f2b7e800640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b800c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.099+0000 7f2b7e800640 1 -- 172.21.15.102:0/670515785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b800c5d40 msgr2=0x7f2b8014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.099+0000 7f2b7e800640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b800c5d40 0x7f2b8014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.099+0000 7f2b7e800640 1 -- 172.21.15.102:0/670515785 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78009a70 con 0x7f2b8014e3d0 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.100+0000 7f2b7de00640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b800c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.100+0000 7f2b7e800640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b8014e3d0 0x7f2b80150400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b78033000 tx=0x7f2b78004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.100+0000 7f2b76000640 1 -- 172.21.15.102:0/670515785 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78009490 con 0x7f2b8014e3d0 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.100+0000 7f2b76000640 1 -- 172.21.15.102:0/670515785 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78040650 con 0x7f2b8014e3d0 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.100+0000 7f2b76000640 1 -- 172.21.15.102:0/670515785 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78040a00 con 0x7f2b8014e3d0 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.100+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b801f32c0 con 0x7f2b8014e3d0 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.100+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b801f3880 con 0x7f2b8014e3d0 2024-03-25T05:38:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.101+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8014fba0 con 0x7f2b8014e3d0 2024-03-25T05:38:04.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.103+0000 7f2b76000640 1 -- 172.21.15.102:0/670515785 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b78040b60 con 0x7f2b8014e3d0 2024-03-25T05:38:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.104+0000 7f2b76000640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2b6006b810 0x7f2b6006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.104+0000 7f2b76000640 1 -- 172.21.15.102:0/670515785 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2b780ad940 con 0x7f2b8014e3d0 2024-03-25T05:38:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.105+0000 7f2b7de00640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2b6006b810 0x7f2b6006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.105+0000 7f2b7de00640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2b6006b810 0x7f2b6006dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b70004e60 tx=0x7f2b70007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.109+0000 7f2b76000640 1 -- 172.21.15.102:0/670515785 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2b78078240 con 0x7f2b8014e3d0 2024-03-25T05:38:04.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.304+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b8014f800 con 0x7f2b8014e3d0 2024-03-25T05:38:04.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.306+0000 7f2b76000640 1 -- 172.21.15.102:0/670515785 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f2b7807b900 con 0x7f2b8014e3d0 2024-03-25T05:38:04.299 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:04.299 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2b6006b810 msgr2=0x7f2b6006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2b6006b810 0x7f2b6006dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b70004e60 tx=0x7f2b70007f10 comp rx=0 tx=0).stop 2024-03-25T05:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b8014e3d0 msgr2=0x7f2b80150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b8014e3d0 0x7f2b80150400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b78033000 tx=0x7f2b78004a40 comp rx=0 tx=0).stop 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 shutdown_connections 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f2b6006b810 0x7f2b6006dcd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b8014e3d0 0x7f2b80150400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b800c5d40 0x7f2b8014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 --2- 172.21.15.102:0/670515785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b80070de0 0x7f2b800c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 >> 172.21.15.102:0/670515785 conn(0x7f2b800cb340 msgr2=0x7f2b80149390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 shutdown_connections 2024-03-25T05:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.308+0000 7f2b7f200640 1 -- 172.21.15.102:0/670515785 wait complete. 2024-03-25T05:38:04.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T05:37:25.079908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-25T05:37:29.008596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-25T05:37:29.891587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-25T05:37:33.466049+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-25T05:38:04.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-25T05:38:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.504+0000 7f0f66e00640 1 Processor -- start 2024-03-25T05:38:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.504+0000 7f0f66e00640 1 -- start start 2024-03-25T05:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.505+0000 7f0f66e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.505+0000 7f0f66e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f60070780 con 0x7f0f60071d90 2024-03-25T05:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f66e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600c6ad0 con 0x7f0f60151be0 2024-03-25T05:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f66e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60070360 con 0x7f0f600c97a0 2024-03-25T05:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f65a00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0f60151be0 0x7f0f60157850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40482/0 (socket says 172.21.15.102:40482) 2024-03-25T05:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f65a00640 1 -- 172.21.15.102:0/2976499111 learned_addr learned my addr 172.21.15.102:0/2976499111 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f66400640 1 --2- 172.21.15.102:0/2976499111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f5fe00640 1 -- 172.21.15.102:0/2976499111 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332393424 0 0) 0x7f0f600c6ad0 con 0x7f0f60151be0 2024-03-25T05:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f5fe00640 1 -- 172.21.15.102:0/2976499111 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f48003520 con 0x7f0f60151be0 2024-03-25T05:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f66400640 1 -- 172.21.15.102:0/2976499111 >> v1:172.21.15.187:6789/0 conn(0x7f0f60151be0 legacy=0x7f0f60157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f66400640 1 -- 172.21.15.102:0/2976499111 >> v1:172.21.15.102:6789/0 conn(0x7f0f60071d90 legacy=0x7f0f600c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.506+0000 7f0f66400640 1 -- 172.21.15.102:0/2976499111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600c6d70 con 0x7f0f600c97a0 2024-03-25T05:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.508+0000 7f0f66400640 1 --2- 172.21.15.102:0/2976499111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601631e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009dc0 tx=0x7f0f5802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67eb95f317d66415 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.508+0000 7f0f5fe00640 1 -- 172.21.15.102:0/2976499111 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5802cce0 con 0x7f0f600c97a0 2024-03-25T05:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.508+0000 7f0f5fe00640 1 -- 172.21.15.102:0/2976499111 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5802ce40 con 0x7f0f600c97a0 2024-03-25T05:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.508+0000 7f0f5fe00640 1 -- 172.21.15.102:0/2976499111 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58034660 con 0x7f0f600c97a0 2024-03-25T05:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.508+0000 7f0f66e00640 1 -- 172.21.15.102:0/2976499111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 msgr2=0x7f0f601631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.508+0000 7f0f66e00640 1 --2- 172.21.15.102:0/2976499111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601631e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009dc0 tx=0x7f0f5802bf30 comp rx=0 tx=0).stop 2024-03-25T05:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.509+0000 7f0f66e00640 1 -- 172.21.15.102:0/2976499111 shutdown_connections 2024-03-25T05:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.509+0000 7f0f66e00640 1 --2- 172.21.15.102:0/2976499111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601631e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.509+0000 7f0f66e00640 1 -- 172.21.15.102:0/2976499111 >> 172.21.15.102:0/2976499111 conn(0x7f0f600c8bd0 msgr2=0x7f0f600c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.509+0000 7f0f66e00640 1 -- 172.21.15.102:0/2976499111 shutdown_connections 2024-03-25T05:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.509+0000 7f0f66e00640 1 -- 172.21.15.102:0/2976499111 wait complete. 2024-03-25T05:38:04.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.510+0000 7f0f66e00640 1 Processor -- start 2024-03-25T05:38:04.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.510+0000 7f0f66e00640 1 -- start start 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.511+0000 7f0f66e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f60071d90 0x7f0f60154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.511+0000 7f0f66e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.511+0000 7f0f66e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f60151be0 0x7f0f60155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.511+0000 7f0f66e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f601429b0 con 0x7f0f60071d90 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.511+0000 7f0f66e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60156500 con 0x7f0f60151be0 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.511+0000 7f0f66e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f601423f0 con 0x7f0f600c97a0 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f60151be0 0x7f0f60155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f65000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f60151be0 0x7f0f60155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35570/0 (socket says 172.21.15.102:35570) 2024-03-25T05:38:04.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 -- 172.21.15.102:0/3105916635 learned_addr learned my addr 172.21.15.102:0/3105916635 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:04.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f65a00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f60071d90 0x7f0f60154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 -- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 msgr2=0x7f0f601f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 -- 172.21.15.102:0/3105916635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f60071d90 msgr2=0x7f0f60154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f60071d90 0x7f0f60154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 -- 172.21.15.102:0/3105916635 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009a70 con 0x7f0f60151be0 2024-03-25T05:38:04.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f65a00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f60071d90 0x7f0f60154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.512+0000 7f0f66400640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f60151be0 0x7f0f60155fc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009ee0 tx=0x7f0f58004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.513+0000 7f0f5d600640 1 -- 172.21.15.102:0/3105916635 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5803d600 con 0x7f0f60151be0 2024-03-25T05:38:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.513+0000 7f0f5d600640 1 -- 172.21.15.102:0/3105916635 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5803d780 con 0x7f0f60151be0 2024-03-25T05:38:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.513+0000 7f0f5d600640 1 -- 172.21.15.102:0/3105916635 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5803db30 con 0x7f0f60151be0 2024-03-25T05:38:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.513+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f601426d0 con 0x7f0f60151be0 2024-03-25T05:38:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.513+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f601ef920 con 0x7f0f60151be0 2024-03-25T05:38:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.514+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f601ef4a0 con 0x7f0f60151be0 2024-03-25T05:38:04.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.516+0000 7f0f5d600640 1 -- 172.21.15.102:0/3105916635 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0f5803b040 con 0x7f0f60151be0 2024-03-25T05:38:04.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.517+0000 7f0f5d600640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0f4006b810 0x7f0f4006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.517+0000 7f0f5d600640 1 -- 172.21.15.102:0/3105916635 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0f580ad2d0 con 0x7f0f60151be0 2024-03-25T05:38:04.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.518+0000 7f0f65a00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0f4006b810 0x7f0f4006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.518+0000 7f0f65a00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0f4006b810 0x7f0f4006dcd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f540011e0 tx=0x7f0f54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.520+0000 7f0f5d600640 1 -- 172.21.15.102:0/3105916635 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0f58077a40 con 0x7f0f60151be0 2024-03-25T05:38:04.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.730+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f60157f40 con 0x7f0f60151be0 2024-03-25T05:38:04.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.731+0000 7f0f5d600640 1 -- 172.21.15.102:0/3105916635 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f5804e020 con 0x7f0f60151be0 2024-03-25T05:38:04.724 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-03-25T05:38:04.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0f4006b810 msgr2=0x7f0f4006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0f4006b810 0x7f0f4006dcd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f540011e0 tx=0x7f0f54009040 comp rx=0 tx=0).stop 2024-03-25T05:38:04.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f60151be0 msgr2=0x7f0f60155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f60151be0 0x7f0f60155fc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009ee0 tx=0x7f0f58004a40 comp rx=0 tx=0).stop 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 shutdown_connections 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0f4006b810 0x7f0f4006dcd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f60151be0 0x7f0f60155fc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f600c97a0 0x7f0f601f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 --2- 172.21.15.102:0/3105916635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f60071d90 0x7f0f60154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 >> 172.21.15.102:0/3105916635 conn(0x7f0f600c8bd0 msgr2=0x7f0f60150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 shutdown_connections 2024-03-25T05:38:04.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.733+0000 7f0f66e00640 1 -- 172.21.15.102:0/3105916635 wait complete. 2024-03-25T05:38:04.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-25T05:38:04.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.942+0000 7fae7de00640 1 Processor -- start 2024-03-25T05:38:04.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.943+0000 7fae7de00640 1 -- start start 2024-03-25T05:38:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7de00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae78154260 0x7fae780cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7de00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae780cb620 0x7fae780c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7de00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae780c8220 con 0x7fae78153e80 2024-03-25T05:38:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7de00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780c8500 con 0x7fae78154260 2024-03-25T05:38:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7de00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780ca320 con 0x7fae780cb620 2024-03-25T05:38:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7d400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae780cb620 0x7fae780c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae6fe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae78154260 0x7fae780cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7d400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae780cb620 0x7fae780c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35580/0 (socket says 172.21.15.102:35580) 2024-03-25T05:38:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.944+0000 7fae7d400640 1 -- 172.21.15.102:0/609167199 learned_addr learned my addr 172.21.15.102:0/609167199 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.945+0000 7fae7d400640 1 -- 172.21.15.102:0/609167199 >> v2:172.21.15.102:3300/0 conn(0x7fae78154260 msgr2=0x7fae780cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.945+0000 7fae7d400640 1 --2- 172.21.15.102:0/609167199 >> v2:172.21.15.102:3300/0 conn(0x7fae78154260 0x7fae780cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.945+0000 7fae7d400640 1 -- 172.21.15.102:0/609167199 >> v1:172.21.15.102:6789/0 conn(0x7fae78153e80 legacy=0x7fae780c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.945+0000 7fae77e00640 1 -- 172.21.15.102:0/609167199 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757767370 0 0) 0x7fae780c8220 con 0x7fae78153e80 2024-03-25T05:38:04.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.945+0000 7fae7d400640 1 -- 172.21.15.102:0/609167199 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780ca600 con 0x7fae780cb620 2024-03-25T05:38:04.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.945+0000 7fae6fe00640 1 --2- 172.21.15.102:0/609167199 >> v2:172.21.15.102:3300/0 conn(0x7fae78154260 0x7fae780cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.946+0000 7fae7d400640 1 --2- 172.21.15.102:0/609167199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae780c7460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae780cbda0 tx=0x7fae7002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=772ce4076bab8328 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.946+0000 7fae77e00640 1 -- 172.21.15.102:0/609167199 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7002cbb0 con 0x7fae780cb620 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.946+0000 7fae77e00640 1 -- 172.21.15.102:0/609167199 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7002cd10 con 0x7fae780cb620 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.946+0000 7fae77e00640 1 -- 172.21.15.102:0/609167199 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70034610 con 0x7fae780cb620 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 -- 172.21.15.102:0/609167199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 msgr2=0x7fae780c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 --2- 172.21.15.102:0/609167199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae780c7460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae780cbda0 tx=0x7fae7002c010 comp rx=0 tx=0).stop 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 -- 172.21.15.102:0/609167199 shutdown_connections 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 --2- 172.21.15.102:0/609167199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae780c7460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 --2- 172.21.15.102:0/609167199 >> v2:172.21.15.102:3300/0 conn(0x7fae78154260 0x7fae780cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 -- 172.21.15.102:0/609167199 >> 172.21.15.102:0/609167199 conn(0x7fae780cf370 msgr2=0x7fae780cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 -- 172.21.15.102:0/609167199 shutdown_connections 2024-03-25T05:38:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.947+0000 7fae7de00640 1 -- 172.21.15.102:0/609167199 wait complete. 2024-03-25T05:38:04.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.948+0000 7fae7de00640 1 Processor -- start 2024-03-25T05:38:04.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.949+0000 7fae7de00640 1 -- start start 2024-03-25T05:38:04.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.949+0000 7fae7de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae781f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.949+0000 7fae7de00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae78153e80 0x7fae781f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.949+0000 7fae7de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7815c890 0x7fae7815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.949+0000 7fae7de00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7815b000 con 0x7fae78153e80 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.949+0000 7fae7de00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c5d50 con 0x7fae780cb620 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.949+0000 7fae7de00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c6030 con 0x7fae7815c890 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae78153e80 0x7fae781f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae78153e80 0x7fae781f0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60276/0 (socket says 172.21.15.102:60276) 2024-03-25T05:38:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 -- 172.21.15.102:0/295083564 learned_addr learned my addr 172.21.15.102:0/295083564 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae7ca00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae781f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 -- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7815c890 msgr2=0x7fae7815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae7d400640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7815c890 0x7fae7815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7815c890 0x7fae7815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 -- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 msgr2=0x7fae781f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae781f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae6fe00640 1 -- 172.21.15.102:0/295083564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009400 con 0x7fae78153e80 2024-03-25T05:38:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.950+0000 7fae7ca00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae781f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.951+0000 7fae6fe00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae78153e80 0x7fae781f0240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fae6000e900 tx=0x7fae6000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.951+0000 7fae75600640 1 -- 172.21.15.102:0/295083564 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60009660 con 0x7fae78153e80 2024-03-25T05:38:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.951+0000 7fae75600640 1 -- 172.21.15.102:0/295083564 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000ca00 con 0x7fae78153e80 2024-03-25T05:38:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.951+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae70009b30 con 0x7fae78153e80 2024-03-25T05:38:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.951+0000 7fae75600640 1 -- 172.21.15.102:0/295083564 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000cdb0 con 0x7fae78153e80 2024-03-25T05:38:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.952+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae781efd20 con 0x7fae78153e80 2024-03-25T05:38:04.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.953+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae781eff40 con 0x7fae78153e80 2024-03-25T05:38:04.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.954+0000 7fae75600640 1 -- 172.21.15.102:0/295083564 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae60013470 con 0x7fae78153e80 2024-03-25T05:38:04.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.954+0000 7fae75600640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fae5406b840 0x7fae5406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:04.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.955+0000 7fae75600640 1 -- 172.21.15.102:0/295083564 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fae6008a3d0 con 0x7fae78153e80 2024-03-25T05:38:04.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.955+0000 7fae7ca00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fae5406b840 0x7fae5406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:04.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.956+0000 7fae7ca00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fae5406b840 0x7fae5406dd00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae68000f60 tx=0x7fae68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:04.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:04.963+0000 7fae75600640 1 -- 172.21.15.102:0/295083564 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fae60054a30 con 0x7fae78153e80 2024-03-25T05:38:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.152+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae7804f2f0 con 0x7fae78153e80 2024-03-25T05:38:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.152+0000 7fae75600640 1 -- 172.21.15.102:0/295083564 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae600580f0 con 0x7fae78153e80 2024-03-25T05:38:05.145 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.154+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fae5406b840 msgr2=0x7fae5406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.154+0000 7fae7de00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fae5406b840 0x7fae5406dd00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae68000f60 tx=0x7fae68009040 comp rx=0 tx=0).stop 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.154+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae78153e80 msgr2=0x7fae781f0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.154+0000 7fae7de00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae78153e80 0x7fae781f0240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fae6000e900 tx=0x7fae6000edc0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.154+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 shutdown_connections 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.154+0000 7fae7de00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fae5406b840 0x7fae5406dd00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.154+0000 7fae7de00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7815c890 0x7fae7815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.155+0000 7fae7de00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae78153e80 0x7fae781f0240 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.155+0000 7fae7de00640 1 --2- 172.21.15.102:0/295083564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae780cb620 0x7fae781f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.155+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 >> 172.21.15.102:0/295083564 conn(0x7fae780cf370 msgr2=0x7fae78150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.155+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 shutdown_connections 2024-03-25T05:38:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.155+0000 7fae7de00640 1 -- 172.21.15.102:0/295083564 wait complete. 2024-03-25T05:38:05.163 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-25T05:38:05.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.341+0000 7f1eb5600640 1 Processor -- start 2024-03-25T05:38:05.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.341+0000 7f1eb5600640 1 -- start start 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.342+0000 7f1eb5600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1eb0153e80 0x7f1eb00c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.342+0000 7f1eb5600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1eb0154260 0x7f1eb00c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.342+0000 7f1eb5600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb00c8220 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.342+0000 7f1eb5600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00c8500 con 0x7f1eb0154260 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.342+0000 7f1eb5600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00ca320 con 0x7f1eb0153e80 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eafe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1eb0153e80 0x7f1eb00c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eafe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1eb0153e80 0x7f1eb00c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35604/0 (socket says 172.21.15.102:35604) 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eafe00640 1 -- 172.21.15.102:0/2528241171 learned_addr learned my addr 172.21.15.102:0/2528241171 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:05.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eaf400640 1 --2- 172.21.15.102:0/2528241171 >> v2:172.21.15.102:3300/0 conn(0x7f1eb0154260 0x7f1eb00c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eafe00640 1 -- 172.21.15.102:0/2528241171 >> v2:172.21.15.102:3300/0 conn(0x7f1eb0154260 msgr2=0x7f1eb00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:05.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eafe00640 1 --2- 172.21.15.102:0/2528241171 >> v2:172.21.15.102:3300/0 conn(0x7f1eb0154260 0x7f1eb00c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eafe00640 1 -- 172.21.15.102:0/2528241171 >> v1:172.21.15.102:6789/0 conn(0x7f1eb00cb0e0 legacy=0x7f1eb00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.343+0000 7f1eafe00640 1 -- 172.21.15.102:0/2528241171 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00ca600 con 0x7f1eb0153e80 2024-03-25T05:38:05.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.344+0000 7f1eafe00640 1 --2- 172.21.15.102:0/2528241171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb0153e80 0x7f1eb00c6770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1eb008cab0 tx=0x7f1ea002ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a84fa457682a7ea server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.344+0000 7f1eaea00640 1 -- 172.21.15.102:0/2528241171 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea002f860 con 0x7f1eb0153e80 2024-03-25T05:38:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.344+0000 7f1eaea00640 1 -- 172.21.15.102:0/2528241171 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea002f9c0 con 0x7f1eb0153e80 2024-03-25T05:38:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.344+0000 7f1eaea00640 1 -- 172.21.15.102:0/2528241171 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea002fd50 con 0x7f1eb0153e80 2024-03-25T05:38:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 -- 172.21.15.102:0/2528241171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb0153e80 msgr2=0x7f1eb00c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 --2- 172.21.15.102:0/2528241171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb0153e80 0x7f1eb00c6770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1eb008cab0 tx=0x7f1ea002ba40 comp rx=0 tx=0).stop 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 -- 172.21.15.102:0/2528241171 shutdown_connections 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 --2- 172.21.15.102:0/2528241171 >> v2:172.21.15.102:3300/0 conn(0x7f1eb0154260 0x7f1eb00c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 --2- 172.21.15.102:0/2528241171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb0153e80 0x7f1eb00c6770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 -- 172.21.15.102:0/2528241171 >> 172.21.15.102:0/2528241171 conn(0x7f1eb00cf370 msgr2=0x7f1eb00cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 -- 172.21.15.102:0/2528241171 shutdown_connections 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.345+0000 7f1eb5600640 1 -- 172.21.15.102:0/2528241171 wait complete. 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.347+0000 7f1eb5600640 1 Processor -- start 2024-03-25T05:38:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.347+0000 7f1eb5600640 1 -- start start 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eb5600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb00cb0e0 0x7f1eb015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eb5600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1eb0153e80 0x7f1eb00ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eb5600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1eb0157200 0x7f1eb01efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eb5600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb01f3df0 con 0x7f1eb0153e80 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eb5600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb01f2f40 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eb5600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb01f31e0 con 0x7f1eb0157200 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb00cb0e0 0x7f1eb015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eaf400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1eb0153e80 0x7f1eb00ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb00cb0e0 0x7f1eb015a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35608/0 (socket says 172.21.15.102:35608) 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 -- 172.21.15.102:0/1240776990 learned_addr learned my addr 172.21.15.102:0/1240776990 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eb4c00640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1eb0157200 0x7f1eb01efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 -- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1eb0157200 msgr2=0x7f1eb01efc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1eb0157200 0x7f1eb01efc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 -- 172.21.15.102:0/1240776990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1eb0153e80 msgr2=0x7f1eb00ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1eb0153e80 0x7f1eb00ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.348+0000 7f1eafe00640 1 -- 172.21.15.102:0/1240776990 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea00094d0 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.349+0000 7f1eafe00640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb00cb0e0 0x7f1eb015a7f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ea002ba80 tx=0x7f1ea0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.349+0000 7f1ea7e00640 1 -- 172.21.15.102:0/1240776990 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0037d10 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.349+0000 7f1ea7e00640 1 -- 172.21.15.102:0/1240776990 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0037e90 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.349+0000 7f1ea7e00640 1 -- 172.21.15.102:0/1240776990 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0041640 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.349+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb01f34c0 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.349+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb01f3a80 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.350+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb01f3c10 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.351+0000 7f1ea7e00640 1 -- 172.21.15.102:0/1240776990 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ea00417a0 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.351+0000 7f1ea7e00640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1e9006b810 0x7f1e9006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.352+0000 7f1ea7e00640 1 -- 172.21.15.102:0/1240776990 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1ea003c070 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.352+0000 7f1eaf400640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1e9006b810 0x7f1e9006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.352+0000 7f1eaf400640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1e9006b810 0x7f1e9006dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00c7880 tx=0x7f1e9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.356+0000 7f1ea7e00640 1 -- 172.21.15.102:0/1240776990 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1ea0077be0 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.544+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1eb004f2f0 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.545+0000 7f1ea7e00640 1 -- 172.21.15.102:0/1240776990 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ea007b2a0 con 0x7f1eb00cb0e0 2024-03-25T05:38:05.539 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-03-25T05:38:05.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1e9006b810 msgr2=0x7f1e9006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1e9006b810 0x7f1e9006dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00c7880 tx=0x7f1e9c008040 comp rx=0 tx=0).stop 2024-03-25T05:38:05.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb00cb0e0 msgr2=0x7f1eb015a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb00cb0e0 0x7f1eb015a7f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ea002ba80 tx=0x7f1ea0004730 comp rx=0 tx=0).stop 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 shutdown_connections 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1e9006b810 0x7f1e9006dcd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1eb0157200 0x7f1eb01efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1eb0153e80 0x7f1eb00ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 --2- 172.21.15.102:0/1240776990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb00cb0e0 0x7f1eb015a7f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 >> 172.21.15.102:0/1240776990 conn(0x7f1eb00cf370 msgr2=0x7f1eb01511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 shutdown_connections 2024-03-25T05:38:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.548+0000 7f1eb5600640 1 -- 172.21.15.102:0/1240776990 wait complete. 2024-03-25T05:38:05.566 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-25T05:38:05.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.758+0000 7f8594000640 1 Processor -- start 2024-03-25T05:38:05.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.759+0000 7f8594000640 1 -- start start 2024-03-25T05:38:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8594000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f858c0cb1e0 0x7f858c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8594000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0c5a50 0x7f858c164700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8594000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c0c4e20 con 0x7f858c0ca630 2024-03-25T05:38:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8594000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c15e120 con 0x7f858c0cb1e0 2024-03-25T05:38:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8594000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0b28d0 con 0x7f858c0c5a50 2024-03-25T05:38:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8591600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f858c0cb1e0 0x7f858c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8590c00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f858c0ca630 0x7f858c0c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40492/0 (socket says 172.21.15.102:40492) 2024-03-25T05:38:05.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8590c00640 1 -- 172.21.15.102:0/1637001543 learned_addr learned my addr 172.21.15.102:0/1637001543 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:05.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f8592000640 1 --2- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0c5a50 0x7f858c164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.761+0000 7f8591600640 1 -- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0c5a50 msgr2=0x7f858c164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.761+0000 7f8591600640 1 --2- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0c5a50 0x7f858c164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.760+0000 7f858be00640 1 -- 172.21.15.102:0/1637001543 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416019821 0 0) 0x7f858c0c4e20 con 0x7f858c0ca630 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.761+0000 7f8591600640 1 -- 172.21.15.102:0/1637001543 >> v1:172.21.15.187:6789/0 conn(0x7f858c0ca630 legacy=0x7f858c0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.761+0000 7f8591600640 1 -- 172.21.15.102:0/1637001543 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c15d4a0 con 0x7f858c0cb1e0 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f8591600640 1 --2- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0cb1e0 0x7f858c0cb5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85800097a0 tx=0x7f858002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c0807649643e65 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f858be00640 1 -- 172.21.15.102:0/1637001543 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580031780 con 0x7f858c0cb1e0 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f858be00640 1 -- 172.21.15.102:0/1637001543 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800318e0 con 0x7f858c0cb1e0 2024-03-25T05:38:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f858be00640 1 -- 172.21.15.102:0/1637001543 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580031c70 con 0x7f858c0cb1e0 2024-03-25T05:38:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f8594000640 1 -- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0cb1e0 msgr2=0x7f858c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f8594000640 1 --2- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0cb1e0 0x7f858c0cb5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85800097a0 tx=0x7f858002b820 comp rx=0 tx=0).stop 2024-03-25T05:38:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f8594000640 1 -- 172.21.15.102:0/1637001543 shutdown_connections 2024-03-25T05:38:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f8594000640 1 --2- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0c5a50 0x7f858c164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f8594000640 1 --2- 172.21.15.102:0/1637001543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0cb1e0 0x7f858c0cb5c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.762+0000 7f8594000640 1 -- 172.21.15.102:0/1637001543 >> 172.21.15.102:0/1637001543 conn(0x7f858c066cc0 msgr2=0x7f858c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.763+0000 7f8594000640 1 -- 172.21.15.102:0/1637001543 shutdown_connections 2024-03-25T05:38:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.763+0000 7f8594000640 1 -- 172.21.15.102:0/1637001543 wait complete. 2024-03-25T05:38:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.764+0000 7f8594000640 1 Processor -- start 2024-03-25T05:38:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.764+0000 7f8594000640 1 -- start start 2024-03-25T05:38:05.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8594000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0c5a50 0x7f858c15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8594000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0ca630 0x7f858c1e5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8594000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0cb1e0 0x7f858c1e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8594000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1e4fc0 con 0x7f858c0cb1e0 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8594000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1e41a0 con 0x7f858c0c5a50 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8594000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0b4640 con 0x7f858c0ca630 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8591600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0c5a50 0x7f858c15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8590c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0ca630 0x7f858c1e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8591600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0c5a50 0x7f858c15c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35622/0 (socket says 172.21.15.102:35622) 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8590c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0ca630 0x7f858c1e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53316/0 (socket says 172.21.15.102:53316) 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.765+0000 7f8591600640 1 -- 172.21.15.102:0/3862570625 learned_addr learned my addr 172.21.15.102:0/3862570625 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8592000640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0cb1e0 0x7f858c1e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8591600640 1 -- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0ca630 msgr2=0x7f858c1e5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8591600640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0ca630 0x7f858c1e5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8591600640 1 -- 172.21.15.102:0/3862570625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0cb1e0 msgr2=0x7f858c1e5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8591600640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0cb1e0 0x7f858c1e5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8591600640 1 -- 172.21.15.102:0/3862570625 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580009400 con 0x7f858c0c5a50 2024-03-25T05:38:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8591600640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0c5a50 0x7f858c15c710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8580034040 tx=0x7f85800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8589600640 1 -- 172.21.15.102:0/3862570625 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580032820 con 0x7f858c0c5a50 2024-03-25T05:38:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8589600640 1 -- 172.21.15.102:0/3862570625 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580032980 con 0x7f858c0c5a50 2024-03-25T05:38:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8589600640 1 -- 172.21.15.102:0/3862570625 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580032d30 con 0x7f858c0c5a50 2024-03-25T05:38:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.766+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c1e4690 con 0x7f858c0c5a50 2024-03-25T05:38:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.767+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c1e4c50 con 0x7f858c0c5a50 2024-03-25T05:38:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.768+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c067fb0 con 0x7f858c0c5a50 2024-03-25T05:38:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.768+0000 7f8589600640 1 -- 172.21.15.102:0/3862570625 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f858004e440 con 0x7f858c0c5a50 2024-03-25T05:38:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.769+0000 7f8589600640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f856c06b840 0x7f856c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.769+0000 7f8589600640 1 -- 172.21.15.102:0/3862570625 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f85800ac580 con 0x7f858c0c5a50 2024-03-25T05:38:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.769+0000 7f8590c00640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f856c06b840 0x7f856c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.770+0000 7f8590c00640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f856c06b840 0x7f856c06dd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f858c15d1d0 tx=0x7f8578007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.773+0000 7f8589600640 1 -- 172.21.15.102:0/3862570625 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8580076bc0 con 0x7f858c0c5a50 2024-03-25T05:38:05.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.963+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f858c0cafc0 con 0x7f858c0c5a50 2024-03-25T05:38:05.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.963+0000 7f8589600640 1 -- 172.21.15.102:0/3862570625 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f858007a280 con 0x7f858c0c5a50 2024-03-25T05:38:05.958 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.965+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f856c06b840 msgr2=0x7f856c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f856c06b840 0x7f856c06dd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f858c15d1d0 tx=0x7f8578007d50 comp rx=0 tx=0).stop 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0c5a50 msgr2=0x7f858c15c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0c5a50 0x7f858c15c710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8580034040 tx=0x7f85800046c0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 shutdown_connections 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f856c06b840 0x7f856c06dd00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0cb1e0 0x7f858c1e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f858c0ca630 0x7f858c1e5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 --2- 172.21.15.102:0/3862570625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f858c0c5a50 0x7f858c15c710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:05.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 >> 172.21.15.102:0/3862570625 conn(0x7f858c066cc0 msgr2=0x7f858c0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:05.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 shutdown_connections 2024-03-25T05:38:05.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:05.966+0000 7f8594000640 1 -- 172.21.15.102:0/3862570625 wait complete. 2024-03-25T05:38:05.983 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T05:38:06.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.173+0000 7f9bc8e00640 1 Processor -- start 2024-03-25T05:38:06.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.174+0000 7f9bc8e00640 1 -- start start 2024-03-25T05:38:06.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.175+0000 7f9bc8e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9bc4154120 0x7f9bc40cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.175+0000 7f9bc8e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.175+0000 7f9bc8e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40cbbe0 con 0x7f9bc40c6c10 2024-03-25T05:38:06.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.175+0000 7f9bc8e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc4154500 con 0x7f9bc4154120 2024-03-25T05:38:06.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.175+0000 7f9bc8e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc406b250 con 0x7f9bc40c67e0 2024-03-25T05:38:06.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc40cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53324/0 (socket says 172.21.15.102:53324) 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2a00640 1 -- 172.21.15.102:0/775263164 learned_addr learned my addr 172.21.15.102:0/775263164 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc3400640 1 --2- 172.21.15.102:0/775263164 >> v2:172.21.15.102:3300/0 conn(0x7f9bc4154120 0x7f9bc40cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2a00640 1 -- 172.21.15.102:0/775263164 >> v2:172.21.15.102:3300/0 conn(0x7f9bc4154120 msgr2=0x7f9bc40cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2a00640 1 --2- 172.21.15.102:0/775263164 >> v2:172.21.15.102:3300/0 conn(0x7f9bc4154120 0x7f9bc40cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2a00640 1 -- 172.21.15.102:0/775263164 >> v1:172.21.15.187:6789/0 conn(0x7f9bc40c6c10 legacy=0x7f9bc40c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2a00640 1 -- 172.21.15.102:0/775263164 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40ca280 con 0x7f9bc40c67e0 2024-03-25T05:38:06.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.176+0000 7f9bc2000640 1 -- 172.21.15.102:0/775263164 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524674229 0 0) 0x7f9bc40cbbe0 con 0x7f9bc40c6c10 2024-03-25T05:38:06.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.178+0000 7f9bc2a00640 1 --2- 172.21.15.102:0/775263164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc40cb540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009870 tx=0x7f9bb002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7146307fa91cffca server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:06.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.178+0000 7f9bc2000640 1 -- 172.21.15.102:0/775263164 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0030840 con 0x7f9bc40c67e0 2024-03-25T05:38:06.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.178+0000 7f9bc2000640 1 -- 172.21.15.102:0/775263164 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb00309a0 con 0x7f9bc40c67e0 2024-03-25T05:38:06.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.178+0000 7f9bc2000640 1 -- 172.21.15.102:0/775263164 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0030d30 con 0x7f9bc40c67e0 2024-03-25T05:38:06.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 -- 172.21.15.102:0/775263164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 msgr2=0x7f9bc40cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/775263164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc40cb540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009870 tx=0x7f9bb002b980 comp rx=0 tx=0).stop 2024-03-25T05:38:06.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 -- 172.21.15.102:0/775263164 shutdown_connections 2024-03-25T05:38:06.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/775263164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc40cb540 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/775263164 >> v2:172.21.15.102:3300/0 conn(0x7f9bc4154120 0x7f9bc40cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 -- 172.21.15.102:0/775263164 >> 172.21.15.102:0/775263164 conn(0x7f9bc40cf3e0 msgr2=0x7f9bc40cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:06.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 -- 172.21.15.102:0/775263164 shutdown_connections 2024-03-25T05:38:06.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.179+0000 7f9bc8e00640 1 -- 172.21.15.102:0/775263164 wait complete. 2024-03-25T05:38:06.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.181+0000 7f9bc8e00640 1 Processor -- start 2024-03-25T05:38:06.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.182+0000 7f9bc8e00640 1 -- start start 2024-03-25T05:38:06.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc8e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc41f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc8e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc40c6c10 0x7f9bc40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc8e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bc4154120 0x7f9bc4155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc8e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4156550 con 0x7f9bc40c6c10 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc8e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4147350 con 0x7f9bc4154120 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc8e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc41f0340 con 0x7f9bc40c67e0 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc3400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc41f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc3400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc41f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53338/0 (socket says 172.21.15.102:53338) 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc3400640 1 -- 172.21.15.102:0/519017542 learned_addr learned my addr 172.21.15.102:0/519017542 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc2a00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc40c6c10 0x7f9bc40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.183+0000 7f9bc3e00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bc4154120 0x7f9bc4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bc3400640 1 -- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bc4154120 msgr2=0x7f9bc4155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bc3400640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bc4154120 0x7f9bc4155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bc3400640 1 -- 172.21.15.102:0/519017542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc40c6c10 msgr2=0x7f9bc40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bc3400640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc40c6c10 0x7f9bc40c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bc3400640 1 -- 172.21.15.102:0/519017542 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00094d0 con 0x7f9bc40c67e0 2024-03-25T05:38:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bc3400640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc41f3330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00efc0 tx=0x7f9bbc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bbb400640 1 -- 172.21.15.102:0/519017542 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc014480 con 0x7f9bc40c67e0 2024-03-25T05:38:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bbb400640 1 -- 172.21.15.102:0/519017542 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00f040 con 0x7f9bc40c67e0 2024-03-25T05:38:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bbb400640 1 -- 172.21.15.102:0/519017542 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc014800 con 0x7f9bc40c67e0 2024-03-25T05:38:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.184+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc40c5e10 con 0x7f9bc40c67e0 2024-03-25T05:38:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.185+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc41efa10 con 0x7f9bc40c67e0 2024-03-25T05:38:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.186+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc40c7160 con 0x7f9bc40c67e0 2024-03-25T05:38:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.186+0000 7f9bbb400640 1 -- 172.21.15.102:0/519017542 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9bbc014960 con 0x7f9bc40c67e0 2024-03-25T05:38:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.188+0000 7f9bbb400640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9ba406b810 0x7f9ba406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.188+0000 7f9bbb400640 1 -- 172.21.15.102:0/519017542 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9bbc08b0c0 con 0x7f9bc40c67e0 2024-03-25T05:38:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.188+0000 7f9bc2a00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9ba406b810 0x7f9ba406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.189+0000 7f9bc2a00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9ba406b810 0x7f9ba406dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0036000 tx=0x7f9bb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:06.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.192+0000 7f9bbb400640 1 -- 172.21.15.102:0/519017542 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9bbc055720 con 0x7f9bc40c67e0 2024-03-25T05:38:06.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.420+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bc404f2f0 con 0x7f9bc40c67e0 2024-03-25T05:38:06.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.421+0000 7f9bbb400640 1 -- 172.21.15.102:0/519017542 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6654 (secure 0 0 0) 0x7f9bbc058de0 con 0x7f9bc40c67e0 2024-03-25T05:38:06.415 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:06.415 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:57.547664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4291,"mds_1":4273,"mds_2":4270,"mds_3":4250,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4270":{"gid":4270,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4244,4270,4250,4273,4291]},"id":1}]} 2024-03-25T05:38:06.415 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-03-25T05:38:06.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9ba406b810 msgr2=0x7f9ba406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9ba406b810 0x7f9ba406dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0036000 tx=0x7f9bb0008030 comp rx=0 tx=0).stop 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 msgr2=0x7f9bc41f3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc41f3330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00efc0 tx=0x7f9bbc00c490 comp rx=0 tx=0).stop 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 shutdown_connections 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9ba406b810 0x7f9ba406dcd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bc4154120 0x7f9bc4155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc40c6c10 0x7f9bc40c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 --2- 172.21.15.102:0/519017542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bc40c67e0 0x7f9bc41f3330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 >> 172.21.15.102:0/519017542 conn(0x7f9bc40cf3e0 msgr2=0x7f9bc40ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 shutdown_connections 2024-03-25T05:38:06.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.424+0000 7f9bc8e00640 1 -- 172.21.15.102:0/519017542 wait complete. 2024-03-25T05:38:06.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:38:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.617+0000 7f9da1200640 1 Processor -- start 2024-03-25T05:38:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.617+0000 7f9da1200640 1 -- start start 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9da1200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9d9c0c5940 0x7f9d9c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9da1200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9d9c0c7940 0x7f9d9c0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9da1200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c0c82d0 con 0x7f9d9c0c6240 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9da1200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c0caa10 con 0x7f9d9c0c7940 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9da1200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c15a060 con 0x7f9d9c0c5940 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9d99e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9d9c0c5940 0x7f9d9c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9d9a800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9d9c0c7940 0x7f9d9c0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9d99e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9d9c0c5940 0x7f9d9c0ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35638/0 (socket says 172.21.15.102:35638) 2024-03-25T05:38:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.619+0000 7f9d99e00640 1 -- 172.21.15.102:0/3572791837 learned_addr learned my addr 172.21.15.102:0/3572791837 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:06.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.620+0000 7f9d99e00640 1 -- 172.21.15.102:0/3572791837 >> v2:172.21.15.102:3300/0 conn(0x7f9d9c0c7940 msgr2=0x7f9d9c0c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:06.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.620+0000 7f9d99e00640 1 --2- 172.21.15.102:0/3572791837 >> v2:172.21.15.102:3300/0 conn(0x7f9d9c0c7940 0x7f9d9c0c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.620+0000 7f9d99e00640 1 -- 172.21.15.102:0/3572791837 >> v1:172.21.15.102:6789/0 conn(0x7f9d9c0c6240 legacy=0x7f9d9c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.620+0000 7f9d99e00640 1 -- 172.21.15.102:0/3572791837 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c15a340 con 0x7f9d9c0c5940 2024-03-25T05:38:06.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.621+0000 7f9d99e00640 1 --2- 172.21.15.102:0/3572791837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c0ca4d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c06cc70 tx=0x7f9d8c02b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d021ec3d85b52842 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:06.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.621+0000 7f9d99400640 1 -- 172.21.15.102:0/3572791837 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c030870 con 0x7f9d9c0c5940 2024-03-25T05:38:06.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.621+0000 7f9d99400640 1 -- 172.21.15.102:0/3572791837 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0309d0 con 0x7f9d9c0c5940 2024-03-25T05:38:06.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.621+0000 7f9d99400640 1 -- 172.21.15.102:0/3572791837 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c030d60 con 0x7f9d9c0c5940 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.621+0000 7f9da1200640 1 -- 172.21.15.102:0/3572791837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 msgr2=0x7f9d9c0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.621+0000 7f9da1200640 1 --2- 172.21.15.102:0/3572791837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c0ca4d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c06cc70 tx=0x7f9d8c02b9b0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.622+0000 7f9da1200640 1 -- 172.21.15.102:0/3572791837 shutdown_connections 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.622+0000 7f9da1200640 1 --2- 172.21.15.102:0/3572791837 >> v2:172.21.15.102:3300/0 conn(0x7f9d9c0c7940 0x7f9d9c0c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.622+0000 7f9da1200640 1 --2- 172.21.15.102:0/3572791837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c0ca4d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.622+0000 7f9da1200640 1 -- 172.21.15.102:0/3572791837 >> 172.21.15.102:0/3572791837 conn(0x7f9d9c0728c0 msgr2=0x7f9d9c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.622+0000 7f9da1200640 1 -- 172.21.15.102:0/3572791837 shutdown_connections 2024-03-25T05:38:06.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.622+0000 7f9da1200640 1 -- 172.21.15.102:0/3572791837 wait complete. 2024-03-25T05:38:06.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.623+0000 7f9da1200640 1 Processor -- start 2024-03-25T05:38:06.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.623+0000 7f9da1200640 1 -- start start 2024-03-25T05:38:06.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9da1200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9da1200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d9c0c6240 0x7f9d9c1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9da1200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d9c0c7940 0x7f9d9c1e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9da1200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1e5c40 con 0x7f9d9c0c7940 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9da1200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c0b57c0 con 0x7f9d9c0c5940 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9da1200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c0aafa0 con 0x7f9d9c0c6240 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9d99e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9d99e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35642/0 (socket says 172.21.15.102:35642) 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9d93e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d9c0c6240 0x7f9d9c1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.624+0000 7f9d99e00640 1 -- 172.21.15.102:0/2119135985 learned_addr learned my addr 172.21.15.102:0/2119135985 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d9a800640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d9c0c7940 0x7f9d9c1e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d99e00640 1 -- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d9c0c6240 msgr2=0x7f9d9c1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d99e00640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d9c0c6240 0x7f9d9c1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d99e00640 1 -- 172.21.15.102:0/2119135985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d9c0c7940 msgr2=0x7f9d9c1e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d99e00640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d9c0c7940 0x7f9d9c1e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d99e00640 1 -- 172.21.15.102:0/2119135985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c0094d0 con 0x7f9d9c0c5940 2024-03-25T05:38:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d99e00640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c154060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c000c00 tx=0x7f9d8c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d92000640 1 -- 172.21.15.102:0/2119135985 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c039a10 con 0x7f9d9c0c5940 2024-03-25T05:38:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d92000640 1 -- 172.21.15.102:0/2119135985 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c039b90 con 0x7f9d9c0c5940 2024-03-25T05:38:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9d92000640 1 -- 172.21.15.102:0/2119135985 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c043410 con 0x7f9d9c0c5940 2024-03-25T05:38:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.625+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c0ac7c0 con 0x7f9d9c0c5940 2024-03-25T05:38:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.626+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c0ab240 con 0x7f9d9c0c5940 2024-03-25T05:38:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.627+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c0c8fe0 con 0x7f9d9c0c5940 2024-03-25T05:38:06.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.628+0000 7f9d92000640 1 -- 172.21.15.102:0/2119135985 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d8c02f3c0 con 0x7f9d9c0c5940 2024-03-25T05:38:06.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.628+0000 7f9d92000640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9d7806b810 0x7f9d7806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:06.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.628+0000 7f9d92000640 1 -- 172.21.15.102:0/2119135985 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9d8c0aca70 con 0x7f9d9c0c5940 2024-03-25T05:38:06.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.629+0000 7f9d93e00640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9d7806b810 0x7f9d7806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:06.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.629+0000 7f9d93e00640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9d7806b810 0x7f9d7806dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c1ed650 tx=0x7f9d84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:06.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.633+0000 7f9d92000640 1 -- 172.21.15.102:0/2119135985 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9d8c077170 con 0x7f9d9c0c5940 2024-03-25T05:38:06.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.823+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d9c067fb0 con 0x7f9d9c0c5940 2024-03-25T05:38:06.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.824+0000 7f9d92000640 1 -- 172.21.15.102:0/2119135985 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f9d8c034030 con 0x7f9d9c0c5940 2024-03-25T05:38:06.819 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:06.819 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9d7806b810 msgr2=0x7f9d7806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9d7806b810 0x7f9d7806dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c1ed650 tx=0x7f9d84009040 comp rx=0 tx=0).stop 2024-03-25T05:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 msgr2=0x7f9d9c154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c154060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c000c00 tx=0x7f9d8c004730 comp rx=0 tx=0).stop 2024-03-25T05:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 shutdown_connections 2024-03-25T05:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9d7806b810 0x7f9d7806dcd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d9c0c7940 0x7f9d9c1e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d9c0c6240 0x7f9d9c1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 --2- 172.21.15.102:0/2119135985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d9c0c5940 0x7f9d9c154060 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:06.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 >> 172.21.15.102:0/2119135985 conn(0x7f9d9c0728c0 msgr2=0x7f9d9c159600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:06.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 shutdown_connections 2024-03-25T05:38:06.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:06.828+0000 7f9da1200640 1 -- 172.21.15.102:0/2119135985 wait complete. 2024-03-25T05:38:06.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T05:37:25.079908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-25T05:37:29.008596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-25T05:37:29.891587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-25T05:37:33.466049+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-25T05:38:06.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-25T05:38:07.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.032+0000 7f0150c00640 1 Processor -- start 2024-03-25T05:38:07.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.032+0000 7f0150c00640 1 -- start start 2024-03-25T05:38:07.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.033+0000 7f0150c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f014c153e80 0x7f014c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.033+0000 7f0150c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f014c154260 0x7f014c0c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.033+0000 7f0150c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0c8220 con 0x7f014c0cb0e0 2024-03-25T05:38:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.033+0000 7f0150c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0c8500 con 0x7f014c154260 2024-03-25T05:38:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.033+0000 7f0150c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0ca320 con 0x7f014c153e80 2024-03-25T05:38:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.033+0000 7f014b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f014c153e80 0x7f014c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.033+0000 7f014aa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f014c154260 0x7f014c0c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.034+0000 7f014b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f014c153e80 0x7f014c0c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35652/0 (socket says 172.21.15.102:35652) 2024-03-25T05:38:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.034+0000 7f014b400640 1 -- 172.21.15.102:0/808277249 learned_addr learned my addr 172.21.15.102:0/808277249 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.034+0000 7f014b400640 1 -- 172.21.15.102:0/808277249 >> v2:172.21.15.102:3300/0 conn(0x7f014c154260 msgr2=0x7f014c0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.034+0000 7f014b400640 1 --2- 172.21.15.102:0/808277249 >> v2:172.21.15.102:3300/0 conn(0x7f014c154260 0x7f014c0c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.034+0000 7f014b400640 1 -- 172.21.15.102:0/808277249 >> v1:172.21.15.102:6789/0 conn(0x7f014c0cb0e0 legacy=0x7f014c0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.034+0000 7f014b400640 1 -- 172.21.15.102:0/808277249 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0ca600 con 0x7f014c153e80 2024-03-25T05:38:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.035+0000 7f014b400640 1 --2- 172.21.15.102:0/808277249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c153e80 0x7f014c0c6770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f014c08cab0 tx=0x7f013c02ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3e24605293f81bd server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.035+0000 7f014a000640 1 -- 172.21.15.102:0/808277249 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c02f860 con 0x7f014c153e80 2024-03-25T05:38:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.035+0000 7f014a000640 1 -- 172.21.15.102:0/808277249 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c02f9c0 con 0x7f014c153e80 2024-03-25T05:38:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.035+0000 7f014a000640 1 -- 172.21.15.102:0/808277249 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c02fd50 con 0x7f014c153e80 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 -- 172.21.15.102:0/808277249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c153e80 msgr2=0x7f014c0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 --2- 172.21.15.102:0/808277249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c153e80 0x7f014c0c6770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f014c08cab0 tx=0x7f013c02ba40 comp rx=0 tx=0).stop 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 -- 172.21.15.102:0/808277249 shutdown_connections 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 --2- 172.21.15.102:0/808277249 >> v2:172.21.15.102:3300/0 conn(0x7f014c154260 0x7f014c0c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 --2- 172.21.15.102:0/808277249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c153e80 0x7f014c0c6770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 -- 172.21.15.102:0/808277249 >> 172.21.15.102:0/808277249 conn(0x7f014c0cf370 msgr2=0x7f014c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 -- 172.21.15.102:0/808277249 shutdown_connections 2024-03-25T05:38:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.036+0000 7f0150c00640 1 -- 172.21.15.102:0/808277249 wait complete. 2024-03-25T05:38:07.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.038+0000 7f0150c00640 1 Processor -- start 2024-03-25T05:38:07.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.038+0000 7f0150c00640 1 -- start start 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.038+0000 7f0150c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c0cb0e0 0x7f014c1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f0150c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f014c153e80 0x7f014c1481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f0150c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014c156e00 0x7f014c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f0150c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15b350 con 0x7f014c153e80 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f0150c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c14aa90 con 0x7f014c0cb0e0 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f0150c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c14ad70 con 0x7f014c156e00 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c0cb0e0 0x7f014c1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014c156e00 0x7f014c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c0cb0e0 0x7f014c1492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35666/0 (socket says 172.21.15.102:35666) 2024-03-25T05:38:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 -- 172.21.15.102:0/3478769246 learned_addr learned my addr 172.21.15.102:0/3478769246 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014aa00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f014c153e80 0x7f014c1481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 -- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014c156e00 msgr2=0x7f014c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014c156e00 0x7f014c15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 -- 172.21.15.102:0/3478769246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f014c153e80 msgr2=0x7f014c1481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f014c153e80 0x7f014c1481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014b400640 1 -- 172.21.15.102:0/3478769246 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0094d0 con 0x7f014c0cb0e0 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.039+0000 7f014aa00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f014c153e80 0x7f014c1481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.040+0000 7f014b400640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c0cb0e0 0x7f014c1492d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f013c000c00 tx=0x7f013c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.040+0000 7f0143400640 1 -- 172.21.15.102:0/3478769246 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c037c40 con 0x7f014c0cb0e0 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.040+0000 7f0143400640 1 -- 172.21.15.102:0/3478769246 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c037dc0 con 0x7f014c0cb0e0 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.040+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c14b050 con 0x7f014c0cb0e0 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.040+0000 7f0143400640 1 -- 172.21.15.102:0/3478769246 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0426c0 con 0x7f014c0cb0e0 2024-03-25T05:38:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.040+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c152890 con 0x7f014c0cb0e0 2024-03-25T05:38:07.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.041+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c14b210 con 0x7f014c0cb0e0 2024-03-25T05:38:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.043+0000 7f0143400640 1 -- 172.21.15.102:0/3478769246 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f013c042820 con 0x7f014c0cb0e0 2024-03-25T05:38:07.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.044+0000 7f0143400640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f012c06b840 0x7f012c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.044+0000 7f0143400640 1 -- 172.21.15.102:0/3478769246 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f013c03c070 con 0x7f014c0cb0e0 2024-03-25T05:38:07.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.044+0000 7f014aa00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f012c06b840 0x7f012c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.045+0000 7f014aa00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f012c06b840 0x7f012c06dd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f014c15ad90 tx=0x7f0138008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.050+0000 7f0143400640 1 -- 172.21.15.102:0/3478769246 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f013c077620 con 0x7f014c0cb0e0 2024-03-25T05:38:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.238+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f014c15ae40 con 0x7f014c0cb0e0 2024-03-25T05:38:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.238+0000 7f0143400640 1 -- 172.21.15.102:0/3478769246 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f014c15ae40 con 0x7f014c0cb0e0 2024-03-25T05:38:07.232 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.240+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f012c06b840 msgr2=0x7f012c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.240+0000 7f0150c00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f012c06b840 0x7f012c06dd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f014c15ad90 tx=0x7f0138008040 comp rx=0 tx=0).stop 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.240+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c0cb0e0 msgr2=0x7f014c1492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.240+0000 7f0150c00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c0cb0e0 0x7f014c1492d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f013c000c00 tx=0x7f013c004730 comp rx=0 tx=0).stop 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 shutdown_connections 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f012c06b840 0x7f012c06dd00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014c156e00 0x7f014c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f014c153e80 0x7f014c1481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 --2- 172.21.15.102:0/3478769246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f014c0cb0e0 0x7f014c1492d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 >> 172.21.15.102:0/3478769246 conn(0x7f014c0cf370 msgr2=0x7f014c0c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:07.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 shutdown_connections 2024-03-25T05:38:07.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.241+0000 7f0150c00640 1 -- 172.21.15.102:0/3478769246 wait complete. 2024-03-25T05:38:07.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-25T05:38:07.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.450+0000 7f367d000640 1 Processor -- start 2024-03-25T05:38:07.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.450+0000 7f367d000640 1 -- start start 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.451+0000 7f367d000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f36780cb1e0 0x7f36780cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f367d000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780ca630 0x7f36780c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f367d000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36780c4e20 con 0x7f36780cbd20 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f367d000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367815e120 con 0x7f36780cb1e0 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f367d000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36780b28d0 con 0x7f36780ca630 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f36780cb1e0 0x7f36780cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f36780cb1e0 0x7f36780cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35668/0 (socket says 172.21.15.102:35668) 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675e00640 1 -- 172.21.15.102:0/1284985225 learned_addr learned my addr 172.21.15.102:0/1284985225 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675400640 1 --2- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780ca630 0x7f36780c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675e00640 1 -- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780ca630 msgr2=0x7f36780c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675e00640 1 --2- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780ca630 0x7f36780c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675e00640 1 -- 172.21.15.102:0/1284985225 >> v1:172.21.15.102:6789/0 conn(0x7f36780cbd20 legacy=0x7f3678159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.452+0000 7f3675e00640 1 -- 172.21.15.102:0/1284985225 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367815d4a0 con 0x7f36780cb1e0 2024-03-25T05:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.453+0000 7f3675e00640 1 --2- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780cb1e0 0x7f36780cb5c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3668009870 tx=0x7f366802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=def1a30098461677 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f3674a00640 1 -- 172.21.15.102:0/1284985225 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668031640 con 0x7f36780cb1e0 2024-03-25T05:38:07.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f3674a00640 1 -- 172.21.15.102:0/1284985225 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36680317a0 con 0x7f36780cb1e0 2024-03-25T05:38:07.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f3674a00640 1 -- 172.21.15.102:0/1284985225 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668031b30 con 0x7f36780cb1e0 2024-03-25T05:38:07.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f367d000640 1 -- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780cb1e0 msgr2=0x7f36780cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f367d000640 1 --2- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780cb1e0 0x7f36780cb5c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3668009870 tx=0x7f366802b8f0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f367d000640 1 -- 172.21.15.102:0/1284985225 shutdown_connections 2024-03-25T05:38:07.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f367d000640 1 --2- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780ca630 0x7f36780c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f367d000640 1 --2- 172.21.15.102:0/1284985225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780cb1e0 0x7f36780cb5c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.454+0000 7f367d000640 1 -- 172.21.15.102:0/1284985225 >> 172.21.15.102:0/1284985225 conn(0x7f3678066cc0 msgr2=0x7f36780670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:07.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.455+0000 7f367d000640 1 -- 172.21.15.102:0/1284985225 shutdown_connections 2024-03-25T05:38:07.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.455+0000 7f367d000640 1 -- 172.21.15.102:0/1284985225 wait complete. 2024-03-25T05:38:07.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.456+0000 7f367d000640 1 Processor -- start 2024-03-25T05:38:07.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.456+0000 7f367d000640 1 -- start start 2024-03-25T05:38:07.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f367d000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780ca630 0x7f36781f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f367d000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780cb1e0 0x7f36781f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f367d000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36780cbd20 0x7f367815c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f367d000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36781efc80 con 0x7f36780cbd20 2024-03-25T05:38:07.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f367d000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36781f3370 con 0x7f36780ca630 2024-03-25T05:38:07.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f367d000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36781f3bd0 con 0x7f36780cb1e0 2024-03-25T05:38:07.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f3675e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780ca630 0x7f36781f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f3675400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780cb1e0 0x7f36781f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f3676800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36780cbd20 0x7f367815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f3675400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780cb1e0 0x7f36781f0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53382/0 (socket says 172.21.15.102:53382) 2024-03-25T05:38:07.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f3675e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780ca630 0x7f36781f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35682/0 (socket says 172.21.15.102:35682) 2024-03-25T05:38:07.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.458+0000 7f3675400640 1 -- 172.21.15.102:0/3474419024 learned_addr learned my addr 172.21.15.102:0/3474419024 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f3675400640 1 -- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780ca630 msgr2=0x7f36781f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f3675400640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780ca630 0x7f36781f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f3675400640 1 -- 172.21.15.102:0/3474419024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36780cbd20 msgr2=0x7f367815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f3675400640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36780cbd20 0x7f367815c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f3675400640 1 -- 172.21.15.102:0/3474419024 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680094d0 con 0x7f36780cb1e0 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f3676800640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36780cbd20 0x7f367815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f3675400640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780cb1e0 0x7f36781f0110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f366400e9b0 tx=0x7f366400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f366e000640 1 -- 172.21.15.102:0/3474419024 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664009670 con 0x7f36780cb1e0 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f366e000640 1 -- 172.21.15.102:0/3474419024 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366400c9a0 con 0x7f36780cb1e0 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f366e000640 1 -- 172.21.15.102:0/3474419024 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400cd50 con 0x7f36780cb1e0 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.459+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36781f3610 con 0x7f36780cb1e0 2024-03-25T05:38:07.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.460+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36781ef910 con 0x7f36780cb1e0 2024-03-25T05:38:07.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.461+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36781ef770 con 0x7f36780cb1e0 2024-03-25T05:38:07.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.462+0000 7f366e000640 1 -- 172.21.15.102:0/3474419024 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3664013470 con 0x7f36780cb1e0 2024-03-25T05:38:07.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.463+0000 7f366e000640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f365806b810 0x7f365806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.463+0000 7f366e000640 1 -- 172.21.15.102:0/3474419024 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f366408a7d0 con 0x7f36780cb1e0 2024-03-25T05:38:07.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.464+0000 7f3675e00640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f365806b810 0x7f365806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.465+0000 7f3675e00640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f365806b810 0x7f365806dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3668036000 tx=0x7f366803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.471+0000 7f366e000640 1 -- 172.21.15.102:0/3474419024 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f36781ef770 con 0x7f36780cb1e0 2024-03-25T05:38:07.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.662+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36781ef770 con 0x7f36780cb1e0 2024-03-25T05:38:07.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.663+0000 7f366e000640 1 -- 172.21.15.102:0/3474419024 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36781ef770 con 0x7f36780cb1e0 2024-03-25T05:38:07.657 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:38:07.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f365806b810 msgr2=0x7f365806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f365806b810 0x7f365806dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3668036000 tx=0x7f366803c040 comp rx=0 tx=0).stop 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780cb1e0 msgr2=0x7f36781f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780cb1e0 0x7f36781f0110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f366400e9b0 tx=0x7f366400ee70 comp rx=0 tx=0).stop 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 shutdown_connections 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f365806b810 0x7f365806dcd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36780cbd20 0x7f367815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36780cb1e0 0x7f36781f0110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 --2- 172.21.15.102:0/3474419024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36780ca630 0x7f36781f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 >> 172.21.15.102:0/3474419024 conn(0x7f3678066cc0 msgr2=0x7f3678152780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 shutdown_connections 2024-03-25T05:38:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.665+0000 7f367d000640 1 -- 172.21.15.102:0/3474419024 wait complete. 2024-03-25T05:38:07.676 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-25T05:38:07.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.876+0000 7fcff6600640 1 Processor -- start 2024-03-25T05:38:07.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.876+0000 7fcff6600640 1 -- start start 2024-03-25T05:38:07.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcff6600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcff00ca1d0 0x7fcff00cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcff6600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcff00cb2b0 0x7fcff0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcff6600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff015a9a0 con 0x7fcff0154220 2024-03-25T05:38:07.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcff6600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff00c4b00 con 0x7fcff00cb2b0 2024-03-25T05:38:07.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcff6600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff0154600 con 0x7fcff00ca1d0 2024-03-25T05:38:07.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcfe7e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcff00ca1d0 0x7fcff00cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcfef400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fcff0154220 0x7fcff00c57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40498/0 (socket says 172.21.15.102:40498) 2024-03-25T05:38:07.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcfef400640 1 -- 172.21.15.102:0/2436610897 learned_addr learned my addr 172.21.15.102:0/2436610897 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:07.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.878+0000 7fcfefe00640 1 --2- 172.21.15.102:0/2436610897 >> v2:172.21.15.102:3300/0 conn(0x7fcff00cb2b0 0x7fcff0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.879+0000 7fcfe7e00640 1 -- 172.21.15.102:0/2436610897 >> v2:172.21.15.102:3300/0 conn(0x7fcff00cb2b0 msgr2=0x7fcff0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.879+0000 7fcfe7e00640 1 --2- 172.21.15.102:0/2436610897 >> v2:172.21.15.102:3300/0 conn(0x7fcff00cb2b0 0x7fcff0159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.879+0000 7fcfe7e00640 1 -- 172.21.15.102:0/2436610897 >> v1:172.21.15.187:6789/0 conn(0x7fcff0154220 legacy=0x7fcff00c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.879+0000 7fcfe7e00640 1 -- 172.21.15.102:0/2436610897 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff015ac60 con 0x7fcff00ca1d0 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.879+0000 7fcfeea00640 1 -- 172.21.15.102:0/2436610897 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288774691 0 0) 0x7fcff015a9a0 con 0x7fcff0154220 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.879+0000 7fcfefe00640 1 --2- 172.21.15.102:0/2436610897 >> v2:172.21.15.102:3300/0 conn(0x7fcff00cb2b0 0x7fcff0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.880+0000 7fcfe7e00640 1 --2- 172.21.15.102:0/2436610897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff00cad70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcff00b2060 tx=0x7fcfd802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf6b2cf12d2ac7a server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.880+0000 7fcfeea00640 1 -- 172.21.15.102:0/2436610897 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8031640 con 0x7fcff00ca1d0 2024-03-25T05:38:07.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.880+0000 7fcfeea00640 1 -- 172.21.15.102:0/2436610897 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80317a0 con 0x7fcff00ca1d0 2024-03-25T05:38:07.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.880+0000 7fcfeea00640 1 -- 172.21.15.102:0/2436610897 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8031b30 con 0x7fcff00ca1d0 2024-03-25T05:38:07.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.880+0000 7fcff6600640 1 -- 172.21.15.102:0/2436610897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 msgr2=0x7fcff00cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.880+0000 7fcff6600640 1 --2- 172.21.15.102:0/2436610897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff00cad70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcff00b2060 tx=0x7fcfd802b8f0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.881+0000 7fcff6600640 1 -- 172.21.15.102:0/2436610897 shutdown_connections 2024-03-25T05:38:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.881+0000 7fcff6600640 1 --2- 172.21.15.102:0/2436610897 >> v2:172.21.15.102:3300/0 conn(0x7fcff00cb2b0 0x7fcff0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.881+0000 7fcff6600640 1 --2- 172.21.15.102:0/2436610897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff00cad70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.881+0000 7fcff6600640 1 -- 172.21.15.102:0/2436610897 >> 172.21.15.102:0/2436610897 conn(0x7fcff006c710 msgr2=0x7fcff006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.881+0000 7fcff6600640 1 -- 172.21.15.102:0/2436610897 shutdown_connections 2024-03-25T05:38:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.881+0000 7fcff6600640 1 -- 172.21.15.102:0/2436610897 wait complete. 2024-03-25T05:38:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.882+0000 7fcff6600640 1 Processor -- start 2024-03-25T05:38:07.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.882+0000 7fcff6600640 1 -- start start 2024-03-25T05:38:07.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.883+0000 7fcff6600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff014f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.883+0000 7fcff6600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff00cb2b0 0x7fcff014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.883+0000 7fcff6600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff0154220 0x7fcff00ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.883+0000 7fcff6600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff015b3d0 con 0x7fcff0154220 2024-03-25T05:38:07.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.883+0000 7fcff6600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff01effd0 con 0x7fcff00ca1d0 2024-03-25T05:38:07.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.883+0000 7fcff6600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff01f0290 con 0x7fcff00cb2b0 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfef400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff014f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfe7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff00cb2b0 0x7fcff014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfef400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff014f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35702/0 (socket says 172.21.15.102:35702) 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfef400640 1 -- 172.21.15.102:0/3344778998 learned_addr learned my addr 172.21.15.102:0/3344778998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfefe00640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff0154220 0x7fcff00ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfe7e00640 1 -- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 msgr2=0x7fcff014f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfe7e00640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff014f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfe7e00640 1 -- 172.21.15.102:0/3344778998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff0154220 msgr2=0x7fcff00ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfe7e00640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff0154220 0x7fcff00ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfe7e00640 1 -- 172.21.15.102:0/3344778998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8009400 con 0x7fcff00cb2b0 2024-03-25T05:38:07.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.884+0000 7fcfe7e00640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff00cb2b0 0x7fcff014eb40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c4c40 tx=0x7fcfd80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.885+0000 7fcfe7400640 1 -- 172.21.15.102:0/3344778998 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd803ac60 con 0x7fcff00cb2b0 2024-03-25T05:38:07.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.885+0000 7fcfe7400640 1 -- 172.21.15.102:0/3344778998 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd803adc0 con 0x7fcff00cb2b0 2024-03-25T05:38:07.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.885+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff01f0570 con 0x7fcff00cb2b0 2024-03-25T05:38:07.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.885+0000 7fcfe7400640 1 -- 172.21.15.102:0/3344778998 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8044600 con 0x7fcff00cb2b0 2024-03-25T05:38:07.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.885+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff015aff0 con 0x7fcff00cb2b0 2024-03-25T05:38:07.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.886+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff015b510 con 0x7fcff00cb2b0 2024-03-25T05:38:07.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.887+0000 7fcfe7400640 1 -- 172.21.15.102:0/3344778998 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfd802f050 con 0x7fcff00cb2b0 2024-03-25T05:38:07.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.888+0000 7fcfe7400640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcfcc06b810 0x7fcfcc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:07.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.888+0000 7fcfe7400640 1 -- 172.21.15.102:0/3344778998 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcfd80ac3a0 con 0x7fcff00cb2b0 2024-03-25T05:38:07.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.888+0000 7fcfef400640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcfcc06b810 0x7fcfcc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:07.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.889+0000 7fcfef400640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcfcc06b810 0x7fcfcc06dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0007b10 tx=0x7fcfe0007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:07.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:07.896+0000 7fcfe7400640 1 -- 172.21.15.102:0/3344778998 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcff015b510 con 0x7fcff00cb2b0 2024-03-25T05:38:08.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.146+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcff015b510 con 0x7fcff00cb2b0 2024-03-25T05:38:08.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.146+0000 7fcfe7400640 1 -- 172.21.15.102:0/3344778998 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcff015b510 con 0x7fcff00cb2b0 2024-03-25T05:38:08.141 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-03-25T05:38:08.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcfcc06b810 msgr2=0x7fcfcc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcfcc06b810 0x7fcfcc06dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0007b10 tx=0x7fcfe0007a60 comp rx=0 tx=0).stop 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff00cb2b0 msgr2=0x7fcff014eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff00cb2b0 0x7fcff014eb40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c4c40 tx=0x7fcfd80046c0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 shutdown_connections 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcfcc06b810 0x7fcfcc06dcd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff0154220 0x7fcff00ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff00cb2b0 0x7fcff014eb40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 --2- 172.21.15.102:0/3344778998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff00ca1d0 0x7fcff014f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 >> 172.21.15.102:0/3344778998 conn(0x7fcff006c710 msgr2=0x7fcff00cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:08.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 shutdown_connections 2024-03-25T05:38:08.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.150+0000 7fcff6600640 1 -- 172.21.15.102:0/3344778998 wait complete. 2024-03-25T05:38:08.162 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-25T05:38:08.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.358+0000 7f5ca4e00640 1 Processor -- start 2024-03-25T05:38:08.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.358+0000 7f5ca4e00640 1 -- start start 2024-03-25T05:38:08.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.360+0000 7f5ca4e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c6ec0 0x7f5ca00c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.360+0000 7f5ca4e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5ca00c5bd0 0x7f5ca00c6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.360+0000 7f5ca4e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca0072940 con 0x7f5ca014e4b0 2024-03-25T05:38:08.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.360+0000 7f5ca4e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca0073140 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5ca4e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca015b6d0 con 0x7f5ca00c6ec0 2024-03-25T05:38:08.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c6ec0 0x7f5ca00c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9de00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5ca014e4b0 0x7f5ca015afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40508/0 (socket says 172.21.15.102:40508) 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9e800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5ca00c5bd0 0x7f5ca00c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9de00640 1 -- 172.21.15.102:0/1698248055 learned_addr learned my addr 172.21.15.102:0/1698248055 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9d400640 1 -- 172.21.15.102:0/1698248055 >> v2:172.21.15.187:3300/0 conn(0x7f5ca00c5bd0 msgr2=0x7f5ca00c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9d400640 1 --2- 172.21.15.102:0/1698248055 >> v2:172.21.15.187:3300/0 conn(0x7f5ca00c5bd0 0x7f5ca00c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9d400640 1 -- 172.21.15.102:0/1698248055 >> v1:172.21.15.187:6789/0 conn(0x7f5ca014e4b0 legacy=0x7f5ca015afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9d400640 1 -- 172.21.15.102:0/1698248055 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0072ba0 con 0x7f5ca00c6ec0 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9ca00640 1 -- 172.21.15.102:0/1698248055 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767757190 0 0) 0x7f5ca0072940 con 0x7f5ca014e4b0 2024-03-25T05:38:08.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.361+0000 7f5c9e800640 1 --2- 172.21.15.102:0/1698248055 >> v2:172.21.15.187:3300/0 conn(0x7f5ca00c5bd0 0x7f5ca00c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:08.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.363+0000 7f5c9d400640 1 --2- 172.21.15.102:0/1698248055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c6ec0 0x7f5ca00c7330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0097a0 tx=0x7f5c8c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76f5854a06622fc server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:08.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.363+0000 7f5c9ca00640 1 -- 172.21.15.102:0/1698248055 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c02d040 con 0x7f5ca00c6ec0 2024-03-25T05:38:08.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.363+0000 7f5c9ca00640 1 -- 172.21.15.102:0/1698248055 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c031810 con 0x7f5ca00c6ec0 2024-03-25T05:38:08.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.363+0000 7f5c9ca00640 1 -- 172.21.15.102:0/1698248055 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c031ba0 con 0x7f5ca00c6ec0 2024-03-25T05:38:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 -- 172.21.15.102:0/1698248055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c6ec0 msgr2=0x7f5ca00c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/1698248055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c6ec0 0x7f5ca00c7330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0097a0 tx=0x7f5c8c02b8b0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 -- 172.21.15.102:0/1698248055 shutdown_connections 2024-03-25T05:38:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/1698248055 >> v2:172.21.15.187:3300/0 conn(0x7f5ca00c5bd0 0x7f5ca00c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/1698248055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c6ec0 0x7f5ca00c7330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 -- 172.21.15.102:0/1698248055 >> 172.21.15.102:0/1698248055 conn(0x7f5ca00cc4c0 msgr2=0x7f5ca00cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:08.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 -- 172.21.15.102:0/1698248055 shutdown_connections 2024-03-25T05:38:08.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.364+0000 7f5ca4e00640 1 -- 172.21.15.102:0/1698248055 wait complete. 2024-03-25T05:38:08.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.367+0000 7f5ca4e00640 1 Processor -- start 2024-03-25T05:38:08.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.367+0000 7f5ca4e00640 1 -- start start 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.368+0000 7f5ca4e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c5bd0 0x7f5ca0153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.368+0000 7f5ca4e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca00c6ec0 0x7f5ca0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.368+0000 7f5ca4e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca014e4b0 0x7f5ca014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.368+0000 7f5ca4e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0158380 con 0x7f5ca014e4b0 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.368+0000 7f5ca4e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0158660 con 0x7f5ca00c6ec0 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.368+0000 7f5ca4e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0152560 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c5bd0 0x7f5ca0153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9d400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca00c6ec0 0x7f5ca0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9d400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca00c6ec0 0x7f5ca0154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35720/0 (socket says 172.21.15.102:35720) 2024-03-25T05:38:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9d400640 1 -- 172.21.15.102:0/974324006 learned_addr learned my addr 172.21.15.102:0/974324006 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9e800640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca014e4b0 0x7f5ca014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9de00640 1 -- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca00c6ec0 msgr2=0x7f5ca0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9de00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca00c6ec0 0x7f5ca0154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9de00640 1 -- 172.21.15.102:0/974324006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca014e4b0 msgr2=0x7f5ca014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9de00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca014e4b0 0x7f5ca014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9de00640 1 -- 172.21.15.102:0/974324006 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9800f050 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.369+0000 7f5c9de00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c5bd0 0x7f5ca0153040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c90005880 tx=0x7f5c9000c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.370+0000 7f5c96000640 1 -- 172.21.15.102:0/974324006 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90005ce0 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.370+0000 7f5c96000640 1 -- 172.21.15.102:0/974324006 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90005e60 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.370+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c009400 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.370+0000 7f5c96000640 1 -- 172.21.15.102:0/974324006 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90007310 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.370+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca0152b20 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.371+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca00686c0 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.372+0000 7f5c96000640 1 -- 172.21.15.102:0/974324006 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c90007470 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.373+0000 7f5c96000640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5c8006b890 0x7f5c8006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.373+0000 7f5c96000640 1 -- 172.21.15.102:0/974324006 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5c90089ae0 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.373+0000 7f5c9d400640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5c8006b890 0x7f5c8006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.374+0000 7f5c9d400640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5c8006b890 0x7f5c8006dd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ca014bbb0 tx=0x7f5c8c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:08.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.377+0000 7f5c96000640 1 -- 172.21.15.102:0/974324006 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5c900541c0 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.623+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5ca00ccd90 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.623+0000 7f5c96000640 1 -- 172.21.15.102:0/974324006 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5c900170a0 con 0x7f5ca00c5bd0 2024-03-25T05:38:08.617 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T05:38:08.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5c8006b890 msgr2=0x7f5c8006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5c8006b890 0x7f5c8006dd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ca014bbb0 tx=0x7f5c8c03c040 comp rx=0 tx=0).stop 2024-03-25T05:38:08.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c5bd0 msgr2=0x7f5ca0153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c5bd0 0x7f5ca0153040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c90005880 tx=0x7f5c9000c870 comp rx=0 tx=0).stop 2024-03-25T05:38:08.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 shutdown_connections 2024-03-25T05:38:08.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f5c8006b890 0x7f5c8006dd50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca014e4b0 0x7f5ca014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca00c6ec0 0x7f5ca0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 --2- 172.21.15.102:0/974324006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca00c5bd0 0x7f5ca0153040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 >> 172.21.15.102:0/974324006 conn(0x7f5ca00cc4c0 msgr2=0x7f5ca00ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:08.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 shutdown_connections 2024-03-25T05:38:08.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.626+0000 7f5ca4e00640 1 -- 172.21.15.102:0/974324006 wait complete. 2024-03-25T05:38:08.637 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T05:38:08.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.813+0000 7fe2cd400640 1 Processor -- start 2024-03-25T05:38:08.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.813+0000 7fe2cd400640 1 -- start start 2024-03-25T05:38:08.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2cd400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe2c80c5940 0x7fe2c80ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2cd400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe2c80c7940 0x7fe2c80c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2cd400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c80c82d0 con 0x7fe2c80c6240 2024-03-25T05:38:08.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2cd400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c80caa10 con 0x7fe2c80c5940 2024-03-25T05:38:08.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2cd400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c815a060 con 0x7fe2c80c7940 2024-03-25T05:38:08.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2c6800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe2c80c5940 0x7fe2c80ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2c7200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe2c80c7940 0x7fe2c80c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2c7200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe2c80c7940 0x7fe2c80c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35730/0 (socket says 172.21.15.102:35730) 2024-03-25T05:38:08.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.815+0000 7fe2c7200640 1 -- 172.21.15.102:0/1527843073 learned_addr learned my addr 172.21.15.102:0/1527843073 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:08.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.816+0000 7fe2c7200640 1 -- 172.21.15.102:0/1527843073 >> v2:172.21.15.102:3300/0 conn(0x7fe2c80c5940 msgr2=0x7fe2c80ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:08.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.816+0000 7fe2c5e00640 1 -- 172.21.15.102:0/1527843073 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303894933 0 0) 0x7fe2c80c82d0 con 0x7fe2c80c6240 2024-03-25T05:38:08.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.816+0000 7fe2c7200640 1 --2- 172.21.15.102:0/1527843073 >> v2:172.21.15.102:3300/0 conn(0x7fe2c80c5940 0x7fe2c80ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.816+0000 7fe2c7200640 1 -- 172.21.15.102:0/1527843073 >> v1:172.21.15.102:6789/0 conn(0x7fe2c80c6240 legacy=0x7fe2c80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.816+0000 7fe2c7200640 1 -- 172.21.15.102:0/1527843073 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c815a340 con 0x7fe2c80c7940 2024-03-25T05:38:08.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.816+0000 7fe2c6800640 1 --2- 172.21.15.102:0/1527843073 >> v2:172.21.15.102:3300/0 conn(0x7fe2c80c5940 0x7fe2c80ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:08.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.817+0000 7fe2c7200640 1 --2- 172.21.15.102:0/1527843073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c7940 0x7fe2c80c7d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80ca440 tx=0x7fe2c002bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a72cb844354b31e server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:08.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2c5e00640 1 -- 172.21.15.102:0/1527843073 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c002cb10 con 0x7fe2c80c7940 2024-03-25T05:38:08.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2c5e00640 1 -- 172.21.15.102:0/1527843073 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c002cc70 con 0x7fe2c80c7940 2024-03-25T05:38:08.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2c5e00640 1 -- 172.21.15.102:0/1527843073 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00343f0 con 0x7fe2c80c7940 2024-03-25T05:38:08.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 -- 172.21.15.102:0/1527843073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c7940 msgr2=0x7fe2c80c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 --2- 172.21.15.102:0/1527843073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c7940 0x7fe2c80c7d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80ca440 tx=0x7fe2c002bf70 comp rx=0 tx=0).stop 2024-03-25T05:38:08.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 -- 172.21.15.102:0/1527843073 shutdown_connections 2024-03-25T05:38:08.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 --2- 172.21.15.102:0/1527843073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c7940 0x7fe2c80c7d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 --2- 172.21.15.102:0/1527843073 >> v2:172.21.15.102:3300/0 conn(0x7fe2c80c5940 0x7fe2c80ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 -- 172.21.15.102:0/1527843073 >> 172.21.15.102:0/1527843073 conn(0x7fe2c80728c0 msgr2=0x7fe2c806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:08.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 -- 172.21.15.102:0/1527843073 shutdown_connections 2024-03-25T05:38:08.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.818+0000 7fe2cd400640 1 -- 172.21.15.102:0/1527843073 wait complete. 2024-03-25T05:38:08.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.820+0000 7fe2cd400640 1 Processor -- start 2024-03-25T05:38:08.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.820+0000 7fe2cd400640 1 -- start start 2024-03-25T05:38:08.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2cd400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c5940 0x7fe2c81f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2cd400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c80c6240 0x7fe2c80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2cd400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c80c7940 0x7fe2c81f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2cd400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81e2f40 con 0x7fe2c80c6240 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2cd400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81529c0 con 0x7fe2c80c5940 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2cd400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81f3640 con 0x7fe2c80c7940 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2c6800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c5940 0x7fe2c81f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2c6800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c5940 0x7fe2c81f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35732/0 (socket says 172.21.15.102:35732) 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2c6800640 1 -- 172.21.15.102:0/2466121727 learned_addr learned my addr 172.21.15.102:0/2466121727 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2c7200640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c80c7940 0x7fe2c81f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.821+0000 7fe2bfe00640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c80c6240 0x7fe2c80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2c6800640 1 -- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c80c7940 msgr2=0x7fe2c81f05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2c6800640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c80c7940 0x7fe2c81f05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2c6800640 1 -- 172.21.15.102:0/2466121727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c80c6240 msgr2=0x7fe2c80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:08.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2c6800640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c80c6240 0x7fe2c80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:08.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2c6800640 1 -- 172.21.15.102:0/2466121727 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8009400 con 0x7fe2c80c5940 2024-03-25T05:38:08.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2c6800640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c5940 0x7fe2c81f3100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ebe0 tx=0x7fe2b800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:08.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2bea00640 1 -- 172.21.15.102:0/2466121727 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8009760 con 0x7fe2c80c5940 2024-03-25T05:38:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2bea00640 1 -- 172.21.15.102:0/2466121727 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800cbd0 con 0x7fe2c80c5940 2024-03-25T05:38:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2bea00640 1 -- 172.21.15.102:0/2466121727 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800eee0 con 0x7fe2c80c5940 2024-03-25T05:38:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c0009b30 con 0x7fe2c80c5940 2024-03-25T05:38:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.822+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c81e2350 con 0x7fe2c80c5940 2024-03-25T05:38:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.824+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c8067fb0 con 0x7fe2c80c5940 2024-03-25T05:38:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.824+0000 7fe2bea00640 1 -- 172.21.15.102:0/2466121727 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe2b8013470 con 0x7fe2c80c5940 2024-03-25T05:38:08.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.825+0000 7fe2bea00640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe2a406b840 0x7fe2a406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:08.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.825+0000 7fe2bea00640 1 -- 172.21.15.102:0/2466121727 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe2b808a7e0 con 0x7fe2c80c5940 2024-03-25T05:38:08.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.825+0000 7fe2bfe00640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe2a406b840 0x7fe2a406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.826+0000 7fe2bfe00640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe2a406b840 0x7fe2a406dd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80cbba0 tx=0x7fe2b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:08.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:08.829+0000 7fe2bea00640 1 -- 172.21.15.102:0/2466121727 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe2b8054e40 con 0x7fe2c80c5940 2024-03-25T05:38:09.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.059+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2c80cafd0 con 0x7fe2c80c5940 2024-03-25T05:38:09.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.060+0000 7fe2bea00640 1 -- 172.21.15.102:0/2466121727 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6654 (secure 0 0 0) 0x7fe2b8058500 con 0x7fe2c80c5940 2024-03-25T05:38:09.054 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:09.054 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:57.547664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4291,"mds_1":4273,"mds_2":4270,"mds_3":4250,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4270":{"gid":4270,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4244,4270,4250,4273,4291]},"id":1}]} 2024-03-25T05:38:09.054 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe2a406b840 msgr2=0x7fe2a406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe2a406b840 0x7fe2a406dd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80cbba0 tx=0x7fe2b0009040 comp rx=0 tx=0).stop 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c5940 msgr2=0x7fe2c81f3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c5940 0x7fe2c81f3100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ebe0 tx=0x7fe2b800c520 comp rx=0 tx=0).stop 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 shutdown_connections 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fe2a406b840 0x7fe2a406dd00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c80c7940 0x7fe2c81f05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c80c6240 0x7fe2c80ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 --2- 172.21.15.102:0/2466121727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c80c5940 0x7fe2c81f3100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 >> 172.21.15.102:0/2466121727 conn(0x7fe2c80728c0 msgr2=0x7fe2c80c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:09.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 shutdown_connections 2024-03-25T05:38:09.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.063+0000 7fe2cd400640 1 -- 172.21.15.102:0/2466121727 wait complete. 2024-03-25T05:38:09.075 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T05:38:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.265+0000 7f228ea00640 1 Processor -- start 2024-03-25T05:38:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.265+0000 7f228ea00640 1 -- start start 2024-03-25T05:38:09.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f228ea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22880cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f228ea00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228815a060 con 0x7f22880c5940 2024-03-25T05:38:09.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f228ea00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228815a340 con 0x7f22880cfcc0 2024-03-25T05:38:09.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f228ea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228815a620 con 0x7f22880c6240 2024-03-25T05:38:09.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f228ca00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f22880cfcc0 0x7f22880c7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40512/0 (socket says 172.21.15.102:40512) 2024-03-25T05:38:09.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f228ca00640 1 -- 172.21.15.102:0/2942527091 learned_addr learned my addr 172.21.15.102:0/2942527091 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:09.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f227fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22880cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f2287400640 1 -- 172.21.15.102:0/2942527091 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755579066 0 0) 0x7f228815a340 con 0x7f22880cfcc0 2024-03-25T05:38:09.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f227fe00640 1 -- 172.21.15.102:0/2942527091 >> v1:172.21.15.187:6789/0 conn(0x7f22880cfcc0 legacy=0x7f22880c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f227fe00640 1 -- 172.21.15.102:0/2942527091 >> v1:172.21.15.102:6789/0 conn(0x7f22880c5940 legacy=0x7f22880ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.267+0000 7f227fe00640 1 -- 172.21.15.102:0/2942527091 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228815a900 con 0x7f22880c6240 2024-03-25T05:38:09.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.268+0000 7f227fe00640 1 --2- 172.21.15.102:0/2942527091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22880cf780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22700097d0 tx=0x7f227002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7afb718a39185b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:09.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f2287400640 1 -- 172.21.15.102:0/2942527091 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270030800 con 0x7f22880c6240 2024-03-25T05:38:09.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f2287400640 1 -- 172.21.15.102:0/2942527091 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2270030960 con 0x7f22880c6240 2024-03-25T05:38:09.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f2287400640 1 -- 172.21.15.102:0/2942527091 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270030cf0 con 0x7f22880c6240 2024-03-25T05:38:09.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f228ea00640 1 -- 172.21.15.102:0/2942527091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 msgr2=0x7f22880cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f228ea00640 1 --2- 172.21.15.102:0/2942527091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22880cf780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22700097d0 tx=0x7f227002b940 comp rx=0 tx=0).stop 2024-03-25T05:38:09.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f228ea00640 1 -- 172.21.15.102:0/2942527091 shutdown_connections 2024-03-25T05:38:09.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f228ea00640 1 --2- 172.21.15.102:0/2942527091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22880cf780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f228ea00640 1 -- 172.21.15.102:0/2942527091 >> 172.21.15.102:0/2942527091 conn(0x7f22880728c0 msgr2=0x7f228806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:09.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f228ea00640 1 -- 172.21.15.102:0/2942527091 shutdown_connections 2024-03-25T05:38:09.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.269+0000 7f228ea00640 1 -- 172.21.15.102:0/2942527091 wait complete. 2024-03-25T05:38:09.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.271+0000 7f228ea00640 1 Processor -- start 2024-03-25T05:38:09.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.271+0000 7f228ea00640 1 -- start start 2024-03-25T05:38:09.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f228ea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22880c5940 0x7f22881ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f228ea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22881f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f228ea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cfcc0 0x7f2288152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f228ea00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288151a10 con 0x7f22880cfcc0 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f228ea00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288150ad0 con 0x7f22880c5940 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f228ea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2288150d90 con 0x7f22880c6240 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f2287e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22880c5940 0x7f22881ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f2287e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22880c5940 0x7f22881ef9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35734/0 (socket says 172.21.15.102:35734) 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f2287e00640 1 -- 172.21.15.102:0/2949421919 learned_addr learned my addr 172.21.15.102:0/2949421919 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f227fe00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22881f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.272+0000 7f228ca00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cfcc0 0x7f2288152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2287e00640 1 -- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 msgr2=0x7f22881f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2287e00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22881f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2287e00640 1 -- 172.21.15.102:0/2949421919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cfcc0 msgr2=0x7f2288152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2287e00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cfcc0 0x7f2288152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2287e00640 1 -- 172.21.15.102:0/2949421919 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270009400 con 0x7f22880c5940 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2287e00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22880c5940 0x7f22881ef9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f227800c450 tx=0x7f227800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:09.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2284c00640 1 -- 172.21.15.102:0/2949421919 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780052d0 con 0x7f22880c5940 2024-03-25T05:38:09.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2284c00640 1 -- 172.21.15.102:0/2949421919 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278005430 con 0x7f22880c5940 2024-03-25T05:38:09.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22880c5ea0 con 0x7f22880c5940 2024-03-25T05:38:09.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f2284c00640 1 -- 172.21.15.102:0/2949421919 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278012870 con 0x7f22880c5940 2024-03-25T05:38:09.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.273+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288151350 con 0x7f22880c5940 2024-03-25T05:38:09.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.275+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2288151b50 con 0x7f22880c5940 2024-03-25T05:38:09.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.277+0000 7f2284c00640 1 -- 172.21.15.102:0/2949421919 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f22780129d0 con 0x7f22880c5940 2024-03-25T05:38:09.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.277+0000 7f2284c00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f226406b810 0x7f226406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.277+0000 7f2284c00640 1 -- 172.21.15.102:0/2949421919 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2278089f20 con 0x7f22880c5940 2024-03-25T05:38:09.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.278+0000 7f227fe00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f226406b810 0x7f226406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.278+0000 7f227fe00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f226406b810 0x7f226406dcd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2270036000 tx=0x7f2270008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:09.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.286+0000 7f2284c00640 1 -- 172.21.15.102:0/2949421919 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2288151b50 con 0x7f22880c5940 2024-03-25T05:38:09.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.512+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2288151b50 con 0x7f22880c5940 2024-03-25T05:38:09.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.514+0000 7f2284c00640 1 -- 172.21.15.102:0/2949421919 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f2278054690 con 0x7f22880c5940 2024-03-25T05:38:09.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:09.509 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":25,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:37:37.426493+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.517+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f226406b810 msgr2=0x7f226406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.517+0000 7f228ea00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f226406b810 0x7f226406dcd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2270036000 tx=0x7f2270008030 comp rx=0 tx=0).stop 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.517+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22880c5940 msgr2=0x7f22881ef9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.517+0000 7f228ea00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22880c5940 0x7f22881ef9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f227800c450 tx=0x7f227800c910 comp rx=0 tx=0).stop 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 shutdown_connections 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f226406b810 0x7f226406dcd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cfcc0 0x7f2288152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22880c6240 0x7f22881f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 --2- 172.21.15.102:0/2949421919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22880c5940 0x7f22881ef9f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 >> 172.21.15.102:0/2949421919 conn(0x7f22880728c0 msgr2=0x7f22880cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 shutdown_connections 2024-03-25T05:38:09.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.518+0000 7f228ea00640 1 -- 172.21.15.102:0/2949421919 wait complete. 2024-03-25T05:38:09.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T05:38:09.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.711+0000 7fac00a00640 1 Processor -- start 2024-03-25T05:38:09.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.711+0000 7fac00a00640 1 -- start start 2024-03-25T05:38:09.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.712+0000 7fac00a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc154120 0x7fabfc0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.712+0000 7fac00a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fabfc0c6c10 0x7fabfc0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.712+0000 7fac00a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0cbbe0 con 0x7fabfc0c67e0 2024-03-25T05:38:09.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.712+0000 7fac00a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc154500 con 0x7fabfc0c6c10 2024-03-25T05:38:09.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.712+0000 7fac00a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc06b250 con 0x7fabfc154120 2024-03-25T05:38:09.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfa800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc154120 0x7fabfc0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfb200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fabfc0c6c10 0x7fabfc0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfa800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc154120 0x7fabfc0cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53452/0 (socket says 172.21.15.102:53452) 2024-03-25T05:38:09.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfa800640 1 -- 172.21.15.102:0/3535057618 learned_addr learned my addr 172.21.15.102:0/3535057618 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:09.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfa800640 1 -- 172.21.15.102:0/3535057618 >> v2:172.21.15.187:3300/0 conn(0x7fabfc0c6c10 msgr2=0x7fabfc0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:09.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfa800640 1 --2- 172.21.15.102:0/3535057618 >> v2:172.21.15.187:3300/0 conn(0x7fabfc0c6c10 0x7fabfc0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfa800640 1 -- 172.21.15.102:0/3535057618 >> v1:172.21.15.102:6789/0 conn(0x7fabfc0c67e0 legacy=0x7fabfc0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.713+0000 7fabfa800640 1 -- 172.21.15.102:0/3535057618 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0ca280 con 0x7fabfc154120 2024-03-25T05:38:09.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.714+0000 7fabfa800640 1 --2- 172.21.15.102:0/3535057618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc154120 0x7fabfc0cb000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabec009870 tx=0x7fabec02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ffe9e676aab1faa server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.714+0000 7fabf9e00640 1 -- 172.21.15.102:0/3535057618 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec030840 con 0x7fabfc154120 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fabf9e00640 1 -- 172.21.15.102:0/3535057618 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec0309a0 con 0x7fabfc154120 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fabf9e00640 1 -- 172.21.15.102:0/3535057618 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec030d30 con 0x7fabfc154120 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 -- 172.21.15.102:0/3535057618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc154120 msgr2=0x7fabfc0cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 --2- 172.21.15.102:0/3535057618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc154120 0x7fabfc0cb000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabec009870 tx=0x7fabec02b980 comp rx=0 tx=0).stop 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 -- 172.21.15.102:0/3535057618 shutdown_connections 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 --2- 172.21.15.102:0/3535057618 >> v2:172.21.15.187:3300/0 conn(0x7fabfc0c6c10 0x7fabfc0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 --2- 172.21.15.102:0/3535057618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc154120 0x7fabfc0cb000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 -- 172.21.15.102:0/3535057618 >> 172.21.15.102:0/3535057618 conn(0x7fabfc0cf3e0 msgr2=0x7fabfc0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 -- 172.21.15.102:0/3535057618 shutdown_connections 2024-03-25T05:38:09.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.715+0000 7fac00a00640 1 -- 172.21.15.102:0/3535057618 wait complete. 2024-03-25T05:38:09.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.717+0000 7fac00a00640 1 Processor -- start 2024-03-25T05:38:09.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.717+0000 7fac00a00640 1 -- start start 2024-03-25T05:38:09.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fac00a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabfc0c67e0 0x7fabfc1ef350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fac00a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc0c6c10 0x7fabfc156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fac00a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabfc154120 0x7fabfc1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fac00a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc156060 con 0x7fabfc154120 2024-03-25T05:38:09.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fac00a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc156290 con 0x7fabfc0c67e0 2024-03-25T05:38:09.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fac00a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc1f3800 con 0x7fabfc0c6c10 2024-03-25T05:38:09.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabfc0c67e0 0x7fabfc1ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabfc0c67e0 0x7fabfc1ef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35742/0 (socket says 172.21.15.102:35742) 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 -- 172.21.15.102:0/772305626 learned_addr learned my addr 172.21.15.102:0/772305626 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabf3e00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc0c6c10 0x7fabfc156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfb200640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabfc154120 0x7fabfc1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 -- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc0c6c10 msgr2=0x7fabfc156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc0c6c10 0x7fabfc156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 -- 172.21.15.102:0/772305626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabfc154120 msgr2=0x7fabfc1523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabfc154120 0x7fabfc1523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfa800640 1 -- 172.21.15.102:0/772305626 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0094d0 con 0x7fabfc0c67e0 2024-03-25T05:38:09.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.718+0000 7fabfb200640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabfc154120 0x7fabfc1523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:38:09.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.719+0000 7fabfa800640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabfc0c67e0 0x7fabfc1ef350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fabec000c00 tx=0x7fabec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:09.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.719+0000 7fabf2a00640 1 -- 172.21.15.102:0/772305626 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec039a90 con 0x7fabfc0c67e0 2024-03-25T05:38:09.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.719+0000 7fabf2a00640 1 -- 172.21.15.102:0/772305626 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec039c10 con 0x7fabfc0c67e0 2024-03-25T05:38:09.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.719+0000 7fabf2a00640 1 -- 172.21.15.102:0/772305626 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec043410 con 0x7fabfc0c67e0 2024-03-25T05:38:09.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.719+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc157580 con 0x7fabfc0c67e0 2024-03-25T05:38:09.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.719+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc1f3490 con 0x7fabfc0c67e0 2024-03-25T05:38:09.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.720+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc14e9f0 con 0x7fabfc0c67e0 2024-03-25T05:38:09.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.721+0000 7fabf2a00640 1 -- 172.21.15.102:0/772305626 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fabec04c3b0 con 0x7fabfc0c67e0 2024-03-25T05:38:09.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.722+0000 7fabf2a00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fabd806b810 0x7fabd806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:09.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.722+0000 7fabf2a00640 1 -- 172.21.15.102:0/772305626 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fabec0ac8d0 con 0x7fabfc0c67e0 2024-03-25T05:38:09.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.722+0000 7fabf3e00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fabd806b810 0x7fabd806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:09.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.723+0000 7fabf3e00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fabd806b810 0x7fabd806dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fabfc155ff0 tx=0x7fabe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:09.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.730+0000 7fabf2a00640 1 -- 172.21.15.102:0/772305626 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fabec076fc0 con 0x7fabfc0c67e0 2024-03-25T05:38:09.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.960+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabfc04f2f0 con 0x7fabfc0c67e0 2024-03-25T05:38:09.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.961+0000 7fabf2a00640 1 -- 172.21.15.102:0/772305626 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6654 (secure 0 0 0) 0x7fabec07a680 con 0x7fabfc0c67e0 2024-03-25T05:38:09.955 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T05:38:09.956 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:57.547664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4291,"mds_1":4273,"mds_2":4270,"mds_3":4250,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4270":{"gid":4270,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4244,4270,4250,4273,4291]},"id":1}]} 2024-03-25T05:38:09.956 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fabd806b810 msgr2=0x7fabd806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fabd806b810 0x7fabd806dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fabfc155ff0 tx=0x7fabe4009040 comp rx=0 tx=0).stop 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabfc0c67e0 msgr2=0x7fabfc1ef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabfc0c67e0 0x7fabfc1ef350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fabec000c00 tx=0x7fabec004730 comp rx=0 tx=0).stop 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 shutdown_connections 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fabd806b810 0x7fabd806dcd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabfc154120 0x7fabfc1523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabfc0c6c10 0x7fabfc156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 --2- 172.21.15.102:0/772305626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabfc0c67e0 0x7fabfc1ef350 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.963+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 >> 172.21.15.102:0/772305626 conn(0x7fabfc0cf3e0 msgr2=0x7fabfc0c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.964+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 shutdown_connections 2024-03-25T05:38:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:09.964+0000 7fac00a00640 1 -- 172.21.15.102:0/772305626 wait complete. 2024-03-25T05:38:10.586 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-25T05:37:30.879451+0000', 'modified': '2024-03-25T05:37:57.547664+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4291, 'mds_1': 4273, 'mds_2': 4270, 'mds_3': 4250, 'mds_4': 4244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4244': {'gid': 4244, 'name': 'a', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.102:6833/3221573983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 3221573983}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 3221573983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4250': {'gid': 4250, 'name': 'c', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.102:6837/1662064342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 1662064342}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 1662064342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.187:6837/3691197003', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6835', 'nonce': 3691197003}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 3691197003}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4273': {'gid': 4273, 'name': 'f', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.187:6839/3721745292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 3721745292}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 3721745292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4291': {'gid': 4291, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6835/2568369315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 2568369315}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 2568369315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4291, 'qdb_cluster': [4244, 4270, 4250, 4273, 4291]} 2024-03-25T05:38:10.586 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-25T05:38:10.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-25T05:38:10.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.774+0000 7f3247e00640 1 Processor -- start 2024-03-25T05:38:10.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.774+0000 7f3247e00640 1 -- start start 2024-03-25T05:38:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.775+0000 7f3247e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32480c5c60 0x7f32481517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3247e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480c7120 con 0x7f32480c6040 2024-03-25T05:38:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3247e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3248072870 con 0x7f3248158370 2024-03-25T05:38:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3247e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480c7400 con 0x7f32480c5c60 2024-03-25T05:38:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3246a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32480c5c60 0x7f32481517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3246a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32480c5c60 0x7f32481517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35758/0 (socket says 172.21.15.102:35758) 2024-03-25T05:38:10.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3246a00640 1 -- 172.21.15.102:0/2732844641 learned_addr learned my addr 172.21.15.102:0/2732844641 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:10.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3246a00640 1 -- 172.21.15.102:0/2732844641 >> v1:172.21.15.187:6789/0 conn(0x7f3248158370 legacy=0x7f3248162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3246a00640 1 -- 172.21.15.102:0/2732844641 >> v1:172.21.15.102:6789/0 conn(0x7f32480c6040 legacy=0x7f3248157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.776+0000 7f3246a00640 1 -- 172.21.15.102:0/2732844641 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248072b50 con 0x7f32480c5c60 2024-03-25T05:38:10.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.777+0000 7f3246a00640 1 --2- 172.21.15.102:0/2732844641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481517a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3238009870 tx=0x7f323802ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab33a8136bf34cf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:10.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3245600640 1 -- 172.21.15.102:0/2732844641 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323802f850 con 0x7f32480c5c60 2024-03-25T05:38:10.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3245600640 1 -- 172.21.15.102:0/2732844641 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323802f9b0 con 0x7f32480c5c60 2024-03-25T05:38:10.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3245600640 1 -- 172.21.15.102:0/2732844641 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323802fd40 con 0x7f32480c5c60 2024-03-25T05:38:10.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3247e00640 1 -- 172.21.15.102:0/2732844641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 msgr2=0x7f32481517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3247e00640 1 --2- 172.21.15.102:0/2732844641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481517a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3238009870 tx=0x7f323802ba30 comp rx=0 tx=0).stop 2024-03-25T05:38:10.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3247e00640 1 -- 172.21.15.102:0/2732844641 shutdown_connections 2024-03-25T05:38:10.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3247e00640 1 --2- 172.21.15.102:0/2732844641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481517a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3247e00640 1 -- 172.21.15.102:0/2732844641 >> 172.21.15.102:0/2732844641 conn(0x7f324806c0c0 msgr2=0x7f324806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:10.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3247e00640 1 -- 172.21.15.102:0/2732844641 shutdown_connections 2024-03-25T05:38:10.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.778+0000 7f3247e00640 1 -- 172.21.15.102:0/2732844641 wait complete. 2024-03-25T05:38:10.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.780+0000 7f3247e00640 1 Processor -- start 2024-03-25T05:38:10.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.780+0000 7f3247e00640 1 -- start start 2024-03-25T05:38:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3247e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3247e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32480c6040 0x7f32480cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3247e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3248158370 0x7f32481ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3247e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3248073210 con 0x7f32480c6040 2024-03-25T05:38:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3247e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32480c4b60 con 0x7f32480c5c60 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3247e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32480c37e0 con 0x7f3248158370 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3246a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3246a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481f01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35766/0 (socket says 172.21.15.102:35766) 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3246000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32480c6040 0x7f32480cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3246a00640 1 -- 172.21.15.102:0/3587828435 learned_addr learned my addr 172.21.15.102:0/3587828435 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.781+0000 7f3247400640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3248158370 0x7f32481ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3246a00640 1 -- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3248158370 msgr2=0x7f32481ddc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3246a00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3248158370 0x7f32481ddc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3246a00640 1 -- 172.21.15.102:0/3587828435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32480c6040 msgr2=0x7f32480cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3246a00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32480c6040 0x7f32480cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3246a00640 1 -- 172.21.15.102:0/3587828435 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32380094d0 con 0x7f32480c5c60 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3247400640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3248158370 0x7f32481ddc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3246a00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481f01c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f323802ba70 tx=0x7f3238004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:10.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f323ea00640 1 -- 172.21.15.102:0/3587828435 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323802f820 con 0x7f32480c5c60 2024-03-25T05:38:10.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f323ea00640 1 -- 172.21.15.102:0/3587828435 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3238042480 con 0x7f32480c5c60 2024-03-25T05:38:10.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f323ea00640 1 -- 172.21.15.102:0/3587828435 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238042850 con 0x7f32480c5c60 2024-03-25T05:38:10.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32480c3ac0 con 0x7f32480c5c60 2024-03-25T05:38:10.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.782+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32480c4080 con 0x7f32480c5c60 2024-03-25T05:38:10.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.784+0000 7f323ea00640 1 -- 172.21.15.102:0/3587828435 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f323802d3e0 con 0x7f32480c5c60 2024-03-25T05:38:10.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.786+0000 7f323ea00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f322806b810 0x7f322806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.786+0000 7f323ea00640 1 -- 172.21.15.102:0/3587828435 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f323803c070 con 0x7f32480c5c60 2024-03-25T05:38:10.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.786+0000 7f3246000640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f322806b810 0x7f322806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.786+0000 7f3246000640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f322806b810 0x7f322806dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3248150d20 tx=0x7f3234009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:10.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 Processor -- start 2024-03-25T05:38:10.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 -- start start 2024-03-25T05:38:10.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d44ca450 0x5644d450c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d450ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d4439fb0 con 0x5644d450bd90 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d44374e0 con 0x5644d450b9b0 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.787+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644d4432cc0 con 0x5644d44ca450 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d44ca450 0x5644d450c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3247400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d450ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d44ca450 0x5644d450c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53484/0 (socket says 172.21.15.102:53484) 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 -- 172.21.15.102:0/1951869510 learned_addr learned my addr 172.21.15.102:0/1951869510 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246a00640 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 -- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 msgr2=0x5644d44cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 -- 172.21.15.102:0/1951869510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 msgr2=0x5644d450ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d450ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.788+0000 7f3246000640 1 -- 172.21.15.102:0/1951869510 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644d43fa4c0 con 0x5644d44ca450 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f3246000640 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d44ca450 0x5644d450c370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f323400f980 tx=0x7f3234012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a863f4cdd351d4e server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f3233400640 1 -- 172.21.15.102:0/1951869510 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234006e10 con 0x5644d44ca450 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f3233400640 1 -- 172.21.15.102:0/1951869510 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234007030 con 0x5644d44ca450 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f3233400640 1 -- 172.21.15.102:0/1951869510 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340073a0 con 0x5644d44ca450 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f32507fa740 1 -- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d44ca450 msgr2=0x5644d450c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f32507fa740 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d44ca450 0x5644d450c370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f323400f980 tx=0x7f3234012000 comp rx=0 tx=0).stop 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f32507fa740 1 -- 172.21.15.102:0/1951869510 shutdown_connections 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f32507fa740 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d450ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f32507fa740 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d44ca450 0x5644d450c370 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f32507fa740 1 --2- 172.21.15.102:0/1951869510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.789+0000 7f32507fa740 1 -- 172.21.15.102:0/1951869510 >> 172.21.15.102:0/1951869510 conn(0x5644d44c75c0 msgr2=0x5644d44cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:10.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.790+0000 7f32507fa740 1 -- 172.21.15.102:0/1951869510 shutdown_connections 2024-03-25T05:38:10.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.790+0000 7f32507fa740 1 -- 172.21.15.102:0/1951869510 wait complete. 2024-03-25T05:38:10.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.790+0000 7f32507fa740 1 -- start start 2024-03-25T05:38:10.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.790+0000 7f32507fa740 1 Processor -- start 2024-03-25T05:38:10.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.791+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d451ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.791+0000 7f32507fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d4513850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.791+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d45079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.791+0000 7f32507fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d43d7ea0 con 0x5644d450bd90 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.791+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d43d7b40 con 0x5644d450b9b0 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.791+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644d417af20 con 0x5644d45081d0 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f32507fa740 10 client.0 _ll_register_callbacks cb 0x5644d4143ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d451ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d451ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35786/0 (socket says 172.21.15.102:35786) 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 -- 172.21.15.102:0/1020056854 learned_addr learned my addr 172.21.15.102:0/1020056854 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246000640 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d4513850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3247400640 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d45079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 -- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 msgr2=0x5644d45079c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d45079c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 -- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 msgr2=0x5644d4513850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d4513850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 -- 172.21.15.102:0/1020056854 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32480c7120 con 0x5644d450b9b0 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.792+0000 7f3246a00640 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d451ed60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3238000c00 tx=0x7f323807b210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1fbc6d9498b8b21 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f3227e00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f3227e00640 1 -- 172.21.15.102:0/1020056854 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323807a720 con 0x5644d450b9b0 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f3227e00640 1 -- 172.21.15.102:0/1020056854 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3238092030 con 0x5644d450b9b0 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644d41326c0 con 0x5644d450b9b0 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f3227e00640 1 -- 172.21.15.102:0/1020056854 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f323807a880 con 0x5644d450b9b0 2024-03-25T05:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 10 client.4840 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5644d4431340 con 0x5644d450b9b0 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f3227e00640 1 -- 172.21.15.102:0/1020056854 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644d41326c0 con 0x5644d450b9b0 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f3227e00640 1 -- 172.21.15.102:0/1020056854 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7f3238035020 con 0x5644d450b9b0 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 10 client.4840 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 10 client.4840 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 20 client.4840 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d4506a80 0x5644d452a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 4 client.4840 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.793+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 --> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644d4183270 con 0x5644d4506a80 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.794+0000 7f3246000640 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d4506a80 0x5644d452a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.794+0000 7f3246000640 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d4506a80 0x5644d452a3e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3684a825a464868f server_cookie=8d5c13f3fad5fd13 in_seq=0 out_seq=0 2024-03-25T05:38:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.794+0000 7f3227e00640 10 client.4840 ms_handle_connect on v2:172.21.15.102:6832/3221573983 2024-03-25T05:38:10.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f3227e00640 1 -- 172.21.15.102:0/1020056854 <== mds.4 v2:172.21.15.102:6832/3221573983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5644d4183270 con 0x5644d4506a80 2024-03-25T05:38:10.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f3227e00640 10 client.4840 handle_command_reply: tid=0 2024-03-25T05:38:10.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 client.4840 shutdown 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 msgr2=0x5644d451ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d451ed60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3238000c00 tx=0x7f323807b210 comp rx=0 tx=0).stop 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 shutdown_connections 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d4506a80 0x5644d452a3e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d45079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450bd90 0x5644d4513850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f3227e00640 0 client.4840 ms_handle_reset on v2:172.21.15.102:6832/3221573983 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.795+0000 7f32507fa740 1 --2- 172.21.15.102:0/1020056854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d451ed60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.796+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 >> 172.21.15.102:0/1020056854 conn(0x5644d44ca450 msgr2=0x5644d44f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.796+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 shutdown_connections 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.796+0000 7f32507fa740 1 -- 172.21.15.102:0/1020056854 wait complete. 2024-03-25T05:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.796+0000 7f32507fa740 20 client.4840 trim_cache size 0 max 16384 2024-03-25T05:38:10.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.818+0000 7f32507fa740 1 Processor -- start 2024-03-25T05:38:10.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.819+0000 7f32507fa740 1 -- start start 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d450a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f32507fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450b9b0 0x5644d450a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450bd90 0x5644d44f3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f32507fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d4506610 con 0x5644d450b9b0 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d4512cf0 con 0x5644d450bd90 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644d452f7e0 con 0x5644d45081d0 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f3246a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d450a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f3246000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450b9b0 0x5644d450a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f3246a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d450a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53500/0 (socket says 172.21.15.102:53500) 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f3246a00640 1 -- 172.21.15.102:0/623393106 learned_addr learned my addr 172.21.15.102:0/623393106 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f3247400640 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450bd90 0x5644d44f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.820+0000 7f3246a00640 1 -- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450bd90 msgr2=0x5644d44f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3246a00640 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450bd90 0x5644d44f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3246a00640 1 -- 172.21.15.102:0/623393106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450b9b0 msgr2=0x5644d450a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3246a00640 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450b9b0 0x5644d450a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3246a00640 1 -- 172.21.15.102:0/623393106 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644d44f2e80 con 0x5644d45081d0 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3247400640 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450bd90 0x5644d44f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3246a00640 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d450a000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3238006d80 tx=0x7f323804d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be35978b680d011f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3232a00640 1 -- 172.21.15.102:0/623393106 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323807ac10 con 0x5644d45081d0 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3232a00640 1 -- 172.21.15.102:0/623393106 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3238079490 con 0x5644d45081d0 2024-03-25T05:38:10.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.821+0000 7f3232a00640 1 -- 172.21.15.102:0/623393106 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323807a720 con 0x5644d45081d0 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 -- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 msgr2=0x5644d450a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d450a000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3238006d80 tx=0x7f323804d000 comp rx=0 tx=0).stop 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 -- 172.21.15.102:0/623393106 shutdown_connections 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450bd90 0x5644d44f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d450b9b0 0x5644d450a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 --2- 172.21.15.102:0/623393106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d45081d0 0x5644d450a000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 -- 172.21.15.102:0/623393106 >> 172.21.15.102:0/623393106 conn(0x5644d44ca450 msgr2=0x5644d4507710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 -- 172.21.15.102:0/623393106 shutdown_connections 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.822+0000 7f32507fa740 1 -- 172.21.15.102:0/623393106 wait complete. 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.823+0000 7f32507fa740 1 -- start start 2024-03-25T05:38:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.823+0000 7f32507fa740 1 Processor -- start 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f32507fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d45081d0 0x5644d44cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f32507fa740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d450bd90 0x5644d4575180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f32507fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d4505950 con 0x5644d45081d0 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d44f4070 con 0x5644d450b9b0 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f32507fa740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644d457e8a0 con 0x5644d450bd90 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f32507fa740 10 client.0 _ll_register_callbacks cb 0x7f32380091c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d45081d0 0x5644d44cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44f3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35810/0 (socket says 172.21.15.102:35810) 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 -- 172.21.15.102:0/3106284708 learned_addr learned my addr 172.21.15.102:0/3106284708 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d45081d0 0x5644d44cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60476/0 (socket says 172.21.15.102:60476) 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3247400640 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d450bd90 0x5644d4575180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 -- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d450bd90 msgr2=0x5644d4575180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d450bd90 0x5644d4575180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 -- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d45081d0 msgr2=0x5644d44cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d45081d0 0x5644d44cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246000640 1 -- 172.21.15.102:0/3106284708 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644d4431340 con 0x5644d450b9b0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.824+0000 7f3246a00640 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d45081d0 0x5644d44cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f3246000640 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44f3b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5644d450c8b0 tx=0x7f3234000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9521b05b58feb4d server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f3227e00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f3227e00640 1 -- 172.21.15.102:0/3106284708 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234020420 con 0x5644d450b9b0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f3227e00640 1 -- 172.21.15.102:0/3106284708 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f323401b050 con 0x5644d450b9b0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644d4507570 con 0x5644d450b9b0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f3227e00640 1 -- 172.21.15.102:0/3106284708 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3234020580 con 0x5644d450b9b0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f32507fa740 10 client.4843 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5644d43cd8b0 con 0x5644d450b9b0 2024-03-25T05:38:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.825+0000 7f3227e00640 1 -- 172.21.15.102:0/3106284708 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644d4507570 con 0x5644d450b9b0 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f3227e00640 1 -- 172.21.15.102:0/3106284708 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7f3234012070 con 0x5644d450b9b0 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f32507fa740 10 client.4843 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f32507fa740 10 client.4843 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f32507fa740 20 client.4843 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f32507fa740 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d450e8f0 0x5644d450ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f32507fa740 4 client.4843 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 --> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f3234007030 con 0x5644d450e8f0 2024-03-25T05:38:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f3246a00640 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d450e8f0 0x5644d450ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:10.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f3246a00640 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d450e8f0 0x5644d450ecd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cab46219e65b09ee server_cookie=f1339e46a2ed9d6d in_seq=0 out_seq=0 2024-03-25T05:38:10.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.826+0000 7f3227e00640 10 client.4843 ms_handle_connect on v2:172.21.15.102:6832/3221573983 2024-03-25T05:38:10.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f3227e00640 1 -- 172.21.15.102:0/3106284708 <== mds.4 v2:172.21.15.102:6832/3221573983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f3234007030 con 0x5644d450e8f0 2024-03-25T05:38:10.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f3227e00640 10 client.4843 handle_command_reply: tid=0 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 client.4843 shutdown 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 msgr2=0x5644d44f3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44f3b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5644d450c8b0 tx=0x7f3234000ed0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 shutdown_connections 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:6832/3221573983,v1:172.21.15.102:6833/3221573983] conn(0x5644d450e8f0 0x5644d450ecd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5644d450bd90 0x5644d4575180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f3227e00640 0 client.4843 ms_handle_reset on v2:172.21.15.102:6832/3221573983 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5644d450b9b0 0x5644d44f3b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 --2- 172.21.15.102:0/3106284708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644d45081d0 0x5644d44cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 >> 172.21.15.102:0/3106284708 conn(0x5644d44ca450 msgr2=0x5644d4513450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 shutdown_connections 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 1 -- 172.21.15.102:0/3106284708 wait complete. 2024-03-25T05:38:10.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.827+0000 7f32507fa740 20 client.4843 trim_cache size 0 max 16384 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "ad358596-5ce1-459c-a1bc-1e91bde83a5b", 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 4, 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4244, 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 14.279711851, 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 17, 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 25, 2024-03-25T05:38:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 25, 2024-03-25T05:38:10.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 44.763208124999998 2024-03-25T05:38:10.827 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T05:38:10.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f322806b810 msgr2=0x7f322806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f322806b810 0x7f322806dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3248150d20 tx=0x7f3234009040 comp rx=0 tx=0).stop 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 msgr2=0x7f32481f01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481f01c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f323802ba70 tx=0x7f3238004730 comp rx=0 tx=0).stop 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 shutdown_connections 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f322806b810 0x7f322806dcd0 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3248150d20 tx=0x7f3234009040 comp rx=0 tx=0).stop 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3248158370 0x7f32481ddc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32480c6040 0x7f32480cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 --2- 172.21.15.102:0/3587828435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32480c5c60 0x7f32481f01c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 >> 172.21.15.102:0/3587828435 conn(0x7f324806c0c0 msgr2=0x7f324806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 shutdown_connections 2024-03-25T05:38:10.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:10.828+0000 7f3247e00640 1 -- 172.21.15.102:0/3587828435 wait complete. 2024-03-25T05:38:10.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-25T05:38:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.022+0000 7ff8be600640 1 Processor -- start 2024-03-25T05:38:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.022+0000 7ff8be600640 1 -- start start 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.023+0000 7ff8be600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff8b80c6c10 0x7ff8b8165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.023+0000 7ff8be600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b80cbbe0 con 0x7ff8b8154120 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.023+0000 7ff8be600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b80ca280 con 0x7ff8b80c67e0 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.023+0000 7ff8be600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b8154500 con 0x7ff8b80c6c10 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.023+0000 7ff8afe00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff8b80c67e0 0x7ff8b80c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40534/0 (socket says 172.21.15.102:40534) 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.023+0000 7ff8afe00640 1 -- 172.21.15.102:0/3330113582 learned_addr learned my addr 172.21.15.102:0/3330113582 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.024+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/3330113582 >> v2:172.21.15.102:3300/0 conn(0x7ff8b80c6c10 0x7ff8b8165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.024+0000 7ff8b7e00640 1 -- 172.21.15.102:0/3330113582 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041536502 0 0) 0x7ff8b80ca280 con 0x7ff8b80c67e0 2024-03-25T05:38:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.024+0000 7ff8b7e00640 1 -- 172.21.15.102:0/3330113582 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff89c003520 con 0x7ff8b80c67e0 2024-03-25T05:38:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.024+0000 7ff8bdc00640 1 -- 172.21.15.102:0/3330113582 >> v1:172.21.15.187:6789/0 conn(0x7ff8b80c67e0 legacy=0x7ff8b80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.024+0000 7ff8bdc00640 1 -- 172.21.15.102:0/3330113582 >> v1:172.21.15.102:6789/0 conn(0x7ff8b8154120 legacy=0x7ff8b80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.024+0000 7ff8b7e00640 1 -- 172.21.15.102:0/3330113582 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408110741 0 0) 0x7ff8b80cbbe0 con 0x7ff8b8154120 2024-03-25T05:38:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.024+0000 7ff8bdc00640 1 -- 172.21.15.102:0/3330113582 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b815aac0 con 0x7ff8b80c6c10 2024-03-25T05:38:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.025+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/3330113582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c6c10 0x7ff8b8165590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009d90 tx=0x7ff8b002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ddd045fbb36903 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8b7e00640 1 -- 172.21.15.102:0/3330113582 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b002cd00 con 0x7ff8b80c6c10 2024-03-25T05:38:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8b7e00640 1 -- 172.21.15.102:0/3330113582 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b002ce60 con 0x7ff8b80c6c10 2024-03-25T05:38:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8b7e00640 1 -- 172.21.15.102:0/3330113582 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0034640 con 0x7ff8b80c6c10 2024-03-25T05:38:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8be600640 1 -- 172.21.15.102:0/3330113582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c6c10 msgr2=0x7ff8b8165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8be600640 1 --2- 172.21.15.102:0/3330113582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c6c10 0x7ff8b8165590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009d90 tx=0x7ff8b002bf50 comp rx=0 tx=0).stop 2024-03-25T05:38:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8be600640 1 -- 172.21.15.102:0/3330113582 shutdown_connections 2024-03-25T05:38:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8be600640 1 --2- 172.21.15.102:0/3330113582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c6c10 0x7ff8b8165590 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.026+0000 7ff8be600640 1 -- 172.21.15.102:0/3330113582 >> 172.21.15.102:0/3330113582 conn(0x7ff8b80cf3e0 msgr2=0x7ff8b80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.027+0000 7ff8be600640 1 -- 172.21.15.102:0/3330113582 shutdown_connections 2024-03-25T05:38:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.027+0000 7ff8be600640 1 -- 172.21.15.102:0/3330113582 wait complete. 2024-03-25T05:38:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.028+0000 7ff8be600640 1 Processor -- start 2024-03-25T05:38:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.028+0000 7ff8be600640 1 -- start start 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.029+0000 7ff8be600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c67e0 0x7ff8b8157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.029+0000 7ff8be600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b80c6c10 0x7ff8b81506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.029+0000 7ff8be600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b8154120 0x7ff8b8150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.029+0000 7ff8be600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b814f300 con 0x7ff8b80c67e0 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.029+0000 7ff8be600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b814fdb0 con 0x7ff8b80c6c10 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.029+0000 7ff8be600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8150210 con 0x7ff8b8154120 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c67e0 0x7ff8b8157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b8154120 0x7ff8b8150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8afe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b80c6c10 0x7ff8b81506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b8154120 0x7ff8b8150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53522/0 (socket says 172.21.15.102:53522) 2024-03-25T05:38:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 -- 172.21.15.102:0/3482171778 learned_addr learned my addr 172.21.15.102:0/3482171778 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 -- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b80c6c10 msgr2=0x7ff8b81506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b80c6c10 0x7ff8b81506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 -- 172.21.15.102:0/3482171778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c67e0 msgr2=0x7ff8b8157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c67e0 0x7ff8b8157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 -- 172.21.15.102:0/3482171778 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0009a70 con 0x7ff8b8154120 2024-03-25T05:38:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.030+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b8154120 0x7ff8b8150c10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009d90 tx=0x7ff8b0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.031+0000 7ff8b5600640 1 -- 172.21.15.102:0/3482171778 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0004800 con 0x7ff8b8154120 2024-03-25T05:38:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.031+0000 7ff8b5600640 1 -- 172.21.15.102:0/3482171778 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0009450 con 0x7ff8b8154120 2024-03-25T05:38:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.031+0000 7ff8b5600640 1 -- 172.21.15.102:0/3482171778 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0040670 con 0x7ff8b8154120 2024-03-25T05:38:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.031+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b814f510 con 0x7ff8b8154120 2024-03-25T05:38:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.031+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b814fad0 con 0x7ff8b8154120 2024-03-25T05:38:11.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.034+0000 7ff8b5600640 1 -- 172.21.15.102:0/3482171778 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8b00407d0 con 0x7ff8b8154120 2024-03-25T05:38:11.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.034+0000 7ff8c282e740 1 Processor -- start 2024-03-25T05:38:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.034+0000 7ff8c282e740 1 -- start start 2024-03-25T05:38:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8b5600640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff89406b840 0x7ff89406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8b5600640 1 -- 172.21.15.102:0/3482171778 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff8b00ad100 con 0x7ff8b8154120 2024-03-25T05:38:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8afe00640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff89406b840 0x7ff89406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6feba9b0 0x55ca6fe7a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6fe79450 0x55ca6febb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feb9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8c282e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fde8fb0 con 0x55ca6febad90 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fde64e0 con 0x55ca6fe79450 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fde1cc0 con 0x55ca6feba9b0 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.035+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6feba9b0 0x55ca6fe7a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6feba9b0 0x55ca6fe7a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53532/0 (socket says 172.21.15.102:53532) 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 -- 172.21.15.102:0/2085253667 learned_addr learned my addr 172.21.15.102:0/2085253667 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8afe00640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff89406b840 0x7ff89406dd00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8b81501a0 tx=0x7ff8a0007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8afe00640 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6fe79450 0x55ca6febb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feb9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 -- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6fe79450 msgr2=0x55ca6febb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6fe79450 0x55ca6febb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 -- 172.21.15.102:0/2085253667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 msgr2=0x55ca6feb9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feb9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 -- 172.21.15.102:0/2085253667 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6fda94c0 con 0x55ca6feba9b0 2024-03-25T05:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feb9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8bd200640 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6feba9b0 0x55ca6fe7a750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80018a0 tx=0x7ff8a8007db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26ea9cd04e106f57 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8ad600640 1 -- 172.21.15.102:0/2085253667 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8001370 con 0x55ca6feba9b0 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8ad600640 1 -- 172.21.15.102:0/2085253667 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80052e0 con 0x55ca6feba9b0 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.036+0000 7ff8ad600640 1 -- 172.21.15.102:0/2085253667 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800fa90 con 0x55ca6feba9b0 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 -- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6feba9b0 msgr2=0x55ca6fe7a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6feba9b0 0x55ca6fe7a750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80018a0 tx=0x7ff8a8007db0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 -- 172.21.15.102:0/2085253667 shutdown_connections 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feb9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6fe79450 0x55ca6febb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 --2- 172.21.15.102:0/2085253667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6feba9b0 0x55ca6fe7a750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 -- 172.21.15.102:0/2085253667 >> 172.21.15.102:0/2085253667 conn(0x55ca6fe765c0 msgr2=0x55ca6fe79d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 -- 172.21.15.102:0/2085253667 shutdown_connections 2024-03-25T05:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.037+0000 7ff8c282e740 1 -- 172.21.15.102:0/2085253667 wait complete. 2024-03-25T05:38:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.038+0000 7ff8c282e740 1 -- start start 2024-03-25T05:38:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.038+0000 7ff8c282e740 1 Processor -- start 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6fea0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6fe74730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6fe9ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8c282e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fd86ea0 con 0x55ca6febad90 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fd86b40 con 0x55ca6feba9b0 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fb29f20 con 0x55ca6febe880 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8c282e740 10 client.0 _ll_register_callbacks cb 0x55ca6faf2ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6fea0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6fea0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35842/0 (socket says 172.21.15.102:35842) 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8bd200640 1 -- 172.21.15.102:0/1337178528 learned_addr learned my addr 172.21.15.102:0/1337178528 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.039+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6fe9ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8afe00640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6fe74730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8bd200640 1 -- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 msgr2=0x55ca6fe9ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8bd200640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6fe9ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8bd200640 1 -- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 msgr2=0x55ca6fe74730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8bd200640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6fe74730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8bd200640 1 -- 172.21.15.102:0/1337178528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a80014d0 con 0x55ca6feba9b0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8afe00640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6fe74730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8bd200640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6fea0a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55ca6febb8b0 tx=0x7ff8a8000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ab34798b5b23b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8a6000640 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8a6000640 1 -- 172.21.15.102:0/1337178528 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80037f0 con 0x55ca6feba9b0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8a6000640 1 -- 172.21.15.102:0/1337178528 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff8a8005450 con 0x55ca6feba9b0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.040+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca6fae16c0 con 0x55ca6feba9b0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8a6000640 1 -- 172.21.15.102:0/1337178528 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8a8007a70 con 0x55ca6feba9b0 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 10 client.4855 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ca6fde0340 con 0x55ca6feba9b0 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8a6000640 1 -- 172.21.15.102:0/1337178528 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca6fae16c0 con 0x55ca6feba9b0 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8a6000640 1 -- 172.21.15.102:0/1337178528 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7ff8a8012070 con 0x55ca6feba9b0 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 10 client.4855 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 10 client.4855 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 20 client.4855 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6fe97960 0x55ca6fed9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 4 client.4855 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 --> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca6fb32270 con 0x55ca6fe97960 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.041+0000 7ff8afe00640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6fe97960 0x55ca6fed9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.042+0000 7ff8a6000640 10 client.4855 ms_handle_connect on v2:172.21.15.102:6836/1662064342 2024-03-25T05:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.042+0000 7ff8afe00640 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6fe97960 0x55ca6fed9a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=727b4c8e2fd2472 server_cookie=45d2c1af0809d7ce in_seq=0 out_seq=0 2024-03-25T05:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8a6000640 1 -- 172.21.15.102:0/1337178528 <== mds.3 v2:172.21.15.102:6836/1662064342 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ca6fb32270 con 0x55ca6fe97960 2024-03-25T05:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8a6000640 10 client.4855 handle_command_reply: tid=0 2024-03-25T05:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 client.4855 shutdown 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 msgr2=0x55ca6fea0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6fea0a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55ca6febb8b0 tx=0x7ff8a8000ed0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 shutdown_connections 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6fe97960 0x55ca6fed9a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6fe9ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6fe74730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1337178528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6fea0a50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8a6000640 0 client.4855 ms_handle_reset on v2:172.21.15.102:6836/1662064342 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.043+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 >> 172.21.15.102:0/1337178528 conn(0x55ca6fe79450 msgr2=0x55ca6fe7a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.044+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 shutdown_connections 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.044+0000 7ff8c282e740 1 -- 172.21.15.102:0/1337178528 wait complete. 2024-03-25T05:38:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.044+0000 7ff8c282e740 20 client.4855 trim_cache size 0 max 16384 2024-03-25T05:38:11.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.061+0000 7ff8c282e740 1 Processor -- start 2024-03-25T05:38:11.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.062+0000 7ff8c282e740 1 -- start start 2024-03-25T05:38:11.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.062+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6feba9b0 0x55ca6fece760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.062+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febad90 0x55ca6fececa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.062+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6febe880 0x55ca6feb74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.062+0000 7ff8c282e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fe76d90 con 0x55ca6feba9b0 2024-03-25T05:38:11.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.062+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fea2730 con 0x55ca6febe880 2024-03-25T05:38:11.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.062+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fe98330 con 0x55ca6febad90 2024-03-25T05:38:11.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febad90 0x55ca6fececa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6feba9b0 0x55ca6fece760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febad90 0x55ca6fececa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53560/0 (socket says 172.21.15.102:53560) 2024-03-25T05:38:11.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 -- 172.21.15.102:0/1463021255 learned_addr learned my addr 172.21.15.102:0/1463021255 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6febe880 0x55ca6feb74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 -- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6febe880 msgr2=0x55ca6feb74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6febe880 0x55ca6feb74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 -- 172.21.15.102:0/1463021255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6feba9b0 msgr2=0x55ca6fece760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6feba9b0 0x55ca6fece760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 -- 172.21.15.102:0/1463021255 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6fd7c8b0 con 0x55ca6febad90 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6febe880 0x55ca6feb74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.063+0000 7ff8afe00640 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febad90 0x55ca6fececa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80c6bc0 tx=0x7ff8a0012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=213f78aa1718848b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8acc00640 1 -- 172.21.15.102:0/1463021255 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0028070 con 0x55ca6febad90 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8acc00640 1 -- 172.21.15.102:0/1463021255 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00160d0 con 0x55ca6febad90 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8acc00640 1 -- 172.21.15.102:0/1463021255 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0016240 con 0x55ca6febad90 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 -- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febad90 msgr2=0x55ca6fececa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febad90 0x55ca6fececa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80c6bc0 tx=0x7ff8a0012000 comp rx=0 tx=0).stop 2024-03-25T05:38:11.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 -- 172.21.15.102:0/1463021255 shutdown_connections 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6febe880 0x55ca6feb74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febad90 0x55ca6fececa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 --2- 172.21.15.102:0/1463021255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6feba9b0 0x55ca6fece760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 -- 172.21.15.102:0/1463021255 >> 172.21.15.102:0/1463021255 conn(0x55ca6fe79450 msgr2=0x55ca6fe74540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 -- 172.21.15.102:0/1463021255 shutdown_connections 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.064+0000 7ff8c282e740 1 -- 172.21.15.102:0/1463021255 wait complete. 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.065+0000 7ff8c282e740 1 -- start start 2024-03-25T05:38:11.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.066+0000 7ff8c282e740 1 Processor -- start 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6feddb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8c282e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6ff2de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8c282e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fecf0a0 con 0x55ca6febad90 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fe77740 con 0x55ca6feba9b0 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8c282e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca6fe9af60 con 0x55ca6febe880 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8c282e740 10 client.0 _ll_register_callbacks cb 0x7ff8a0017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6feddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8bd200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6feddb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35850/0 (socket says 172.21.15.102:35850) 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8bd200640 1 -- 172.21.15.102:0/3657879885 learned_addr learned my addr 172.21.15.102:0/3657879885 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.067+0000 7ff8bdc00640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6ff2de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8afe00640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8bd200640 1 -- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 msgr2=0x55ca6ff2de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8bd200640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6ff2de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8bd200640 1 -- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 msgr2=0x55ca6feceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8bd200640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8bd200640 1 -- 172.21.15.102:0/3657879885 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b814fad0 con 0x55ca6feba9b0 2024-03-25T05:38:11.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8afe00640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:11.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8bd200640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6feddb10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8001170 tx=0x7ff8a8009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5885067ea8c83f1c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8a6000640 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2024-03-25T05:38:11.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8a6000640 1 -- 172.21.15.102:0/3657879885 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8036070 con 0x55ca6feba9b0 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8a6000640 1 -- 172.21.15.102:0/3657879885 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff8a8005450 con 0x55ca6feba9b0 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.068+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca6fec40c0 con 0x55ca6feba9b0 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8a6000640 1 -- 172.21.15.102:0/3657879885 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8a8007a70 con 0x55ca6feba9b0 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 10 client.4861 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7ff8a0019040 con 0x55ca6feba9b0 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8a6000640 1 -- 172.21.15.102:0/3657879885 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca6fec40c0 con 0x55ca6feba9b0 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8a6000640 1 -- 172.21.15.102:0/3657879885 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7ff8a8039020 con 0x55ca6feba9b0 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 10 client.4861 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 10 client.4861 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 20 client.4861 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6ff2ea70 0x55ca6ff24230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 4 client.4861 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-25T05:38:11.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.069+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 --> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff8a80052e0 con 0x55ca6ff2ea70 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.070+0000 7ff8afe00640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6ff2ea70 0x55ca6ff24230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.070+0000 7ff8afe00640 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6ff2ea70 0x55ca6ff24230 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f3c7d16db7f3eee server_cookie=198ff8900fcfe57f in_seq=0 out_seq=0 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.070+0000 7ff8a6000640 10 client.4861 ms_handle_connect on v2:172.21.15.102:6836/1662064342 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.070+0000 7ff8a6000640 1 -- 172.21.15.102:0/3657879885 <== mds.3 v2:172.21.15.102:6836/1662064342 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7ff8a80052e0 con 0x55ca6ff2ea70 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.070+0000 7ff8a6000640 10 client.4861 handle_command_reply: tid=0 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.070+0000 7ff8c282e740 1 client.4861 shutdown 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 msgr2=0x55ca6feddb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6feddb10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8001170 tx=0x7ff8a8009040 comp rx=0 tx=0).stop 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 shutdown_connections 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:6836/1662064342,v1:172.21.15.102:6837/1662064342] conn(0x55ca6ff2ea70 0x55ca6ff24230 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ca6febe880 0x55ca6ff2de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ca6febad90 0x55ca6feceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 --2- 172.21.15.102:0/3657879885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6feba9b0 0x55ca6feddb10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8a6000640 0 client.4861 ms_handle_reset on v2:172.21.15.102:6836/1662064342 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 >> 172.21.15.102:0/3657879885 conn(0x55ca6fe79450 msgr2=0x55ca6fec3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 shutdown_connections 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 1 -- 172.21.15.102:0/3657879885 wait complete. 2024-03-25T05:38:11.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.071+0000 7ff8c282e740 20 client.4861 trim_cache size 0 max 16384 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "ad358596-5ce1-459c-a1bc-1e91bde83a5b", 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 3, 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4250, 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 15.533438917, 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 17, 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 25, 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 25, 2024-03-25T05:38:11.070 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 44.997774135999997 2024-03-25T05:38:11.071 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T05:38:11.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff89406b840 msgr2=0x7ff89406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff89406b840 0x7ff89406dd00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8b81501a0 tx=0x7ff8a0007d30 comp rx=0 tx=0).stop 2024-03-25T05:38:11.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b8154120 msgr2=0x7ff8b8150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b8154120 0x7ff8b8150c10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009d90 tx=0x7ff8b0004a40 comp rx=0 tx=0).stop 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 shutdown_connections 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff89406b840 0x7ff89406dd00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b8154120 0x7ff8b8150c10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b80c6c10 0x7ff8b81506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 --2- 172.21.15.102:0/3482171778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b80c67e0 0x7ff8b8157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 >> 172.21.15.102:0/3482171778 conn(0x7ff8b80cf3e0 msgr2=0x7ff8b80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.072+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 shutdown_connections 2024-03-25T05:38:11.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.073+0000 7ff8be600640 1 -- 172.21.15.102:0/3482171778 wait complete. 2024-03-25T05:38:11.088 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-25T05:38:11.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.273+0000 7fb6d8c00640 1 Processor -- start 2024-03-25T05:38:11.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.273+0000 7fb6d8c00640 1 -- start start 2024-03-25T05:38:11.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d8c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb6d40cfcc0 0x7fb6d40c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d8c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d415a060 con 0x7fb6d40c5940 2024-03-25T05:38:11.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d8c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d415a340 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d8c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d415a620 con 0x7fb6d40c6240 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6c9400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d1e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb6d40c5940 0x7fb6d40ca4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40536/0 (socket says 172.21.15.102:40536) 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d1e00640 1 -- 172.21.15.102:0/2541359358 learned_addr learned my addr 172.21.15.102:0/2541359358 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6d2800640 1 --2- 172.21.15.102:0/2541359358 >> v2:172.21.15.187:3300/0 conn(0x7fb6d40cfcc0 0x7fb6d40c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6c9400640 1 -- 172.21.15.102:0/2541359358 >> v2:172.21.15.187:3300/0 conn(0x7fb6d40cfcc0 msgr2=0x7fb6d40c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6c9400640 1 --2- 172.21.15.102:0/2541359358 >> v2:172.21.15.187:3300/0 conn(0x7fb6d40cfcc0 0x7fb6d40c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6c9400640 1 -- 172.21.15.102:0/2541359358 >> v1:172.21.15.187:6789/0 conn(0x7fb6d40c5940 legacy=0x7fb6d40ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.275+0000 7fb6c9400640 1 -- 172.21.15.102:0/2541359358 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d415a900 con 0x7fb6d40c6240 2024-03-25T05:38:11.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.277+0000 7fb6c9400640 1 --2- 172.21.15.102:0/2541359358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d40cf780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0097a0 tx=0x7fb6bc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a2fea2b96b05cc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.277+0000 7fb6d1400640 1 -- 172.21.15.102:0/2541359358 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc031830 con 0x7fb6d40c6240 2024-03-25T05:38:11.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.277+0000 7fb6d1400640 1 -- 172.21.15.102:0/2541359358 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc031990 con 0x7fb6d40c6240 2024-03-25T05:38:11.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.277+0000 7fb6d1400640 1 -- 172.21.15.102:0/2541359358 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc031d20 con 0x7fb6d40c6240 2024-03-25T05:38:11.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 -- 172.21.15.102:0/2541359358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 msgr2=0x7fb6d40cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/2541359358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d40cf780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0097a0 tx=0x7fb6bc02b8d0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 -- 172.21.15.102:0/2541359358 shutdown_connections 2024-03-25T05:38:11.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/2541359358 >> v2:172.21.15.187:3300/0 conn(0x7fb6d40cfcc0 0x7fb6d40c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/2541359358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d40cf780 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 -- 172.21.15.102:0/2541359358 >> 172.21.15.102:0/2541359358 conn(0x7fb6d40728c0 msgr2=0x7fb6d406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 -- 172.21.15.102:0/2541359358 shutdown_connections 2024-03-25T05:38:11.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.278+0000 7fb6d8c00640 1 -- 172.21.15.102:0/2541359358 wait complete. 2024-03-25T05:38:11.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.281+0000 7fb6d8c00640 1 Processor -- start 2024-03-25T05:38:11.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.281+0000 7fb6d8c00640 1 -- start start 2024-03-25T05:38:11.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6d8c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d40c5940 0x7fb6d41f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6d8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d4153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6d8c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6d40cfcc0 0x7fb6d41540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6d8c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40cf190 con 0x7fb6d40c5940 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6d8c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d41e5650 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6d8c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d41e6770 con 0x7fb6d40c6240 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6c9400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d4153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.282+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d40c5940 0x7fb6d41f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6d40cfcc0 0x7fb6d41540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6d40cfcc0 0x7fb6d41540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35872/0 (socket says 172.21.15.102:35872) 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 -- 172.21.15.102:0/948576584 learned_addr learned my addr 172.21.15.102:0/948576584 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6c9400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d4153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53598/0 (socket says 172.21.15.102:53598) 2024-03-25T05:38:11.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 -- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 msgr2=0x7fb6d4153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d4153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 -- 172.21.15.102:0/948576584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d40c5940 msgr2=0x7fb6d41f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d40c5940 0x7fb6d41f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 -- 172.21.15.102:0/948576584 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc009400 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6d2800640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6d40cfcc0 0x7fb6d41540c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00efc0 tx=0x7fb6cc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.283+0000 7fb6caa00640 1 -- 172.21.15.102:0/948576584 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc009ba0 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.284+0000 7fb6caa00640 1 -- 172.21.15.102:0/948576584 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc00f040 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.284+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d40c5ea0 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.284+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d41e5b60 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.284+0000 7fb6caa00640 1 -- 172.21.15.102:0/948576584 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0146c0 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.287+0000 7fb6caa00640 1 -- 172.21.15.102:0/948576584 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb6cc014820 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.287+0000 7fb6caa00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6b006b840 0x7fb6b006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.287+0000 7fb6caa00640 1 -- 172.21.15.102:0/948576584 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb6cc08b250 con 0x7fb6d40cfcc0 2024-03-25T05:38:11.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.288+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6b006b840 0x7fb6b006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.288+0000 7fb6db97e740 1 Processor -- start 2024-03-25T05:38:11.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.288+0000 7fb6db97e740 1 -- start start 2024-03-25T05:38:11.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.288+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6b006b840 0x7fb6b006dd00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007fd0 tx=0x7fb6c4007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb06520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb05220 0x55e11cb47140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb45a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6db97e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11ca74fb0 con 0x55e11cb46b60 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11ca724e0 con 0x55e11cb05220 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e11ca6dcc0 con 0x55e11cb46780 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb06520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb06520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53608/0 (socket says 172.21.15.102:53608) 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3479505237 learned_addr learned my addr 172.21.15.102:0/3479505237 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6c9400640 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb05220 0x55e11cb47140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.289+0000 7fb6d2800640 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb45a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb05220 msgr2=0x55e11cb47140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb05220 0x55e11cb47140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3479505237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 msgr2=0x55e11cb45a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb45a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3479505237 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e11ca354c0 con 0x55e11cb46780 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6d2800640 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb45a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb06520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40016c0 tx=0x7fb6c4013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b43d141f5af9049 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6c2600640 1 -- 172.21.15.102:0/3479505237 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4013900 con 0x55e11cb46780 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6c2600640 1 -- 172.21.15.102:0/3479505237 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4013a60 con 0x55e11cb46780 2024-03-25T05:38:11.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.290+0000 7fb6c2600640 1 -- 172.21.15.102:0/3479505237 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4013df0 con 0x55e11cb46780 2024-03-25T05:38:11.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 -- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 msgr2=0x55e11cb06520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb06520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40016c0 tx=0x7fb6c4013000 comp rx=0 tx=0).stop 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 -- 172.21.15.102:0/3479505237 shutdown_connections 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb45a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb05220 0x55e11cb47140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3479505237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb06520 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 -- 172.21.15.102:0/3479505237 >> 172.21.15.102:0/3479505237 conn(0x55e11cb02390 msgr2=0x55e11cb05b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 -- 172.21.15.102:0/3479505237 shutdown_connections 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 -- 172.21.15.102:0/3479505237 wait complete. 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.291+0000 7fb6db97e740 1 -- start start 2024-03-25T05:38:11.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.292+0000 7fb6db97e740 1 Processor -- start 2024-03-25T05:38:11.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb58a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb4dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb43690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6db97e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11ca12ea0 con 0x55e11cb46b60 2024-03-25T05:38:11.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11ca12b40 con 0x55e11cb4e400 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e11c7b5f20 con 0x55e11cb46780 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6db97e740 10 client.0 _ll_register_callbacks cb 0x55e11c77eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb58a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.293+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb58a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53620/0 (socket says 172.21.15.102:53620) 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3469102185 learned_addr learned my addr 172.21.15.102:0/3469102185 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6c9400640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb4dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d2800640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb43690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 msgr2=0x55e11cb43690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb43690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3469102185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 msgr2=0x55e11cb4dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb4dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d1e00640 1 -- 172.21.15.102:0/3469102185 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d415a060 con 0x55e11cb46780 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d2800640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb43690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb58a50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4024040 tx=0x7fb6c4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd348d21956d07b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.294+0000 7fb6b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3301/0 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3469102185 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4013900 con 0x55e11cb46780 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3469102185 <== mon.2 v2:172.21.15.187:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb6c401b050 con 0x55e11cb46780 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e11c76d6c0 con 0x55e11cb46780 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3469102185 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6c40222e0 con 0x55e11cb46780 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 10 client.4691 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e11ca6c340 con 0x55e11cb46780 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3469102185 <== mon.2 v2:172.21.15.187:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e11c76d6c0 con 0x55e11cb46780 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3469102185 <== mon.2 v2:172.21.15.187:3301/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7fb6c4012070 con 0x55e11cb46780 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 10 client.4691 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 10 client.4691 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 20 client.4691 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb5aa60 0x55e11cb2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 4 client.4691 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-25T05:38:11.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.295+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 --> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e11c7be270 con 0x55e11cb5aa60 2024-03-25T05:38:11.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.296+0000 7fb6c9400640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb5aa60 0x55e11cb2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.296+0000 7fb6c9400640 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb5aa60 0x55e11cb2d120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89a6216f4d23cfd2 server_cookie=feaf44944ec5a7ce in_seq=0 out_seq=0 2024-03-25T05:38:11.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.296+0000 7fb6b6a00640 10 client.4691 ms_handle_connect on v2:172.21.15.187:6835/3691197003 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.297+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3469102185 <== mds.2 v2:172.21.15.187:6835/3691197003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e11c7be270 con 0x55e11cb5aa60 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.297+0000 7fb6b6a00640 10 client.4691 handle_command_reply: tid=0 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.297+0000 7fb6db97e740 1 client.4691 shutdown 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.297+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 msgr2=0x55e11cb58a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.297+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb58a50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4024040 tx=0x7fb6c4000bc0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 shutdown_connections 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb5aa60 0x55e11cb2d120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb43690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb4dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6b6a00640 0 client.4691 ms_handle_reset on v2:172.21.15.187:6835/3691197003 2024-03-25T05:38:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3469102185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb58a50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 >> 172.21.15.102:0/3469102185 conn(0x55e11cb05220 msgr2=0x55e11cb459d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 shutdown_connections 2024-03-25T05:38:11.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 1 -- 172.21.15.102:0/3469102185 wait complete. 2024-03-25T05:38:11.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.298+0000 7fb6db97e740 20 client.4691 trim_cache size 0 max 16384 2024-03-25T05:38:11.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.315+0000 7fb6db97e740 1 Processor -- start 2024-03-25T05:38:11.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.316+0000 7fb6db97e740 1 -- start start 2024-03-25T05:38:11.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.316+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb59440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.316+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb59980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.316+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb45140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.316+0000 7fb6db97e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11cb43a00 con 0x55e11cb46b60 2024-03-25T05:38:11.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.316+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11ca6cdc0 con 0x55e11cb4e400 2024-03-25T05:38:11.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.316+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e11cb4dd20 con 0x55e11cb46780 2024-03-25T05:38:11.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb59440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d2800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb45140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb59440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53622/0 (socket says 172.21.15.102:53622) 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 -- 172.21.15.102:0/883606693 learned_addr learned my addr 172.21.15.102:0/883606693 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6c9400640 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb59980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 -- 172.21.15.102:0/883606693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 msgr2=0x55e11cb45140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb45140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 -- 172.21.15.102:0/883606693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 msgr2=0x55e11cb59980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb59980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 -- 172.21.15.102:0/883606693 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e11cb42be0 con 0x55e11cb46780 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb59440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4013900 tx=0x7fb6c402b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99ff7f564240f3e server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.317+0000 7fb6c1c00640 1 -- 172.21.15.102:0/883606693 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c402b270 con 0x55e11cb46780 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6c1c00640 1 -- 172.21.15.102:0/883606693 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400b020 con 0x55e11cb46780 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6c1c00640 1 -- 172.21.15.102:0/883606693 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40224e0 con 0x55e11cb46780 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 -- 172.21.15.102:0/883606693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 msgr2=0x55e11cb59440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb59440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4013900 tx=0x7fb6c402b000 comp rx=0 tx=0).stop 2024-03-25T05:38:11.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 -- 172.21.15.102:0/883606693 shutdown_connections 2024-03-25T05:38:11.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb45140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46b60 0x55e11cb59980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 --2- 172.21.15.102:0/883606693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46780 0x55e11cb59440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 -- 172.21.15.102:0/883606693 >> 172.21.15.102:0/883606693 conn(0x55e11cb05220 msgr2=0x55e11cb40590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 -- 172.21.15.102:0/883606693 shutdown_connections 2024-03-25T05:38:11.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.318+0000 7fb6db97e740 1 -- 172.21.15.102:0/883606693 wait complete. 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.319+0000 7fb6db97e740 1 -- start start 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.319+0000 7fb6db97e740 1 Processor -- start 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46780 0x55e11cbb0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46b60 0x55e11cbb9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6db97e740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb25de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6db97e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11cbba620 con 0x55e11cb46780 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e11cb03e40 con 0x55e11cb4e400 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6db97e740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e11cbba150 con 0x55e11cb46b60 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6db97e740 10 client.0 _ll_register_callbacks cb 0x7fb6c4024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6c9400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46b60 0x55e11cbb9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6c9400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46b60 0x55e11cbb9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53636/0 (socket says 172.21.15.102:53636) 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6c9400640 1 -- 172.21.15.102:0/3058705801 learned_addr learned my addr 172.21.15.102:0/3058705801 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6d1e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46780 0x55e11cbb0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.320+0000 7fb6d2800640 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb25de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6c9400640 1 -- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 msgr2=0x55e11cb25de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6c9400640 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb25de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6c9400640 1 -- 172.21.15.102:0/3058705801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46780 msgr2=0x55e11cbb0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6c9400640 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46780 0x55e11cbb0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6c9400640 1 -- 172.21.15.102:0/3058705801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e11ca6c340 con 0x55e11cb46b60 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6c9400640 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46b60 0x55e11cbb9c10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc000c00 tx=0x7fb6bc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dacf6920e2c3b779 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3301/0 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3058705801 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc03f040 con 0x55e11cb46b60 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3058705801 <== mon.2 v2:172.21.15.187:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb6bc004360 con 0x55e11cb46b60 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6c4013a60 con 0x55e11cb46b60 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3058705801 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6bc004520 con 0x55e11cb46b60 2024-03-25T05:38:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6db97e740 10 client.4697 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.321+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e11ca088b0 con 0x55e11cb46b60 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3058705801 <== mon.2 v2:172.21.15.187:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4013a60 con 0x55e11cb46b60 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3058705801 <== mon.2 v2:172.21.15.187:3301/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7fb6bc045040 con 0x55e11cb46b60 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6db97e740 10 client.4697 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6db97e740 10 client.4697 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6db97e740 20 client.4697 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb452d0 0x55e11cb456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6db97e740 4 client.4697 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 --> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e11c7aa610 con 0x55e11cb452d0 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.322+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb452d0 0x55e11cb456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6d1e00640 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb452d0 0x55e11cb456b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b52efb22ea1a4828 server_cookie=6f2f887af6961ed9 in_seq=0 out_seq=0 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6b6a00640 10 client.4697 ms_handle_connect on v2:172.21.15.187:6835/3691197003 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6b6a00640 1 -- 172.21.15.102:0/3058705801 <== mds.2 v2:172.21.15.187:6835/3691197003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e11c7aa610 con 0x55e11cb452d0 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6b6a00640 10 client.4697 handle_command_reply: tid=0 2024-03-25T05:38:11.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 client.4697 shutdown 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46b60 msgr2=0x55e11cbb9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46b60 0x55e11cbb9c10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc000c00 tx=0x7fb6bc004730 comp rx=0 tx=0).stop 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 shutdown_connections 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:6835/3691197003,v1:172.21.15.187:6837/3691197003] conn(0x55e11cb452d0 0x55e11cb456b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e11cb4e400 0x55e11cb25de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e11cb46b60 0x55e11cbb9c10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6b6a00640 0 client.4697 ms_handle_reset on v2:172.21.15.187:6835/3691197003 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 --2- 172.21.15.102:0/3058705801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e11cb46780 0x55e11cbb0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 >> 172.21.15.102:0/3058705801 conn(0x55e11cb05220 msgr2=0x55e11cb591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 shutdown_connections 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.323+0000 7fb6db97e740 1 -- 172.21.15.102:0/3058705801 wait complete. 2024-03-25T05:38:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6db97e740 20 client.4697 trim_cache size 0 max 16384 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "ad358596-5ce1-459c-a1bc-1e91bde83a5b", 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 2, 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4270, 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 16.800942929000001, 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 17, 2024-03-25T05:38:11.322 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 25, 2024-03-25T05:38:11.323 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 25, 2024-03-25T05:38:11.323 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 45.313016584000003 2024-03-25T05:38:11.323 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T05:38:11.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6b006b840 msgr2=0x7fb6b006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6b006b840 0x7fb6b006dd00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007fd0 tx=0x7fb6c4007e80 comp rx=0 tx=0).stop 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6d40cfcc0 msgr2=0x7fb6d41540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6d40cfcc0 0x7fb6d41540c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00efc0 tx=0x7fb6cc00c490 comp rx=0 tx=0).stop 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 shutdown_connections 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6b006b840 0x7fb6b006dd00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6d40cfcc0 0x7fb6d41540c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6d40c6240 0x7fb6d4153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 --2- 172.21.15.102:0/948576584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d40c5940 0x7fb6d41f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 >> 172.21.15.102:0/948576584 conn(0x7fb6d40728c0 msgr2=0x7fb6d406be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.324+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 shutdown_connections 2024-03-25T05:38:11.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.325+0000 7fb6d8c00640 1 -- 172.21.15.102:0/948576584 wait complete. 2024-03-25T05:38:11.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-25T05:38:11.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.565+0000 7f8d32c00640 1 Processor -- start 2024-03-25T05:38:11.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.565+0000 7f8d32c00640 1 -- start start 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.566+0000 7f8d32c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8d2c0c67e0 0x7f8d2c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.566+0000 7f8d32c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c0c6c10 0x7f8d2c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.566+0000 7f8d32c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c0cbbe0 con 0x7f8d2c154120 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.566+0000 7f8d32c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c154500 con 0x7f8d2c0c67e0 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.566+0000 7f8d32c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c06b250 con 0x7f8d2c0c6c10 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.566+0000 7f8d31800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f8d2c154120 0x7f8d2c0cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40546/0 (socket says 172.21.15.102:40546) 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d31800640 1 -- 172.21.15.102:0/2424072251 learned_addr learned my addr 172.21.15.102:0/2424072251 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2424072251 >> v2:172.21.15.102:3300/0 conn(0x7f8d2c0c67e0 0x7f8d2c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d32200640 1 --2- 172.21.15.102:0/2424072251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c0c6c10 0x7f8d2c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d2be00640 1 -- 172.21.15.102:0/2424072251 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190980873 0 0) 0x7f8d2c0cbbe0 con 0x7f8d2c154120 2024-03-25T05:38:11.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d2be00640 1 -- 172.21.15.102:0/2424072251 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d14003520 con 0x7f8d2c154120 2024-03-25T05:38:11.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d32200640 1 -- 172.21.15.102:0/2424072251 >> v2:172.21.15.102:3300/0 conn(0x7f8d2c0c67e0 msgr2=0x7f8d2c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d32200640 1 --2- 172.21.15.102:0/2424072251 >> v2:172.21.15.102:3300/0 conn(0x7f8d2c0c67e0 0x7f8d2c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d32200640 1 -- 172.21.15.102:0/2424072251 >> v1:172.21.15.187:6789/0 conn(0x7f8d2c154120 legacy=0x7f8d2c0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d32200640 1 -- 172.21.15.102:0/2424072251 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0ca280 con 0x7f8d2c0c6c10 2024-03-25T05:38:11.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.567+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2424072251 >> v2:172.21.15.102:3300/0 conn(0x7f8d2c0c67e0 0x7f8d2c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.569+0000 7f8d32200640 1 --2- 172.21.15.102:0/2424072251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c0c6c10 0x7f8d2c0c8240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d2402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=467bfe4d52fa3827 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.569+0000 7f8d2be00640 1 -- 172.21.15.102:0/2424072251 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2402cc60 con 0x7f8d2c0c6c10 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.569+0000 7f8d2be00640 1 -- 172.21.15.102:0/2424072251 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2402cdc0 con 0x7f8d2c0c6c10 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.569+0000 7f8d2be00640 1 -- 172.21.15.102:0/2424072251 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24034660 con 0x7f8d2c0c6c10 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 -- 172.21.15.102:0/2424072251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c0c6c10 msgr2=0x7f8d2c0c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 --2- 172.21.15.102:0/2424072251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c0c6c10 0x7f8d2c0c8240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d2402beb0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 -- 172.21.15.102:0/2424072251 shutdown_connections 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 --2- 172.21.15.102:0/2424072251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c0c6c10 0x7f8d2c0c8240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 --2- 172.21.15.102:0/2424072251 >> v2:172.21.15.102:3300/0 conn(0x7f8d2c0c67e0 0x7f8d2c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 -- 172.21.15.102:0/2424072251 >> 172.21.15.102:0/2424072251 conn(0x7f8d2c0cf3e0 msgr2=0x7f8d2c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 -- 172.21.15.102:0/2424072251 shutdown_connections 2024-03-25T05:38:11.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.570+0000 7f8d32c00640 1 -- 172.21.15.102:0/2424072251 wait complete. 2024-03-25T05:38:11.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.572+0000 7f8d32c00640 1 Processor -- start 2024-03-25T05:38:11.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.572+0000 7f8d32c00640 1 -- start start 2024-03-25T05:38:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.573+0000 7f8d32c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d2c0c67e0 0x7f8d2c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.573+0000 7f8d32c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d2c0c6c10 0x7f8d2c147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.573+0000 7f8d32c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c154120 0x7f8d2c147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.573+0000 7f8d32c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0c5490 con 0x7f8d2c0c6c10 2024-03-25T05:38:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.573+0000 7f8d32c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c1f06d0 con 0x7f8d2c0c67e0 2024-03-25T05:38:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.573+0000 7f8d32c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c14a8e0 con 0x7f8d2c154120 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d31800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d2c0c67e0 0x7f8d2c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d32200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c154120 0x7f8d2c147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d31800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d2c0c67e0 0x7f8d2c159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35928/0 (socket says 172.21.15.102:35928) 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d31800640 1 -- 172.21.15.102:0/1566984067 learned_addr learned my addr 172.21.15.102:0/1566984067 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d30e00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d2c0c6c10 0x7f8d2c147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d32200640 1 -- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d2c0c67e0 msgr2=0x7f8d2c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d32200640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d2c0c67e0 0x7f8d2c159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d32200640 1 -- 172.21.15.102:0/1566984067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d2c0c6c10 msgr2=0x7f8d2c147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d32200640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d2c0c6c10 0x7f8d2c147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d32200640 1 -- 172.21.15.102:0/1566984067 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18009400 con 0x7f8d2c154120 2024-03-25T05:38:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d31800640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d2c0c67e0 0x7f8d2c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.574+0000 7f8d32200640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c154120 0x7f8d2c147d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d24033000 tx=0x7f8d24004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.575+0000 7f8d29600640 1 -- 172.21.15.102:0/1566984067 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24040650 con 0x7f8d2c154120 2024-03-25T05:38:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.575+0000 7f8d29600640 1 -- 172.21.15.102:0/1566984067 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d240407b0 con 0x7f8d2c154120 2024-03-25T05:38:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.575+0000 7f8d29600640 1 -- 172.21.15.102:0/1566984067 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24040b20 con 0x7f8d2c154120 2024-03-25T05:38:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.575+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d24009a70 con 0x7f8d2c154120 2024-03-25T05:38:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.575+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c14ab50 con 0x7f8d2c154120 2024-03-25T05:38:11.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.578+0000 7f8d29600640 1 -- 172.21.15.102:0/1566984067 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d24040c80 con 0x7f8d2c154120 2024-03-25T05:38:11.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.579+0000 7f8d3701f740 1 Processor -- start 2024-03-25T05:38:11.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.579+0000 7f8d3701f740 1 -- start start 2024-03-25T05:38:11.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.579+0000 7f8d29600640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8d0c06b810 0x7f8d0c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.579+0000 7f8d29600640 1 -- 172.21.15.102:0/1566984067 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8d240ad050 con 0x7f8d2c154120 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.579+0000 7f8d30e00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8d0c06b810 0x7f8d0c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d12478d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d12478c450 0x55d1247ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d30e00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8d0c06b810 0x7f8d0c06dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c156fc0 tx=0x7f8d18009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d3701f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1246fbfb0 con 0x55d1247cd9b0 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1246f94e0 con 0x55d12478c450 2024-03-25T05:38:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1246f4cc0 con 0x55d1247cdd90 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d30e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d12478c450 0x55d1247ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d31800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d12478d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d30e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d12478c450 0x55d1247ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35940/0 (socket says 172.21.15.102:35940) 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d30e00640 1 -- 172.21.15.102:0/151956546 learned_addr learned my addr 172.21.15.102:0/151956546 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.580+0000 7f8d32200640 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d32200640 1 -- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d12478c450 msgr2=0x55d1247ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d32200640 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d12478c450 0x55d1247ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d32200640 1 -- 172.21.15.102:0/151956546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 msgr2=0x55d12478d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d32200640 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d12478d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d32200640 1 -- 172.21.15.102:0/151956546 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1246bc4c0 con 0x55d1247cdd90 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d32200640 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247ccc90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d24045000 tx=0x7f8d2407b190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6fcf98998d5b04 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d1e000640 1 -- 172.21.15.102:0/151956546 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2407f6f0 con 0x55d1247cdd90 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d1e000640 1 -- 172.21.15.102:0/151956546 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24083cb0 con 0x55d1247cdd90 2024-03-25T05:38:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.581+0000 7f8d1e000640 1 -- 172.21.15.102:0/151956546 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24077cc0 con 0x55d1247cdd90 2024-03-25T05:38:11.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 -- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 msgr2=0x55d1247ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247ccc90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d24045000 tx=0x7f8d2407b190 comp rx=0 tx=0).stop 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 -- 172.21.15.102:0/151956546 shutdown_connections 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247ccc90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d12478c450 0x55d1247ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 --2- 172.21.15.102:0/151956546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d12478d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 -- 172.21.15.102:0/151956546 >> 172.21.15.102:0/151956546 conn(0x55d1247895c0 msgr2=0x55d12478cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 -- 172.21.15.102:0/151956546 shutdown_connections 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.582+0000 7f8d3701f740 1 -- 172.21.15.102:0/151956546 wait complete. 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.583+0000 7f8d3701f740 1 -- start start 2024-03-25T05:38:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.583+0000 7f8d3701f740 1 Processor -- start 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cd9b0 0x55d1247d5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cdd90 0x55d1247ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247d6560 0x55d1247c8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d3701f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d124699ea0 con 0x55d1247d6560 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d124699b40 con 0x55d1247cdd90 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d12443cf20 con 0x55d1247cd9b0 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d3701f740 10 client.0 _ll_register_callbacks cb 0x55d124405ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d31800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cd9b0 0x55d1247d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d31800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cd9b0 0x55d1247d5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53652/0 (socket says 172.21.15.102:53652) 2024-03-25T05:38:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d31800640 1 -- 172.21.15.102:0/834863794 learned_addr learned my addr 172.21.15.102:0/834863794 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d32200640 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247d6560 0x55d1247c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.584+0000 7f8d30e00640 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cdd90 0x55d1247ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d31800640 1 -- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cdd90 msgr2=0x55d1247ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d31800640 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cdd90 0x55d1247ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d31800640 1 -- 172.21.15.102:0/834863794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247d6560 msgr2=0x55d1247c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d31800640 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247d6560 0x55d1247c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d31800640 1 -- 172.21.15.102:0/834863794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c14ab50 con 0x55d1247cd9b0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d31800640 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cd9b0 0x55d1247d5bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d200128f0 tx=0x7f8d20012db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57b5144c83bc642d server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d12a00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3301/0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d12a00640 1 -- 172.21.15.102:0/834863794 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20005ac0 con 0x55d1247cd9b0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d12a00640 1 -- 172.21.15.102:0/834863794 <== mon.2 v2:172.21.15.187:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8d20005c20 con 0x55d1247cd9b0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1243f46c0 con 0x55d1247cd9b0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d12a00640 1 -- 172.21.15.102:0/834863794 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d20005e20 con 0x55d1247cd9b0 2024-03-25T05:38:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d3701f740 10 client.4709 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.585+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1246f3340 con 0x55d1247cd9b0 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d12a00640 1 -- 172.21.15.102:0/834863794 <== mon.2 v2:172.21.15.187:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1243f46c0 con 0x55d1247cd9b0 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d12a00640 1 -- 172.21.15.102:0/834863794 <== mon.2 v2:172.21.15.187:3301/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7f8d200070d0 con 0x55d1247cd9b0 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d3701f740 10 client.4709 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d3701f740 10 client.4709 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d3701f740 20 client.4709 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d3701f740 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d1247b4d50 0x55d1247f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d3701f740 4 client.4709 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 --> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d124445270 con 0x55d1247b4d50 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.586+0000 7f8d30e00640 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d1247b4d50 0x55d1247f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.587+0000 7f8d30e00640 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d1247b4d50 0x55d1247f4c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df6093e57d9ca675 server_cookie=ada3c08d7ce0d0b4 in_seq=0 out_seq=0 2024-03-25T05:38:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.587+0000 7f8d12a00640 10 client.4709 ms_handle_connect on v2:172.21.15.187:6838/3721745292 2024-03-25T05:38:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d12a00640 1 -- 172.21.15.102:0/834863794 <== mds.1 v2:172.21.15.187:6838/3721745292 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d124445270 con 0x55d1247b4d50 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d12a00640 10 client.4709 handle_command_reply: tid=0 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 client.4709 shutdown 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cd9b0 msgr2=0x55d1247d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cd9b0 0x55d1247d5bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d200128f0 tx=0x7f8d20012db0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 shutdown_connections 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d1247b4d50 0x55d1247f4c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247d6560 0x55d1247c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cdd90 0x55d1247ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d12a00640 0 client.4709 ms_handle_reset on v2:172.21.15.187:6838/3721745292 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 --2- 172.21.15.102:0/834863794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cd9b0 0x55d1247d5bb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 >> 172.21.15.102:0/834863794 conn(0x55d12478c450 msgr2=0x55d12478a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 shutdown_connections 2024-03-25T05:38:11.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.588+0000 7f8d3701f740 1 -- 172.21.15.102:0/834863794 wait complete. 2024-03-25T05:38:11.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.589+0000 7f8d3701f740 20 client.4709 trim_cache size 0 max 16384 2024-03-25T05:38:11.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.607+0000 7f8d3701f740 1 Processor -- start 2024-03-25T05:38:11.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.607+0000 7f8d3701f740 1 -- start start 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d1247d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247d6560 0x55d1247e6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d3701f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1246f6c40 con 0x55d1247cd9b0 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1247c9500 con 0x55d1247d6560 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d124786c10 con 0x55d1247cdd90 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d32200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247d6560 0x55d1247e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d31800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d1247d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247e6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53666/0 (socket says 172.21.15.102:53666) 2024-03-25T05:38:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d32200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247d6560 0x55d1247e6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35954/0 (socket says 172.21.15.102:35954) 2024-03-25T05:38:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 -- 172.21.15.102:0/2617456694 learned_addr learned my addr 172.21.15.102:0/2617456694 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 -- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247d6560 msgr2=0x55d1247e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247d6560 0x55d1247e6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 -- 172.21.15.102:0/2617456694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 msgr2=0x55d1247d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d1247d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d30e00640 1 -- 172.21.15.102:0/2617456694 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d12468f8b0 con 0x55d1247cdd90 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d32200640 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247d6560 0x55d1247e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.608+0000 7f8d31800640 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d1247d3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.609+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247e6000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d18016040 tx=0x7f8d18018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd156e3b1f9da23 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.609+0000 7f8d1d600640 1 -- 172.21.15.102:0/2617456694 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1802b2c0 con 0x55d1247cdd90 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.609+0000 7f8d1d600640 1 -- 172.21.15.102:0/2617456694 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18003ae0 con 0x55d1247cdd90 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.609+0000 7f8d1d600640 1 -- 172.21.15.102:0/2617456694 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18003e50 con 0x55d1247cdd90 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.609+0000 7f8d3701f740 1 -- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 msgr2=0x55d1247e6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.609+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247e6000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d18016040 tx=0x7f8d18018000 comp rx=0 tx=0).stop 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 -- 172.21.15.102:0/2617456694 shutdown_connections 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247d6560 0x55d1247e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247cdd90 0x55d1247e6000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2617456694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cd9b0 0x55d1247d3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 -- 172.21.15.102:0/2617456694 >> 172.21.15.102:0/2617456694 conn(0x55d12478c450 msgr2=0x55d1247d59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 -- 172.21.15.102:0/2617456694 shutdown_connections 2024-03-25T05:38:11.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 -- 172.21.15.102:0/2617456694 wait complete. 2024-03-25T05:38:11.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 -- start start 2024-03-25T05:38:11.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.610+0000 7f8d3701f740 1 Processor -- start 2024-03-25T05:38:11.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.611+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cd9b0 0x55d1247880c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.611+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cdd90 0x55d1247b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.611+0000 7f8d3701f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247d6560 0x55d12478c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.611+0000 7f8d3701f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1247b1e30 con 0x55d1247cdd90 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.611+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d124788c40 con 0x55d1247cd9b0 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.611+0000 7f8d3701f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d124788e90 con 0x55d1247d6560 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.611+0000 7f8d3701f740 10 client.0 _ll_register_callbacks cb 0x7f8d20001790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cd9b0 0x55d1247880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cd9b0 0x55d1247880c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35956/0 (socket says 172.21.15.102:35956) 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 -- 172.21.15.102:0/2817883459 learned_addr learned my addr 172.21.15.102:0/2817883459 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d32200640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247d6560 0x55d12478c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cdd90 0x55d1247b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 -- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247d6560 msgr2=0x55d12478c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247d6560 0x55d12478c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 -- 172.21.15.102:0/2817883459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cdd90 msgr2=0x55d1247b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cdd90 0x55d1247b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d31800640 1 -- 172.21.15.102:0/2817883459 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1246f3340 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d32200640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247d6560 0x55d12478c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.612+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cdd90 0x55d1247b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d31800640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cd9b0 0x55d1247880c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d20007360 tx=0x7f8d20015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d43685d0be400b95 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d12a00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d12a00640 1 -- 172.21.15.102:0/2817883459 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20007590 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d12a00640 1 -- 172.21.15.102:0/2817883459 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8d20005cd0 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d24083cb0 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d12a00640 1 -- 172.21.15.102:0/2817883459 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d20005e90 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 10 client.4900 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1246bc4c0 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d12a00640 1 -- 172.21.15.102:0/2817883459 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24083cb0 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d12a00640 1 -- 172.21.15.102:0/2817883459 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7f8d200047e0 con 0x55d1247cd9b0 2024-03-25T05:38:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 10 client.4900 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 10 client.4900 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 20 client.4900 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d12483f540 0x55d12483f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 4 client.4900 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.613+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 --> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d124431610 con 0x55d12483f540 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d12483f540 0x55d12483f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d30e00640 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d12483f540 0x55d12483f920 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2a732e59b603e136 server_cookie=5a2bbc4e7201fd48 in_seq=0 out_seq=0 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d12a00640 10 client.4900 ms_handle_connect on v2:172.21.15.187:6838/3721745292 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d12a00640 1 -- 172.21.15.102:0/2817883459 <== mds.1 v2:172.21.15.187:6838/3721745292 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d124431610 con 0x55d12483f540 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d12a00640 10 client.4900 handle_command_reply: tid=0 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d3701f740 1 client.4900 shutdown 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cd9b0 msgr2=0x55d1247880c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.614+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cd9b0 0x55d1247880c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d20007360 tx=0x7f8d20015000 comp rx=0 tx=0).stop 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 shutdown_connections 2024-03-25T05:38:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:6838/3721745292,v1:172.21.15.187:6839/3721745292] conn(0x55d12483f540 0x55d12483f920 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d1247d6560 0x55d12478c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d12a00640 0 client.4900 ms_handle_reset on v2:172.21.15.187:6838/3721745292 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1247cdd90 0x55d1247b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 --2- 172.21.15.102:0/2817883459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1247cd9b0 0x55d1247880c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 >> 172.21.15.102:0/2817883459 conn(0x55d12478c450 msgr2=0x55d1247e5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 shutdown_connections 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 1 -- 172.21.15.102:0/2817883459 wait complete. 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d3701f740 20 client.4900 trim_cache size 0 max 16384 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "ad358596-5ce1-459c-a1bc-1e91bde83a5b", 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 1, 2024-03-25T05:38:11.613 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4273, 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 18.103312599999999, 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 17, 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 25, 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 25, 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 45.603455981000003 2024-03-25T05:38:11.614 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8d0c06b810 msgr2=0x7f8d0c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d32c00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8d0c06b810 0x7f8d0c06dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c156fc0 tx=0x7f8d18009190 comp rx=0 tx=0).stop 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c154120 msgr2=0x7f8d2c147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.615+0000 7f8d32c00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c154120 0x7f8d2c147d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d24033000 tx=0x7f8d24004a40 comp rx=0 tx=0).stop 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 shutdown_connections 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f8d0c06b810 0x7f8d0c06dcd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d2c154120 0x7f8d2c147d70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d2c0c6c10 0x7f8d2c147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 --2- 172.21.15.102:0/1566984067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d2c0c67e0 0x7f8d2c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 >> 172.21.15.102:0/1566984067 conn(0x7f8d2c0cf3e0 msgr2=0x7f8d2c0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 shutdown_connections 2024-03-25T05:38:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.616+0000 7f8d32c00640 1 -- 172.21.15.102:0/1566984067 wait complete. 2024-03-25T05:38:11.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-25T05:38:11.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.876+0000 7fb6d0e00640 1 Processor -- start 2024-03-25T05:38:11.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.876+0000 7fb6d0e00640 1 -- start start 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.877+0000 7fb6d0e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb6cc154120 0x7fb6cc0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.877+0000 7fb6d0e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c67e0 0x7fb6cc0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.877+0000 7fb6d0e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc0cbbe0 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.877+0000 7fb6d0e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc154500 con 0x7fb6cc154120 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.877+0000 7fb6d0e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc06b250 con 0x7fb6cc0c67e0 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.877+0000 7fb6caa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c67e0 0x7fb6cc0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6cbe00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb6cc0c6c10 0x7fb6cc0c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:40554/0 (socket says 172.21.15.102:40554) 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6cbe00640 1 -- 172.21.15.102:0/2385701433 learned_addr learned my addr 172.21.15.102:0/2385701433 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T05:38:11.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6caa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c67e0 0x7fb6cc0cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53690/0 (socket says 172.21.15.102:53690) 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2385701433 >> v2:172.21.15.102:3300/0 conn(0x7fb6cc154120 0x7fb6cc0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6ca000640 1 -- 172.21.15.102:0/2385701433 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331908150 0 0) 0x7fb6cc0cbbe0 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6ca000640 1 -- 172.21.15.102:0/2385701433 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6b0003520 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6caa00640 1 -- 172.21.15.102:0/2385701433 >> v2:172.21.15.102:3300/0 conn(0x7fb6cc154120 msgr2=0x7fb6cc0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2385701433 >> v2:172.21.15.102:3300/0 conn(0x7fb6cc154120 0x7fb6cc0cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6caa00640 1 -- 172.21.15.102:0/2385701433 >> v1:172.21.15.187:6789/0 conn(0x7fb6cc0c6c10 legacy=0x7fb6cc0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.878+0000 7fb6caa00640 1 -- 172.21.15.102:0/2385701433 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc0ca280 con 0x7fb6cc0c67e0 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.879+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2385701433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c67e0 0x7fb6cc0cb540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80097a0 tx=0x7fb6b802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49ced5cc2d69e76 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.879+0000 7fb6ca000640 1 -- 172.21.15.102:0/2385701433 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8031780 con 0x7fb6cc0c67e0 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.879+0000 7fb6ca000640 1 -- 172.21.15.102:0/2385701433 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b80318e0 con 0x7fb6cc0c67e0 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.879+0000 7fb6ca000640 1 -- 172.21.15.102:0/2385701433 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8031c70 con 0x7fb6cc0c67e0 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2385701433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c67e0 msgr2=0x7fb6cc0cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2385701433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c67e0 0x7fb6cc0cb540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80097a0 tx=0x7fb6b802b820 comp rx=0 tx=0).stop 2024-03-25T05:38:11.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2385701433 shutdown_connections 2024-03-25T05:38:11.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2385701433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c67e0 0x7fb6cc0cb540 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2385701433 >> v2:172.21.15.102:3300/0 conn(0x7fb6cc154120 0x7fb6cc0cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2385701433 >> 172.21.15.102:0/2385701433 conn(0x7fb6cc0cf3e0 msgr2=0x7fb6cc0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2385701433 shutdown_connections 2024-03-25T05:38:11.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.880+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2385701433 wait complete. 2024-03-25T05:38:11.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.883+0000 7fb6d0e00640 1 Processor -- start 2024-03-25T05:38:11.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.883+0000 7fb6d0e00640 1 -- start start 2024-03-25T05:38:11.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.884+0000 7fb6d0e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6cc0c67e0 0x7fb6cc155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.884+0000 7fb6d0e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c6c10 0x7fb6cc1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.884+0000 7fb6d0e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6cc154120 0x7fb6cc0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.884+0000 7fb6d0e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc14f770 con 0x7fb6cc0c67e0 2024-03-25T05:38:11.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.884+0000 7fb6d0e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1f26f0 con 0x7fb6cc154120 2024-03-25T05:38:11.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.884+0000 7fb6d0e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc14e380 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.884+0000 7fb6caa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c6c10 0x7fb6cc1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6cc0c67e0 0x7fb6cc155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6cc0c67e0 0x7fb6cc155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60672/0 (socket says 172.21.15.102:60672) 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6caa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c6c10 0x7fb6cc1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53696/0 (socket says 172.21.15.102:53696) 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6cb400640 1 -- 172.21.15.102:0/2978697812 learned_addr learned my addr 172.21.15.102:0/2978697812 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6cbe00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6cc154120 0x7fb6cc0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6caa00640 1 -- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6cc154120 msgr2=0x7fb6cc0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6cc154120 0x7fb6cc0c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6caa00640 1 -- 172.21.15.102:0/2978697812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6cc0c67e0 msgr2=0x7fb6cc155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6cc0c67e0 0x7fb6cc155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6caa00640 1 -- 172.21.15.102:0/2978697812 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b8009400 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.885+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c6c10 0x7fb6cc1514d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8033000 tx=0x7fb6b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.886+0000 7fb6c3400640 1 -- 172.21.15.102:0/2978697812 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8032820 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.886+0000 7fb6c3400640 1 -- 172.21.15.102:0/2978697812 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b80329c0 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.886+0000 7fb6c3400640 1 -- 172.21.15.102:0/2978697812 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8032d70 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.886+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1f2900 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.886+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc1f2ec0 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.888+0000 7fb6c3400640 1 -- 172.21.15.102:0/2978697812 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb6b804d3f0 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.889+0000 7fb6c3400640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6ac06b810 0x7fb6ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.889+0000 7fb6c3400640 1 -- 172.21.15.102:0/2978697812 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb6b80abfd0 con 0x7fb6cc0c6c10 2024-03-25T05:38:11.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.889+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6ac06b810 0x7fb6ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.890+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6ac06b810 0x7fb6ac06dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009b60 tx=0x7fb6bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 Processor -- start 2024-03-25T05:38:11.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 -- start start 2024-03-25T05:38:11.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x56279ffbf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffbe450 0x5627a0000370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x56279fffec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279ff2dfb0 con 0x56279ffffd90 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279ff2b4e0 con 0x56279ffbe450 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.891+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x56279ff26cc0 con 0x56279ffff9b0 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x56279ffbf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x56279ffbf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53700/0 (socket says 172.21.15.102:53700) 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 -- 172.21.15.102:0/872476771 learned_addr learned my addr 172.21.15.102:0/872476771 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6caa00640 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffbe450 0x5627a0000370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cbe00640 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x56279fffec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 -- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffbe450 msgr2=0x5627a0000370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffbe450 0x5627a0000370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 -- 172.21.15.102:0/872476771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 msgr2=0x56279fffec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x56279fffec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 -- 172.21.15.102:0/872476771 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56279feee4c0 con 0x56279ffff9b0 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cbe00640 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x56279fffec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.892+0000 7fb6cb400640 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x56279ffbf750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc011f20 tx=0x7fb6bc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0c9fac855bbd6d server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6b7e00640 1 -- 172.21.15.102:0/872476771 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc003820 con 0x56279ffff9b0 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6b7e00640 1 -- 172.21.15.102:0/872476771 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc01b070 con 0x56279ffff9b0 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6b7e00640 1 -- 172.21.15.102:0/872476771 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc003b80 con 0x56279ffff9b0 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6d51ee740 1 -- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 msgr2=0x56279ffbf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x56279ffbf750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc011f20 tx=0x7fb6bc014000 comp rx=0 tx=0).stop 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6d51ee740 1 -- 172.21.15.102:0/872476771 shutdown_connections 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x56279fffec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffbe450 0x5627a0000370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/872476771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x56279ffbf750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.893+0000 7fb6d51ee740 1 -- 172.21.15.102:0/872476771 >> 172.21.15.102:0/872476771 conn(0x56279ffbb5c0 msgr2=0x56279ffbed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.894+0000 7fb6d51ee740 1 -- 172.21.15.102:0/872476771 shutdown_connections 2024-03-25T05:38:11.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.894+0000 7fb6d51ee740 1 -- 172.21.15.102:0/872476771 wait complete. 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.894+0000 7fb6d51ee740 1 -- start start 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.894+0000 7fb6d51ee740 1 Processor -- start 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.895+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a0007920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.895+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffffd90 0x5627a0012ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.895+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0003140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.895+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279fecbea0 con 0x56279ffe6e10 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.895+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279fecbb40 con 0x56279ffffd90 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.895+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x56279fc6ef20 con 0x56279ffff9b0 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.895+0000 7fb6d51ee740 10 client.0 _ll_register_callbacks cb 0x56279fc37ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a0007920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a0007920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:53702/0 (socket says 172.21.15.102:53702) 2024-03-25T05:38:11.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 -- 172.21.15.102:0/2320705504 learned_addr learned my addr 172.21.15.102:0/2320705504 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffffd90 0x5627a0012ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cbe00640 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0003140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 -- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffffd90 msgr2=0x5627a0012ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffffd90 0x5627a0012ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 -- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 msgr2=0x5627a0003140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0003140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 -- 172.21.15.102:0/2320705504 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc011c00 con 0x56279ffff9b0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a0007920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5627a00008b0 tx=0x7fb6bc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6e219bf108ecfc server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.896+0000 7fb6b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3301/0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2320705504 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc022640 con 0x56279ffff9b0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2320705504 <== mon.2 v2:172.21.15.187:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb6bc037e20 con 0x56279ffff9b0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56279fc266c0 con 0x56279ffff9b0 2024-03-25T05:38:11.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2320705504 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6bc0227a0 con 0x56279ffff9b0 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 10 client.4727 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56279ff25340 con 0x56279ffff9b0 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2320705504 <== mon.2 v2:172.21.15.187:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56279fc266c0 con 0x56279ffff9b0 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2320705504 <== mon.2 v2:172.21.15.187:3301/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7fb6bc022900 con 0x56279ffff9b0 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 10 client.4727 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 10 client.4727 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 20 client.4727 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x5627a001c480 0x5627a001e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 4 client.4727 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.897+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 --> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56279fc77270 con 0x5627a001c480 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.898+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x5627a001c480 0x5627a001e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.898+0000 7fb6b4c00640 10 client.4727 ms_handle_connect on v2:172.21.15.102:6834/2568369315 2024-03-25T05:38:11.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.898+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x5627a001c480 0x5627a001e870 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da5102968fe4555 server_cookie=462bd1a934f5646d in_seq=0 out_seq=0 2024-03-25T05:38:11.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.899+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2320705504 <== mds.0 v2:172.21.15.102:6834/2568369315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56279fc77270 con 0x5627a001c480 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.899+0000 7fb6b4c00640 10 client.4727 handle_command_reply: tid=0 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.899+0000 7fb6d51ee740 1 client.4727 shutdown 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 msgr2=0x5627a0007920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a0007920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5627a00008b0 tx=0x7fb6bc004730 comp rx=0 tx=0).stop 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 shutdown_connections 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x5627a001c480 0x5627a001e870 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0003140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffffd90 0x5627a0012ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2320705504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a0007920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6b4c00640 0 client.4727 ms_handle_reset on v2:172.21.15.102:6834/2568369315 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 >> 172.21.15.102:0/2320705504 conn(0x56279ffbe450 msgr2=0x56279ffe7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 shutdown_connections 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2320705504 wait complete. 2024-03-25T05:38:11.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.900+0000 7fb6d51ee740 20 client.4727 trim_cache size 0 max 16384 2024-03-25T05:38:11.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.933+0000 7fb6d51ee740 1 Processor -- start 2024-03-25T05:38:11.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.933+0000 7fb6d51ee740 1 -- start start 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.934+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffe6e10 0x5627a00058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.934+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a00028f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.934+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x5627a0002e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.934+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279fffb580 con 0x56279ffffd90 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.934+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a00129d0 con 0x56279ffe6e10 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.934+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x56279ffbff60 con 0x56279ffff9b0 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffe6e10 0x5627a00058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6caa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a00028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffe6e10 0x5627a00058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:35994/0 (socket says 172.21.15.102:35994) 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6cb400640 1 -- 172.21.15.102:0/1724195314 learned_addr learned my addr 172.21.15.102:0/1724195314 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6cbe00640 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x5627a0002e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6caa00640 1 -- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffe6e10 msgr2=0x5627a00058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6caa00640 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffe6e10 0x5627a00058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6caa00640 1 -- 172.21.15.102:0/1724195314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 msgr2=0x5627a0002e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6caa00640 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x5627a0002e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6caa00640 1 -- 172.21.15.102:0/1724195314 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56279fec18b0 con 0x56279ffff9b0 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6cb400640 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffe6e10 0x5627a00058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6cbe00640 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x5627a0002e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.935+0000 7fb6caa00640 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a00028f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80aa180 tx=0x7fb6b8009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24cca6885c60645b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6b7400640 1 -- 172.21.15.102:0/1724195314 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80787b0 con 0x56279ffff9b0 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6b7400640 1 -- 172.21.15.102:0/1724195314 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b80aa230 con 0x56279ffff9b0 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6b7400640 1 -- 172.21.15.102:0/1724195314 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8082680 con 0x56279ffff9b0 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 -- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 msgr2=0x5627a00028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a00028f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80aa180 tx=0x7fb6b8009190 comp rx=0 tx=0).stop 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 -- 172.21.15.102:0/1724195314 shutdown_connections 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffffd90 0x5627a0002e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffff9b0 0x5627a00028f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/1724195314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffe6e10 0x5627a00058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 -- 172.21.15.102:0/1724195314 >> 172.21.15.102:0/1724195314 conn(0x56279ffbe450 msgr2=0x56279ffb8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 -- 172.21.15.102:0/1724195314 shutdown_connections 2024-03-25T05:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.936+0000 7fb6d51ee740 1 -- 172.21.15.102:0/1724195314 wait complete. 2024-03-25T05:38:11.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.937+0000 7fb6d51ee740 1 -- start start 2024-03-25T05:38:11.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.937+0000 7fb6d51ee740 1 Processor -- start 2024-03-25T05:38:11.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0002cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffff9b0 0x5627a0073680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6d51ee740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffffd90 0x56279ffbebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a00070c0 con 0x56279ffe6e10 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279ffe8260 con 0x56279ffff9b0 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6d51ee740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627a0022bc0 con 0x56279ffffd90 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6d51ee740 10 client.0 _ll_register_callbacks cb 0x7fb6b8031f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffff9b0 0x5627a0073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffff9b0 0x5627a0073680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:36010/0 (socket says 172.21.15.102:36010) 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6cb400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0002cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 -- 172.21.15.102:0/2590044098 learned_addr learned my addr 172.21.15.102:0/2590044098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6cbe00640 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffffd90 0x56279ffbebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 -- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffffd90 msgr2=0x56279ffbebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffffd90 0x56279ffbebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 -- 172.21.15.102:0/2590044098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 msgr2=0x5627a0002cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0002cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.939+0000 7fb6caa00640 1 -- 172.21.15.102:0/2590044098 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56279ff25340 con 0x56279ffff9b0 2024-03-25T05:38:11.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6caa00640 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffff9b0 0x5627a0073680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8076910 tx=0x7fb6bc015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f781f04f0b5d24 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2590044098 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8082680 con 0x56279ffff9b0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2590044098 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb6b8093070 con 0x56279ffff9b0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6bc01b070 con 0x56279ffff9b0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2590044098 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6b80827e0 con 0x56279ffff9b0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6d51ee740 10 client.4918 fetch_fsmap learned FSMap version 17 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7fb6cc1f2ec0 con 0x56279ffff9b0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2590044098 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b8088080 con 0x56279ffff9b0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.940+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2590044098 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 17) v1 ==== 4552+0+0 (secure 0 0 0) 0x7fb6b807e0b0 con 0x56279ffff9b0 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.941+0000 7fb6d51ee740 10 client.4918 fetch_fsmap finished waiting for FSMap version 17 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.941+0000 7fb6d51ee740 10 client.4918 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.941+0000 7fb6d51ee740 20 client.4918 populate_metadata read hostname 'smithi102' 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.941+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x56279ffbf3f0 0x5627a006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:11.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.941+0000 7fb6d51ee740 4 client.4918 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-25T05:38:11.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.941+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 --> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56279fc63610 con 0x56279ffbf3f0 2024-03-25T05:38:11.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.941+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x56279ffbf3f0 0x5627a006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:11.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6cb400640 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x56279ffbf3f0 0x5627a006fb20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e5bcb91bfb7c13 server_cookie=e83f3e91ff508c91 in_seq=0 out_seq=0 2024-03-25T05:38:11.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6b4c00640 10 client.4918 ms_handle_connect on v2:172.21.15.102:6834/2568369315 2024-03-25T05:38:11.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6b4c00640 1 -- 172.21.15.102:0/2590044098 <== mds.0 v2:172.21.15.102:6834/2568369315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56279fc63610 con 0x56279ffbf3f0 2024-03-25T05:38:11.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6b4c00640 10 client.4918 handle_command_reply: tid=0 2024-03-25T05:38:11.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 client.4918 shutdown 2024-03-25T05:38:11.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffff9b0 msgr2=0x5627a0073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffff9b0 0x5627a0073680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8076910 tx=0x7fb6bc015000 comp rx=0 tx=0).stop 2024-03-25T05:38:11.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 shutdown_connections 2024-03-25T05:38:11.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.102:6834/2568369315,v1:172.21.15.102:6835/2568369315] conn(0x56279ffbf3f0 0x5627a006fb20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56279ffffd90 0x56279ffbebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56279ffff9b0 0x5627a0073680 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 --2- 172.21.15.102:0/2590044098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56279ffe6e10 0x5627a0002cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 >> 172.21.15.102:0/2590044098 conn(0x56279ffbe450 msgr2=0x56279ffb8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.942+0000 7fb6b4c00640 0 client.4918 ms_handle_reset on v2:172.21.15.102:6834/2568369315 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.943+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 shutdown_connections 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.943+0000 7fb6d51ee740 1 -- 172.21.15.102:0/2590044098 wait complete. 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.943+0000 7fb6d51ee740 20 client.4918 trim_cache size 0 max 16384 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "ad358596-5ce1-459c-a1bc-1e91bde83a5b", 2024-03-25T05:38:11.940 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4291, 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 40.547356465999997, 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 17, 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 25, 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 25, 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 45.875499968 2024-03-25T05:38:11.941 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T05:38:11.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6ac06b810 msgr2=0x7fb6ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6ac06b810 0x7fb6ac06dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009b60 tx=0x7fb6bc009190 comp rx=0 tx=0).stop 2024-03-25T05:38:11.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c6c10 msgr2=0x7fb6cc1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:11.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c6c10 0x7fb6cc1514d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8033000 tx=0x7fb6b80046c0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 shutdown_connections 2024-03-25T05:38:11.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb6ac06b810 0x7fb6ac06dcd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6cc154120 0x7fb6cc0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6cc0c6c10 0x7fb6cc1514d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 --2- 172.21.15.102:0/2978697812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6cc0c67e0 0x7fb6cc155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:11.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 >> 172.21.15.102:0/2978697812 conn(0x7fb6cc0cf3e0 msgr2=0x7fb6cc06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:11.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 shutdown_connections 2024-03-25T05:38:11.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:11.944+0000 7fb6d0e00640 1 -- 172.21.15.102:0/2978697812 wait complete. 2024-03-25T05:38:11.955 INFO:teuthology.run_tasks:Running task kclient... 2024-03-25T05:38:11.967 INFO:tasks.kclient:Mounting kernel clients... 2024-03-25T05:38:11.967 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-25T05:38:11.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:11.968 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-03-25T05:38:12.004 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-25T05:38:12.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:12.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-25T05:38:12.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:12.125 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-03-25T05:38:12.236 INFO:tasks.kclient:client.0 config is {} 2024-03-25T05:38:12.236 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-25T05:38:12.236 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:12.236 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-25T05:38:12.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.424+0000 7f07b9000640 1 Processor -- start 2024-03-25T05:38:12.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.425+0000 7f07b9000640 1 -- start start 2024-03-25T05:38:12.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b9000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f07b4152060 0x7f07b40c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:12.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b9000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b40c3dc0 0x7f07b415b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:12.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b9000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b406e340 con 0x7f07b40c39c0 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b9000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b4152440 con 0x7f07b4152060 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b9000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c53b0 con 0x7f07b40c3dc0 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b1e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f07b4152060 0x7f07b40c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b1e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f07b4152060 0x7f07b40c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:36018/0 (socket says 172.21.15.102:36018) 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b1e00640 1 -- 172.21.15.102:0/1647450631 learned_addr learned my addr 172.21.15.102:0/1647450631 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.426+0000 7f07b2800640 1 --2- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b40c3dc0 0x7f07b415b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.427+0000 7f07b1e00640 1 -- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b40c3dc0 msgr2=0x7f07b415b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.427+0000 7f07b1e00640 1 --2- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b40c3dc0 0x7f07b415b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.427+0000 7f07b1e00640 1 -- 172.21.15.102:0/1647450631 >> v1:172.21.15.102:6789/0 conn(0x7f07b40c39c0 legacy=0x7f07b415b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.427+0000 7f07b1e00640 1 -- 172.21.15.102:0/1647450631 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40c4270 con 0x7f07b4152060 2024-03-25T05:38:12.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.427+0000 7f07b2800640 1 --2- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b40c3dc0 0x7f07b415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:12.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.428+0000 7f07b1e00640 1 --2- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b4152060 0x7f07b40c7700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009870 tx=0x7f07a402ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1264dd10ee47ee6f server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:12.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.428+0000 7f07b0a00640 1 -- 172.21.15.102:0/1647450631 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a402f830 con 0x7f07b4152060 2024-03-25T05:38:12.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.428+0000 7f07b0a00640 1 -- 172.21.15.102:0/1647450631 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a402f990 con 0x7f07b4152060 2024-03-25T05:38:12.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.428+0000 7f07b0a00640 1 -- 172.21.15.102:0/1647450631 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a402fd20 con 0x7f07b4152060 2024-03-25T05:38:12.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 -- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b4152060 msgr2=0x7f07b40c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:12.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 --2- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b4152060 0x7f07b40c7700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009870 tx=0x7f07a402ba10 comp rx=0 tx=0).stop 2024-03-25T05:38:12.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 -- 172.21.15.102:0/1647450631 shutdown_connections 2024-03-25T05:38:12.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 --2- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b40c3dc0 0x7f07b415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 --2- 172.21.15.102:0/1647450631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b4152060 0x7f07b40c7700 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 -- 172.21.15.102:0/1647450631 >> 172.21.15.102:0/1647450631 conn(0x7f07b40c7dd0 msgr2=0x7f07b40c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:12.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 -- 172.21.15.102:0/1647450631 shutdown_connections 2024-03-25T05:38:12.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.429+0000 7f07b9000640 1 -- 172.21.15.102:0/1647450631 wait complete. 2024-03-25T05:38:12.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.431+0000 7f07b9000640 1 Processor -- start 2024-03-25T05:38:12.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.431+0000 7f07b9000640 1 -- start start 2024-03-25T05:38:12.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b9000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40c39c0 0x7f07b406e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:12.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b9000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07b40c3dc0 0x7f07b41ef030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:12.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b9000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b4152060 0x7f07b41ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b9000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41ec660 con 0x7f07b40c3dc0 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b9000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41e17c0 con 0x7f07b40c39c0 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b9000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41eb820 con 0x7f07b4152060 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b1e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40c39c0 0x7f07b406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b1e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40c39c0 0x7f07b406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:36030/0 (socket says 172.21.15.102:36030) 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b1e00640 1 -- 172.21.15.102:0/545893709 learned_addr learned my addr 172.21.15.102:0/545893709 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b1400640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07b40c3dc0 0x7f07b41ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.432+0000 7f07b2800640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b4152060 0x7f07b41ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b1e00640 1 -- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b4152060 msgr2=0x7f07b41ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b1e00640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b4152060 0x7f07b41ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b1e00640 1 -- 172.21.15.102:0/545893709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07b40c3dc0 msgr2=0x7f07b41ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b1e00640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07b40c3dc0 0x7f07b41ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b1e00640 1 -- 172.21.15.102:0/545893709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40094d0 con 0x7f07b40c39c0 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b1400640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07b40c3dc0 0x7f07b41ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b1e00640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40c39c0 0x7f07b406e740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f07a4000c00 tx=0x7f07a4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07aa000640 1 -- 172.21.15.102:0/545893709 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4037c40 con 0x7f07b40c39c0 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07aa000640 1 -- 172.21.15.102:0/545893709 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4037da0 con 0x7f07b40c39c0 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07aa000640 1 -- 172.21.15.102:0/545893709 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4041640 con 0x7f07b40c39c0 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.433+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b41ebae0 con 0x7f07b40c39c0 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.434+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b41ec0a0 con 0x7f07b40c39c0 2024-03-25T05:38:12.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.435+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b4067fb0 con 0x7f07b40c39c0 2024-03-25T05:38:12.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.436+0000 7f07aa000640 1 -- 172.21.15.102:0/545893709 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f07a40417a0 con 0x7f07b40c39c0 2024-03-25T05:38:12.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.438+0000 7f07aa000640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f079406b810 0x7f079406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T05:38:12.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.438+0000 7f07aa000640 1 -- 172.21.15.102:0/545893709 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f07a403c070 con 0x7f07b40c39c0 2024-03-25T05:38:12.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.438+0000 7f07b1400640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f079406b810 0x7f079406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T05:38:12.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.438+0000 7f07b1400640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f079406b810 0x7f079406dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f07b406c200 tx=0x7f07a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T05:38:12.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.441+0000 7f07aa000640 1 -- 172.21.15.102:0/545893709 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f07a4077850 con 0x7f07b40c39c0 2024-03-25T05:38:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.668+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f07b40c4ff0 con 0x7f07b40c39c0 2024-03-25T05:38:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.668+0000 7f07aa000640 1 -- 172.21.15.102:0/545893709 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f07a407af10 con 0x7f07b40c39c0 2024-03-25T05:38:12.663 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-25T05:38:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f079406b810 msgr2=0x7f079406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f079406b810 0x7f079406dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f07b406c200 tx=0x7f07a0009040 comp rx=0 tx=0).stop 2024-03-25T05:38:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40c39c0 msgr2=0x7f07b406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T05:38:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40c39c0 0x7f07b406e740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f07a4000c00 tx=0x7f07a4004730 comp rx=0 tx=0).stop 2024-03-25T05:38:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 shutdown_connections 2024-03-25T05:38:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f079406b810 0x7f079406dcd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b4152060 0x7f07b41ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07b40c3dc0 0x7f07b41ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 --2- 172.21.15.102:0/545893709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40c39c0 0x7f07b406e740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T05:38:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 >> 172.21.15.102:0/545893709 conn(0x7f07b40c7dd0 msgr2=0x7f07b414f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T05:38:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 shutdown_connections 2024-03-25T05:38:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T05:38:12.671+0000 7f07b9000640 1 -- 172.21.15.102:0/545893709 wait complete. 2024-03-25T05:38:12.683 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-25T05:38:12.684 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-25T05:38:12.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:12.684 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-03-25T05:38:12.723 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-25T05:38:12.723 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-25T05:38:12.723 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-03-25T05:38:12.723 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-25T05:38:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42621sec preferred_lft 42621sec 2024-03-25T05:38:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-03-25T05:38:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-03-25T05:38:12.725 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-25T05:38:12.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:12.725 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:38:12.725 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:38:12.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-03-25T05:38:12.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-03-25T05:38:12.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-03-25T05:38:12.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-25T05:38:12.725 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:38:12.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:12.951 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-25T05:38:13.017 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-03-25T05:38:13.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:13.020 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-03-25T05:38:13.058 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-03-25T05:38:13.058 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-25T05:38:13.058 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-25T05:38:13.059 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-25T05:38:13.059 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-25T05:38:13.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:13.059 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:38:13.059 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:38:13.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-25T05:38:13.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-25T05:38:13.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-25T05:38:13.059 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:38:13.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:13.264 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-03-25T05:38:13.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:13.303 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-03-25T05:38:13.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:13.388 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:38:13.388 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:38:13.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-25T05:38:13.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-25T05:38:13.389 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:38:13.539 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-25T05:38:13.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:13.539 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:38:13.539 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:38:13.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-25T05:38:13.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-25T05:38:13.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-25T05:38:13.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-25T05:38:13.540 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-25T05:38:13.540 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:38:13.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:13.766 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-03-25T05:38:13.766 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-03-25T05:38:13.766 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-03-25T05:38:13.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-03-25T05:38:13.767 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-03-25T05:38:13.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-25T05:38:13.910 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:13.947 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-25T05:38:13.948 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-25T05:38:13.948 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:14.035 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-25T05:38:14.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:14.035 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-25T05:38:14.191 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-25T05:38:14.191 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-25T05:38:14.788 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-25T05:38:14.788 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-25T05:38:14.788 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.102:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-03-25T05:38:14.788 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with new device syntax: 0@ad358596-5ce1-459c-a1bc-1e91bde83a5b.cephfs=/ 2024-03-25T05:38:14.788 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.102:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-03-25T05:38:14.791 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-25T05:38:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-03-25T05:38:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-25T05:38:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-03-25T05:38:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-25T05:38:14.795 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-25T05:38:14.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:14.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:14.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:14.867 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-25T05:38:14.909 INFO:teuthology.orchestra.run.smithi102.stdout:client4927 2024-03-25T05:38:14.909 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:38:14.909 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-25T05:38:14.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:14.991 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-25T05:38:15.079 INFO:teuthology.orchestra.run.smithi102.stdout:client4927 2024-03-25T05:38:15.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:15.079 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-25T05:38:15.166 INFO:teuthology.orchestra.run.smithi102.stdout:client4927 2024-03-25T05:38:15.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T05:38:15.166 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad358596-5ce1-459c-a1bc-1e91bde83a5b.client4927/status') 2024-03-25T05:38:15.277 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4927 (3)172.21.15.102:0/1317245580 2024-03-25T05:38:15.277 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2024-03-25T05:38:15.277 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2024-03-25T05:38:15.277 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2024-03-25T05:38:15.278 INFO:teuthology.orchestra.run.smithi102.stderr:71 bytes copied, 5.13e-05 s, 1.4 MB/s 2024-03-25T05:38:15.281 INFO:teuthology.run_tasks:Running task workunit... 2024-03-25T05:38:15.296 INFO:tasks.workunit:Pulling workunits from ref 5b534581aae05db8101ae105c576bb56c54e9c12 2024-03-25T05:38:15.297 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-25T05:38:15.297 INFO:tasks.workunit:timeout=3h 2024-03-25T05:38:15.297 INFO:tasks.workunit:cleanup=True 2024-03-25T05:38:15.297 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-25T05:38:15.341 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-03-25T05:38:15.341 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-25T05:38:15.341 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-25T05:38:15.342 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-25T05:38:15.342 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-25 05:37:31.398979320 +0000 2024-03-25T05:38:15.342 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-25 05:37:44.678752244 +0000 2024-03-25T05:38:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-25 05:37:31.398979320 +0000 2024-03-25T05:38:15.342 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-25T05:38:15.342 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-25T05:38:15.475 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5b534581aae05db8101ae105c576bb56c54e9c12 2024-03-25T05:38:15.517 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-25T05:38:33.329 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:38:33.335 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:39:03.440 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:39:03.448 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:39:34.424 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:39:34.433 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:39:39.940 INFO:tasks.workunit.client.0.smithi102.stderr:Updating files: 63% (7874/12422) Updating files: 64% (7951/12422) Updating files: 65% (8075/12422) Updating files: 66% (8199/12422) Updating files: 67% (8323/12422) Updating files: 68% (8447/12422) Updating files: 69% (8572/12422) Updating files: 70% (8696/12422) Updating files: 71% (8820/12422) Updating files: 72% (8944/12422) Updating files: 73% (9069/12422) Updating files: 74% (9193/12422) Updating files: 75% (9317/12422) Updating files: 76% (9441/12422) Updating files: 77% (9565/12422) Updating files: 78% (9690/12422) Updating files: 79% (9814/12422) Updating files: 80% (9938/12422) Updating files: 81% (10062/12422) Updating files: 82% (10187/12422) Updating files: 83% (10311/12422) Updating files: 84% (10435/12422) Updating files: 85% (10559/12422) Updating files: 86% (10683/12422) Updating files: 87% (10808/12422) Updating files: 88% (10932/12422) Updating files: 89% (11056/12422) Updating files: 90% (11180/12422) Updating files: 91% (11305/12422) Updating files: 92% (11429/12422) Updating files: 93% (11553/12422) Updating files: 94% (11677/12422) Updating files: 95% (11801/12422) Updating files: 95% (11867/12422) Updating files: 96% (11926/12422) Updating files: 97% (12050/12422) Updating files: 98% (12174/12422) Updating files: 99% (12298/12422) Updating files: 100% (12422/12422) Updating files: 100% (12422/12422), done. 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '5b534581aae05db8101ae105c576bb56c54e9c12'. 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-25T05:39:40.876 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-03-25T05:39:40.877 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 5b534581aae Merge pull request #56425 from zdover23/wip-doc-2024-08-24-backport-56367-to-squid 2024-03-25T05:39:40.884 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-25T05:39:40.933 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-25T05:39:40.938 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-25T05:39:40.938 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-25T05:39:41.750 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-25T05:39:41.863 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-25T05:39:41.955 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-25T05:39:41.959 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-25T05:39:41.959 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-25T05:39:42.039 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-25T05:39:42.047 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T05:39:42.047 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-25T05:39:42.084 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-03-25T05:39:42.085 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-03-25T05:39:42.085 DEBUG:teuthology.orchestra.run.smithi102:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5b534581aae05db8101ae105c576bb56c54e9c12 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-03-25T05:39:42.185 INFO:tasks.workunit.client.0.smithi102.stderr:+ dbench 1 2024-03-25T05:39:42.205 INFO:tasks.workunit.client.0.smithi102.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-03-25T05:39:42.205 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-03-25T05:39:42.205 INFO:tasks.workunit.client.0.smithi102.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-03-25T05:39:42.210 INFO:tasks.workunit.client.0.smithi102.stdout:0 of 1 processes prepared for launch 0 sec 2024-03-25T05:39:42.310 INFO:tasks.workunit.client.0.smithi102.stdout:1 of 1 processes prepared for launch 0 sec 2024-03-25T05:39:42.310 INFO:tasks.workunit.client.0.smithi102.stdout:releasing clients 2024-03-25T05:39:43.310 INFO:tasks.workunit.client.0.smithi102.stdout: 1 2400 27.96 MB/sec warmup 1 sec latency 10.952 ms 2024-03-25T05:39:44.310 INFO:tasks.workunit.client.0.smithi102.stdout: 1 4362 20.29 MB/sec warmup 2 sec latency 9.757 ms 2024-03-25T05:39:45.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 7328 19.63 MB/sec warmup 3 sec latency 9.444 ms 2024-03-25T05:39:46.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 9462 16.53 MB/sec warmup 4 sec latency 12.690 ms 2024-03-25T05:39:47.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 11393 15.73 MB/sec warmup 5 sec latency 16.913 ms 2024-03-25T05:39:48.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 13970 15.45 MB/sec warmup 6 sec latency 22.903 ms 2024-03-25T05:39:49.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 15887 14.67 MB/sec warmup 7 sec latency 16.293 ms 2024-03-25T05:39:50.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 18485 14.61 MB/sec warmup 8 sec latency 8.513 ms 2024-03-25T05:39:51.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 21561 15.05 MB/sec warmup 9 sec latency 7.848 ms 2024-03-25T05:39:52.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 23465 14.14 MB/sec warmup 10 sec latency 13.863 ms 2024-03-25T05:39:53.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 25697 14.13 MB/sec warmup 11 sec latency 7.643 ms 2024-03-25T05:39:54.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 28671 14.47 MB/sec warmup 12 sec latency 20.681 ms 2024-03-25T05:39:55.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 31000 14.00 MB/sec warmup 13 sec latency 7.397 ms 2024-03-25T05:39:56.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 33036 13.93 MB/sec warmup 14 sec latency 8.435 ms 2024-03-25T05:39:57.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 35903 14.15 MB/sec warmup 15 sec latency 15.845 ms 2024-03-25T05:39:58.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 37986 13.75 MB/sec warmup 16 sec latency 23.786 ms 2024-03-25T05:39:59.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 39878 13.64 MB/sec warmup 17 sec latency 20.391 ms 2024-03-25T05:40:00.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 42878 13.90 MB/sec warmup 18 sec latency 10.181 ms 2024-03-25T05:40:01.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 43471 13.21 MB/sec warmup 19 sec latency 526.028 ms 2024-03-25T05:40:02.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 46389 13.46 MB/sec warmup 20 sec latency 13.246 ms 2024-03-25T05:40:03.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 47271 12.93 MB/sec warmup 21 sec latency 131.658 ms 2024-03-25T05:40:04.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 49839 13.06 MB/sec warmup 22 sec latency 22.552 ms 2024-03-25T05:40:04.581 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:40:04.587 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:40:05.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 52019 12.85 MB/sec warmup 23 sec latency 32.383 ms 2024-03-25T05:40:06.311 INFO:tasks.workunit.client.0.smithi102.stdout: 1 53974 12.84 MB/sec warmup 24 sec latency 11.963 ms 2024-03-25T05:40:07.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 56854 13.02 MB/sec warmup 25 sec latency 14.353 ms 2024-03-25T05:40:08.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 57581 12.59 MB/sec warmup 26 sec latency 100.836 ms 2024-03-25T05:40:09.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 58871 12.32 MB/sec warmup 27 sec latency 272.813 ms 2024-03-25T05:40:10.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 60871 12.36 MB/sec warmup 28 sec latency 17.361 ms 2024-03-25T05:40:11.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 63535 12.39 MB/sec warmup 29 sec latency 12.328 ms 2024-03-25T05:40:12.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 65288 12.34 MB/sec warmup 30 sec latency 9.858 ms 2024-03-25T05:40:13.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 67800 12.40 MB/sec warmup 31 sec latency 15.983 ms 2024-03-25T05:40:14.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 69910 12.25 MB/sec warmup 32 sec latency 17.502 ms 2024-03-25T05:40:15.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 71846 12.25 MB/sec warmup 33 sec latency 13.850 ms 2024-03-25T05:40:16.312 INFO:tasks.workunit.client.0.smithi102.stdout: 1 74686 12.39 MB/sec warmup 34 sec latency 20.649 ms 2024-03-25T05:40:17.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 76521 12.23 MB/sec warmup 35 sec latency 10.872 ms 2024-03-25T05:40:18.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 78768 12.28 MB/sec warmup 36 sec latency 11.117 ms 2024-03-25T05:40:19.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 81461 12.33 MB/sec warmup 37 sec latency 22.233 ms 2024-03-25T05:40:20.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 83060 12.26 MB/sec warmup 38 sec latency 16.097 ms 2024-03-25T05:40:21.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 85612 12.31 MB/sec warmup 39 sec latency 8.157 ms 2024-03-25T05:40:22.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 87951 12.27 MB/sec warmup 40 sec latency 20.216 ms 2024-03-25T05:40:23.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 89516 12.18 MB/sec warmup 41 sec latency 61.431 ms 2024-03-25T05:40:24.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 92409 12.31 MB/sec warmup 42 sec latency 65.844 ms 2024-03-25T05:40:25.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 94247 12.18 MB/sec warmup 43 sec latency 18.368 ms 2024-03-25T05:40:26.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 96374 12.21 MB/sec warmup 44 sec latency 8.950 ms 2024-03-25T05:40:27.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 98836 12.22 MB/sec warmup 45 sec latency 17.014 ms 2024-03-25T05:40:28.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 100545 12.14 MB/sec warmup 46 sec latency 11.807 ms 2024-03-25T05:40:29.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 103168 12.24 MB/sec warmup 47 sec latency 22.530 ms 2024-03-25T05:40:30.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 104771 12.10 MB/sec warmup 48 sec latency 147.409 ms 2024-03-25T05:40:31.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 106930 12.14 MB/sec warmup 49 sec latency 11.933 ms 2024-03-25T05:40:32.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 109233 12.11 MB/sec warmup 50 sec latency 17.126 ms 2024-03-25T05:40:33.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 110785 12.04 MB/sec warmup 51 sec latency 17.605 ms 2024-03-25T05:40:34.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 113523 12.14 MB/sec warmup 52 sec latency 23.449 ms 2024-03-25T05:40:34.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:40:34.747 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:40:35.313 INFO:tasks.workunit.client.0.smithi102.stdout: 1 114996 12.04 MB/sec warmup 53 sec latency 13.985 ms 2024-03-25T05:40:36.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 117505 12.07 MB/sec warmup 54 sec latency 11.692 ms 2024-03-25T05:40:37.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 119699 12.00 MB/sec warmup 55 sec latency 22.627 ms 2024-03-25T05:40:38.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 121439 11.99 MB/sec warmup 56 sec latency 14.605 ms 2024-03-25T05:40:39.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 122328 11.87 MB/sec warmup 57 sec latency 428.482 ms 2024-03-25T05:40:40.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 123068 11.69 MB/sec warmup 58 sec latency 333.154 ms 2024-03-25T05:40:41.314 INFO:tasks.workunit.client.0.smithi102.stdout: 1 124142 11.67 MB/sec warmup 59 sec latency 25.797 ms 2024-03-25T05:40:42.315 INFO:tasks.workunit.client.0.smithi102.stdout: 1 125286 11.54 MB/sec warmup 60 sec latency 18.579 ms 2024-03-25T05:40:43.315 INFO:tasks.workunit.client.0.smithi102.stdout: 1 128086 11.63 MB/sec warmup 61 sec latency 13.980 ms 2024-03-25T05:40:44.315 INFO:tasks.workunit.client.0.smithi102.stdout: 1 130105 11.55 MB/sec warmup 62 sec latency 32.343 ms 2024-03-25T05:40:45.315 INFO:tasks.workunit.client.0.smithi102.stdout: 1 130935 11.47 MB/sec warmup 63 sec latency 209.827 ms 2024-03-25T05:40:46.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 132335 11.41 MB/sec warmup 64 sec latency 17.526 ms 2024-03-25T05:40:47.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 135073 11.50 MB/sec warmup 65 sec latency 15.455 ms 2024-03-25T05:40:48.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 137190 11.43 MB/sec warmup 66 sec latency 17.380 ms 2024-03-25T05:40:49.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 139055 11.45 MB/sec warmup 67 sec latency 11.170 ms 2024-03-25T05:40:50.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 141879 11.53 MB/sec warmup 68 sec latency 13.613 ms 2024-03-25T05:40:51.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 143313 11.46 MB/sec warmup 69 sec latency 18.364 ms 2024-03-25T05:40:52.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 145758 11.50 MB/sec warmup 70 sec latency 9.031 ms 2024-03-25T05:40:53.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 147890 11.44 MB/sec warmup 71 sec latency 20.735 ms 2024-03-25T05:40:54.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 149717 11.45 MB/sec warmup 72 sec latency 18.332 ms 2024-03-25T05:40:55.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 152378 11.49 MB/sec warmup 73 sec latency 41.391 ms 2024-03-25T05:40:56.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 153830 11.42 MB/sec warmup 74 sec latency 12.132 ms 2024-03-25T05:40:57.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 156386 11.49 MB/sec warmup 75 sec latency 11.614 ms 2024-03-25T05:40:58.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 158494 11.44 MB/sec warmup 76 sec latency 13.036 ms 2024-03-25T05:40:59.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 160246 11.45 MB/sec warmup 77 sec latency 21.430 ms 2024-03-25T05:41:00.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 163010 11.49 MB/sec warmup 78 sec latency 20.186 ms 2024-03-25T05:41:01.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 164618 11.46 MB/sec warmup 79 sec latency 22.245 ms 2024-03-25T05:41:02.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 167103 11.50 MB/sec warmup 80 sec latency 11.570 ms 2024-03-25T05:41:03.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 169150 11.44 MB/sec warmup 81 sec latency 18.475 ms 2024-03-25T05:41:04.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 170971 11.45 MB/sec warmup 82 sec latency 12.698 ms 2024-03-25T05:41:04.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:41:04.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:41:05.316 INFO:tasks.workunit.client.0.smithi102.stdout: 1 173624 11.48 MB/sec warmup 83 sec latency 18.367 ms 2024-03-25T05:41:06.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 175006 11.43 MB/sec warmup 84 sec latency 11.745 ms 2024-03-25T05:41:07.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 177612 11.49 MB/sec warmup 85 sec latency 19.177 ms 2024-03-25T05:41:08.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 179664 11.44 MB/sec warmup 86 sec latency 25.518 ms 2024-03-25T05:41:09.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 181466 11.45 MB/sec warmup 87 sec latency 11.899 ms 2024-03-25T05:41:10.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 183508 11.41 MB/sec warmup 88 sec latency 18.278 ms 2024-03-25T05:41:11.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 185236 11.41 MB/sec warmup 89 sec latency 15.325 ms 2024-03-25T05:41:12.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 187994 11.47 MB/sec warmup 90 sec latency 10.820 ms 2024-03-25T05:41:13.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 189397 11.42 MB/sec warmup 91 sec latency 18.983 ms 2024-03-25T05:41:14.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 191875 11.45 MB/sec warmup 92 sec latency 12.843 ms 2024-03-25T05:41:15.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 193187 11.38 MB/sec warmup 93 sec latency 78.774 ms 2024-03-25T05:41:16.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 195342 11.41 MB/sec warmup 94 sec latency 22.634 ms 2024-03-25T05:41:17.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 197513 11.37 MB/sec warmup 95 sec latency 16.162 ms 2024-03-25T05:41:18.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 199256 11.37 MB/sec warmup 96 sec latency 22.690 ms 2024-03-25T05:41:19.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 201420 11.37 MB/sec warmup 97 sec latency 205.024 ms 2024-03-25T05:41:20.317 INFO:tasks.workunit.client.0.smithi102.stdout: 1 202189 11.32 MB/sec warmup 98 sec latency 618.906 ms 2024-03-25T05:41:21.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 202212 11.20 MB/sec warmup 99 sec latency 308.701 ms 2024-03-25T05:41:22.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 202734 11.11 MB/sec warmup 100 sec latency 390.371 ms 2024-03-25T05:41:23.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 203596 11.05 MB/sec warmup 101 sec latency 27.586 ms 2024-03-25T05:41:24.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 205676 11.06 MB/sec warmup 102 sec latency 23.761 ms 2024-03-25T05:41:25.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 206837 10.99 MB/sec warmup 103 sec latency 21.342 ms 2024-03-25T05:41:26.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 209425 11.04 MB/sec warmup 104 sec latency 17.969 ms 2024-03-25T05:41:27.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 211086 11.00 MB/sec warmup 105 sec latency 22.087 ms 2024-03-25T05:41:28.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 213376 11.02 MB/sec warmup 106 sec latency 14.783 ms 2024-03-25T05:41:29.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 215872 11.04 MB/sec warmup 107 sec latency 20.802 ms 2024-03-25T05:41:30.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 217335 11.00 MB/sec warmup 108 sec latency 22.613 ms 2024-03-25T05:41:31.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 220087 11.06 MB/sec warmup 109 sec latency 10.424 ms 2024-03-25T05:41:32.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 221224 10.99 MB/sec warmup 110 sec latency 20.408 ms 2024-03-25T05:41:33.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 223798 11.04 MB/sec warmup 111 sec latency 14.565 ms 2024-03-25T05:41:34.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 225898 11.01 MB/sec warmup 112 sec latency 13.209 ms 2024-03-25T05:41:35.234 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:41:35.238 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:41:35.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 227608 11.02 MB/sec warmup 113 sec latency 18.698 ms 2024-03-25T05:41:36.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 229813 11.02 MB/sec warmup 114 sec latency 21.098 ms 2024-03-25T05:41:37.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 231326 10.99 MB/sec warmup 115 sec latency 12.015 ms 2024-03-25T05:41:38.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 233772 11.01 MB/sec warmup 116 sec latency 16.284 ms 2024-03-25T05:41:39.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 235197 10.98 MB/sec warmup 117 sec latency 18.887 ms 2024-03-25T05:41:40.318 INFO:tasks.workunit.client.0.smithi102.stdout: 1 237953 11.03 MB/sec warmup 118 sec latency 9.065 ms 2024-03-25T05:41:41.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 240042 11.00 MB/sec warmup 119 sec latency 19.385 ms 2024-03-25T05:41:43.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 244541 14.40 MB/sec execute 1 sec latency 22.734 ms 2024-03-25T05:41:44.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 245779 10.03 MB/sec execute 2 sec latency 22.632 ms 2024-03-25T05:41:45.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 248546 12.64 MB/sec execute 3 sec latency 11.192 ms 2024-03-25T05:41:46.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 250589 11.01 MB/sec execute 4 sec latency 15.836 ms 2024-03-25T05:41:47.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 252538 11.49 MB/sec execute 5 sec latency 12.764 ms 2024-03-25T05:41:48.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 255374 12.46 MB/sec execute 6 sec latency 8.705 ms 2024-03-25T05:41:49.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 256672 11.23 MB/sec execute 7 sec latency 17.666 ms 2024-03-25T05:41:50.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 259118 11.79 MB/sec execute 8 sec latency 9.072 ms 2024-03-25T05:41:51.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 260563 11.20 MB/sec execute 9 sec latency 15.329 ms 2024-03-25T05:41:52.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 262852 11.47 MB/sec execute 10 sec latency 13.658 ms 2024-03-25T05:41:53.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 264953 11.08 MB/sec execute 11 sec latency 12.854 ms 2024-03-25T05:41:54.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 266745 11.17 MB/sec execute 12 sec latency 14.963 ms 2024-03-25T05:41:55.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 269233 11.31 MB/sec execute 13 sec latency 28.427 ms 2024-03-25T05:41:56.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 270214 10.93 MB/sec execute 14 sec latency 283.254 ms 2024-03-25T05:41:57.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 270505 10.24 MB/sec execute 15 sec latency 516.601 ms 2024-03-25T05:41:58.319 INFO:tasks.workunit.client.0.smithi102.stdout: 1 272496 10.30 MB/sec execute 16 sec latency 231.080 ms 2024-03-25T05:41:59.320 INFO:tasks.workunit.client.0.smithi102.stdout: 1 273359 10.10 MB/sec execute 17 sec latency 20.499 ms 2024-03-25T05:42:00.320 INFO:tasks.workunit.client.0.smithi102.stdout: 1 274335 9.67 MB/sec execute 18 sec latency 20.639 ms 2024-03-25T05:42:01.320 INFO:tasks.workunit.client.0.smithi102.stdout: 1 276070 9.71 MB/sec execute 19 sec latency 301.174 ms 2024-03-25T05:42:02.321 INFO:tasks.workunit.client.0.smithi102.stdout: 1 277370 9.57 MB/sec execute 20 sec latency 110.248 ms 2024-03-25T05:42:03.321 INFO:tasks.workunit.client.0.smithi102.stdout: 1 279275 9.48 MB/sec execute 21 sec latency 154.894 ms 2024-03-25T05:42:04.321 INFO:tasks.workunit.client.0.smithi102.stdout: 1 280779 9.56 MB/sec execute 22 sec latency 23.309 ms 2024-03-25T05:42:05.321 INFO:tasks.workunit.client.0.smithi102.stdout: 1 283214 9.69 MB/sec execute 23 sec latency 20.954 ms 2024-03-25T05:42:05.357 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:42:05.362 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:42:06.322 INFO:tasks.workunit.client.0.smithi102.stdout: 1 284611 9.58 MB/sec execute 24 sec latency 19.234 ms 2024-03-25T05:42:07.321 INFO:tasks.workunit.client.0.smithi102.stdout: 1 287439 9.89 MB/sec execute 25 sec latency 11.165 ms 2024-03-25T05:42:08.322 INFO:tasks.workunit.client.0.smithi102.stdout: 1 288972 9.76 MB/sec execute 26 sec latency 26.309 ms 2024-03-25T05:42:09.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 291286 9.91 MB/sec execute 27 sec latency 22.438 ms 2024-03-25T05:42:10.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 293643 9.95 MB/sec execute 28 sec latency 11.569 ms 2024-03-25T05:42:11.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 295224 9.91 MB/sec execute 29 sec latency 20.560 ms 2024-03-25T05:42:12.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 297699 10.04 MB/sec execute 30 sec latency 21.440 ms 2024-03-25T05:42:13.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 298963 9.90 MB/sec execute 31 sec latency 10.396 ms 2024-03-25T05:42:14.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 301637 10.11 MB/sec execute 32 sec latency 18.281 ms 2024-03-25T05:42:15.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 302948 10.00 MB/sec execute 33 sec latency 14.372 ms 2024-03-25T05:42:16.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 305312 10.11 MB/sec execute 34 sec latency 18.616 ms 2024-03-25T05:42:17.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 306829 9.98 MB/sec execute 35 sec latency 14.556 ms 2024-03-25T05:42:18.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 309059 10.09 MB/sec execute 36 sec latency 16.345 ms 2024-03-25T05:42:19.323 INFO:tasks.workunit.client.0.smithi102.stdout: 1 311528 10.16 MB/sec execute 37 sec latency 11.172 ms 2024-03-25T05:42:20.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 312961 10.08 MB/sec execute 38 sec latency 30.393 ms 2024-03-25T05:42:21.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 315543 10.18 MB/sec execute 39 sec latency 15.222 ms 2024-03-25T05:42:22.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 316859 10.09 MB/sec execute 40 sec latency 22.034 ms 2024-03-25T05:42:23.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 319411 10.23 MB/sec execute 41 sec latency 17.301 ms 2024-03-25T05:42:24.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 321022 10.14 MB/sec execute 42 sec latency 19.651 ms 2024-03-25T05:42:25.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 323187 10.23 MB/sec execute 43 sec latency 20.542 ms 2024-03-25T05:42:26.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 325230 10.16 MB/sec execute 44 sec latency 12.840 ms 2024-03-25T05:42:27.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 327004 10.20 MB/sec execute 45 sec latency 16.987 ms 2024-03-25T05:42:28.324 INFO:tasks.workunit.client.0.smithi102.stdout: 1 329313 10.25 MB/sec execute 46 sec latency 27.619 ms 2024-03-25T05:42:29.325 INFO:tasks.workunit.client.0.smithi102.stdout: 1 330799 10.18 MB/sec execute 47 sec latency 15.553 ms 2024-03-25T05:42:30.325 INFO:tasks.workunit.client.0.smithi102.stdout: 1 333519 10.33 MB/sec execute 48 sec latency 19.255 ms 2024-03-25T05:42:31.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 334921 10.25 MB/sec execute 49 sec latency 21.296 ms 2024-03-25T05:42:32.327 INFO:tasks.workunit.client.0.smithi102.stdout: 1 337244 10.32 MB/sec execute 50 sec latency 23.031 ms 2024-03-25T05:42:33.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 338412 10.22 MB/sec execute 51 sec latency 122.040 ms 2024-03-25T05:42:34.327 INFO:tasks.workunit.client.0.smithi102.stdout: 1 340746 10.29 MB/sec execute 52 sec latency 24.452 ms 2024-03-25T05:42:35.327 INFO:tasks.workunit.client.0.smithi102.stdout: 1 342873 10.23 MB/sec execute 53 sec latency 14.918 ms 2024-03-25T05:42:35.478 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:42:35.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:42:36.327 INFO:tasks.workunit.client.0.smithi102.stdout: 1 343878 10.18 MB/sec execute 54 sec latency 323.952 ms 2024-03-25T05:42:37.327 INFO:tasks.workunit.client.0.smithi102.stdout: 1 345306 10.12 MB/sec execute 55 sec latency 330.413 ms 2024-03-25T05:42:38.327 INFO:tasks.workunit.client.0.smithi102.stdout: 1 346986 10.12 MB/sec execute 56 sec latency 356.085 ms 2024-03-25T05:42:39.327 INFO:tasks.workunit.client.0.smithi102.stdout: 1 348074 10.06 MB/sec execute 57 sec latency 660.126 ms 2024-03-25T05:42:40.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 348894 9.93 MB/sec execute 58 sec latency 38.470 ms 2024-03-25T05:42:41.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 350607 9.93 MB/sec execute 59 sec latency 221.710 ms 2024-03-25T05:42:42.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 352364 9.91 MB/sec execute 60 sec latency 14.002 ms 2024-03-25T05:42:43.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 354923 10.02 MB/sec execute 61 sec latency 19.898 ms 2024-03-25T05:42:44.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 355384 9.87 MB/sec execute 62 sec latency 95.579 ms 2024-03-25T05:42:45.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 356395 9.79 MB/sec execute 63 sec latency 30.532 ms 2024-03-25T05:42:46.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 358663 9.86 MB/sec execute 64 sec latency 13.855 ms 2024-03-25T05:42:47.328 INFO:tasks.workunit.client.0.smithi102.stdout: 1 361008 9.87 MB/sec execute 65 sec latency 12.999 ms 2024-03-25T05:42:48.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 362508 9.85 MB/sec execute 66 sec latency 26.205 ms 2024-03-25T05:42:49.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 365086 9.92 MB/sec execute 67 sec latency 22.549 ms 2024-03-25T05:42:50.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 366591 9.87 MB/sec execute 68 sec latency 9.477 ms 2024-03-25T05:42:51.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 369153 9.97 MB/sec execute 69 sec latency 16.443 ms 2024-03-25T05:42:52.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 370660 9.91 MB/sec execute 70 sec latency 15.390 ms 2024-03-25T05:42:53.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 372843 9.96 MB/sec execute 71 sec latency 20.651 ms 2024-03-25T05:42:54.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 374821 9.92 MB/sec execute 72 sec latency 12.172 ms 2024-03-25T05:42:55.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 376559 9.95 MB/sec execute 73 sec latency 15.816 ms 2024-03-25T05:42:56.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 378512 9.92 MB/sec execute 74 sec latency 22.697 ms 2024-03-25T05:42:57.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 380129 9.94 MB/sec execute 75 sec latency 10.332 ms 2024-03-25T05:42:58.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 382439 9.96 MB/sec execute 76 sec latency 22.661 ms 2024-03-25T05:42:59.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 383842 9.94 MB/sec execute 77 sec latency 10.912 ms 2024-03-25T05:43:00.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 386060 9.97 MB/sec execute 78 sec latency 28.050 ms 2024-03-25T05:43:01.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 387466 9.93 MB/sec execute 79 sec latency 14.050 ms 2024-03-25T05:43:02.329 INFO:tasks.workunit.client.0.smithi102.stdout: 1 389882 9.97 MB/sec execute 80 sec latency 25.955 ms 2024-03-25T05:43:03.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 391471 9.94 MB/sec execute 81 sec latency 8.820 ms 2024-03-25T05:43:04.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 393923 10.01 MB/sec execute 82 sec latency 23.399 ms 2024-03-25T05:43:05.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 395426 9.97 MB/sec execute 83 sec latency 17.786 ms 2024-03-25T05:43:06.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 397617 10.01 MB/sec execute 84 sec latency 22.112 ms 2024-03-25T05:43:06.411 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:43:06.417 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:43:07.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 399303 9.96 MB/sec execute 85 sec latency 19.737 ms 2024-03-25T05:43:08.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 401257 10.00 MB/sec execute 86 sec latency 13.510 ms 2024-03-25T05:43:09.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 403300 9.97 MB/sec execute 87 sec latency 16.757 ms 2024-03-25T05:43:10.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 405067 10.00 MB/sec execute 88 sec latency 22.250 ms 2024-03-25T05:43:11.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 407398 10.02 MB/sec execute 89 sec latency 20.446 ms 2024-03-25T05:43:12.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 408938 10.00 MB/sec execute 90 sec latency 10.644 ms 2024-03-25T05:43:13.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 411524 10.07 MB/sec execute 91 sec latency 25.298 ms 2024-03-25T05:43:14.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 412944 10.03 MB/sec execute 92 sec latency 19.132 ms 2024-03-25T05:43:15.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 414990 10.06 MB/sec execute 93 sec latency 96.522 ms 2024-03-25T05:43:16.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 416423 10.02 MB/sec execute 94 sec latency 12.946 ms 2024-03-25T05:43:17.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 418412 10.01 MB/sec execute 95 sec latency 278.000 ms 2024-03-25T05:43:18.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 419805 9.98 MB/sec execute 96 sec latency 12.616 ms 2024-03-25T05:43:19.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 422291 10.04 MB/sec execute 97 sec latency 23.051 ms 2024-03-25T05:43:20.331 INFO:tasks.workunit.client.0.smithi102.stdout: 1 422432 9.95 MB/sec execute 98 sec latency 189.391 ms 2024-03-25T05:43:21.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 423134 9.86 MB/sec execute 99 sec latency 36.913 ms 2024-03-25T05:43:22.331 INFO:tasks.workunit.client.0.smithi102.stdout: 1 423836 9.80 MB/sec execute 100 sec latency 283.970 ms 2024-03-25T05:43:23.330 INFO:tasks.workunit.client.0.smithi102.stdout: 1 426065 9.84 MB/sec execute 101 sec latency 25.123 ms 2024-03-25T05:43:24.331 INFO:tasks.workunit.client.0.smithi102.stdout: 1 428116 9.82 MB/sec execute 102 sec latency 17.959 ms 2024-03-25T05:43:25.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 429560 9.84 MB/sec execute 103 sec latency 139.859 ms 2024-03-25T05:43:26.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 430125 9.75 MB/sec execute 104 sec latency 162.407 ms 2024-03-25T05:43:27.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 432883 9.82 MB/sec execute 105 sec latency 10.176 ms 2024-03-25T05:43:28.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 434415 9.79 MB/sec execute 106 sec latency 25.785 ms 2024-03-25T05:43:29.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 436701 9.83 MB/sec execute 107 sec latency 17.095 ms 2024-03-25T05:43:30.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 438754 9.80 MB/sec execute 108 sec latency 21.953 ms 2024-03-25T05:43:31.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 440544 9.82 MB/sec execute 109 sec latency 13.307 ms 2024-03-25T05:43:32.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 443182 9.86 MB/sec execute 110 sec latency 19.140 ms 2024-03-25T05:43:33.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 444348 9.83 MB/sec execute 111 sec latency 20.718 ms 2024-03-25T05:43:34.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 447056 9.89 MB/sec execute 112 sec latency 11.454 ms 2024-03-25T05:43:35.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 448505 9.86 MB/sec execute 113 sec latency 22.957 ms 2024-03-25T05:43:36.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 450861 9.90 MB/sec execute 114 sec latency 10.347 ms 2024-03-25T05:43:36.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:43:36.568 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:43:37.332 INFO:tasks.workunit.client.0.smithi102.stdout: 1 452410 9.86 MB/sec execute 115 sec latency 33.518 ms 2024-03-25T05:43:38.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 454454 9.89 MB/sec execute 116 sec latency 12.496 ms 2024-03-25T05:43:39.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 456385 9.86 MB/sec execute 117 sec latency 23.672 ms 2024-03-25T05:43:40.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 458143 9.88 MB/sec execute 118 sec latency 12.904 ms 2024-03-25T05:43:41.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 459517 10.00 MB/sec execute 119 sec latency 77.406 ms 2024-03-25T05:43:42.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 462165 10.05 MB/sec execute 120 sec latency 9.739 ms 2024-03-25T05:43:43.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 463462 10.01 MB/sec execute 121 sec latency 28.013 ms 2024-03-25T05:43:44.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 465859 10.05 MB/sec execute 122 sec latency 9.882 ms 2024-03-25T05:43:45.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 467937 10.03 MB/sec execute 123 sec latency 11.688 ms 2024-03-25T05:43:46.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 469564 10.04 MB/sec execute 124 sec latency 20.023 ms 2024-03-25T05:43:47.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 471969 10.06 MB/sec execute 125 sec latency 11.000 ms 2024-03-25T05:43:48.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 473352 10.04 MB/sec execute 126 sec latency 12.530 ms 2024-03-25T05:43:49.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 476091 10.09 MB/sec execute 127 sec latency 11.670 ms 2024-03-25T05:43:50.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 477159 10.04 MB/sec execute 128 sec latency 22.264 ms 2024-03-25T05:43:51.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 478517 10.00 MB/sec execute 129 sec latency 252.228 ms 2024-03-25T05:43:52.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 479980 10.01 MB/sec execute 130 sec latency 30.096 ms 2024-03-25T05:43:53.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 481808 9.98 MB/sec execute 131 sec latency 19.344 ms 2024-03-25T05:43:54.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 483880 10.01 MB/sec execute 132 sec latency 8.618 ms 2024-03-25T05:43:55.333 INFO:tasks.workunit.client.0.smithi102.stdout: 1 486553 10.04 MB/sec execute 133 sec latency 10.320 ms 2024-03-25T05:43:56.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 487151 10.00 MB/sec execute 134 sec latency 293.129 ms 2024-03-25T05:43:57.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 487550 9.93 MB/sec execute 135 sec latency 250.975 ms 2024-03-25T05:43:58.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 489529 9.94 MB/sec execute 136 sec latency 24.373 ms 2024-03-25T05:43:59.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 491050 9.93 MB/sec execute 137 sec latency 21.259 ms 2024-03-25T05:44:00.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 493835 9.98 MB/sec execute 138 sec latency 10.305 ms 2024-03-25T05:44:01.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 495073 9.93 MB/sec execute 139 sec latency 20.156 ms 2024-03-25T05:44:02.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 497631 9.98 MB/sec execute 140 sec latency 15.481 ms 2024-03-25T05:44:03.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 499068 9.95 MB/sec execute 141 sec latency 24.990 ms 2024-03-25T05:44:04.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 501391 9.98 MB/sec execute 142 sec latency 20.516 ms 2024-03-25T05:44:05.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 503537 9.97 MB/sec execute 143 sec latency 23.548 ms 2024-03-25T05:44:06.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 505318 9.98 MB/sec execute 144 sec latency 10.010 ms 2024-03-25T05:44:06.706 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:44:06.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:44:07.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 508014 10.02 MB/sec execute 145 sec latency 26.920 ms 2024-03-25T05:44:08.334 INFO:tasks.workunit.client.0.smithi102.stdout: 1 509527 10.00 MB/sec execute 146 sec latency 10.672 ms 2024-03-25T05:44:09.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 511882 10.03 MB/sec execute 147 sec latency 16.697 ms 2024-03-25T05:44:10.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 513958 10.01 MB/sec execute 148 sec latency 21.702 ms 2024-03-25T05:44:11.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 515718 10.02 MB/sec execute 149 sec latency 9.170 ms 2024-03-25T05:44:12.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 518127 10.04 MB/sec execute 150 sec latency 19.743 ms 2024-03-25T05:44:13.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 519617 10.02 MB/sec execute 151 sec latency 14.848 ms 2024-03-25T05:44:14.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 522168 10.07 MB/sec execute 152 sec latency 17.085 ms 2024-03-25T05:44:15.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 523464 10.02 MB/sec execute 153 sec latency 21.772 ms 2024-03-25T05:44:16.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 526049 10.07 MB/sec execute 154 sec latency 13.384 ms 2024-03-25T05:44:17.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 527905 10.04 MB/sec execute 155 sec latency 38.374 ms 2024-03-25T05:44:18.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 529771 10.06 MB/sec execute 156 sec latency 9.429 ms 2024-03-25T05:44:19.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 531718 10.04 MB/sec execute 157 sec latency 23.482 ms 2024-03-25T05:44:20.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 533342 10.06 MB/sec execute 158 sec latency 10.317 ms 2024-03-25T05:44:21.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 535342 10.04 MB/sec execute 159 sec latency 20.927 ms 2024-03-25T05:44:22.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 537112 10.05 MB/sec execute 160 sec latency 19.486 ms 2024-03-25T05:44:23.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 539358 10.07 MB/sec execute 161 sec latency 19.235 ms 2024-03-25T05:44:24.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 540690 10.05 MB/sec execute 162 sec latency 17.456 ms 2024-03-25T05:44:25.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 543348 10.07 MB/sec execute 163 sec latency 19.735 ms 2024-03-25T05:44:26.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 544675 10.05 MB/sec execute 164 sec latency 12.945 ms 2024-03-25T05:44:27.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 547058 10.08 MB/sec execute 165 sec latency 137.643 ms 2024-03-25T05:44:28.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 548234 10.05 MB/sec execute 166 sec latency 32.441 ms 2024-03-25T05:44:29.335 INFO:tasks.workunit.client.0.smithi102.stdout: 1 550856 10.09 MB/sec execute 167 sec latency 16.945 ms 2024-03-25T05:44:30.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 552649 10.06 MB/sec execute 168 sec latency 17.826 ms 2024-03-25T05:44:31.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 554719 10.08 MB/sec execute 169 sec latency 12.546 ms 2024-03-25T05:44:32.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 556578 10.06 MB/sec execute 170 sec latency 58.924 ms 2024-03-25T05:44:33.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 558072 10.08 MB/sec execute 171 sec latency 76.703 ms 2024-03-25T05:44:34.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 560051 10.06 MB/sec execute 172 sec latency 13.917 ms 2024-03-25T05:44:35.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 561691 10.07 MB/sec execute 173 sec latency 12.503 ms 2024-03-25T05:44:36.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 563825 10.06 MB/sec execute 174 sec latency 17.015 ms 2024-03-25T05:44:36.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:44:36.894 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:44:37.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 565117 10.06 MB/sec execute 175 sec latency 274.121 ms 2024-03-25T05:44:38.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 565575 10.01 MB/sec execute 176 sec latency 267.744 ms 2024-03-25T05:44:39.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 568323 10.05 MB/sec execute 177 sec latency 11.045 ms 2024-03-25T05:44:40.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 569523 10.01 MB/sec execute 178 sec latency 14.293 ms 2024-03-25T05:44:41.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 572026 10.05 MB/sec execute 179 sec latency 20.695 ms 2024-03-25T05:44:42.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 573555 10.03 MB/sec execute 180 sec latency 15.731 ms 2024-03-25T05:44:43.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 574342 9.98 MB/sec execute 181 sec latency 372.324 ms 2024-03-25T05:44:44.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 575772 9.99 MB/sec execute 182 sec latency 42.774 ms 2024-03-25T05:44:45.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 576412 9.94 MB/sec execute 183 sec latency 24.804 ms 2024-03-25T05:44:46.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 579074 9.98 MB/sec execute 184 sec latency 20.690 ms 2024-03-25T05:44:47.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 580430 9.96 MB/sec execute 185 sec latency 20.462 ms 2024-03-25T05:44:48.336 INFO:tasks.workunit.client.0.smithi102.stdout: 1 582466 9.97 MB/sec execute 186 sec latency 141.487 ms 2024-03-25T05:44:49.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 582909 9.93 MB/sec execute 187 sec latency 167.584 ms 2024-03-25T05:44:50.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 583998 9.90 MB/sec execute 188 sec latency 22.780 ms 2024-03-25T05:44:51.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 586316 9.92 MB/sec execute 189 sec latency 11.931 ms 2024-03-25T05:44:52.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 587580 9.90 MB/sec execute 190 sec latency 80.260 ms 2024-03-25T05:44:53.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 590000 9.92 MB/sec execute 191 sec latency 8.517 ms 2024-03-25T05:44:54.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 592029 9.91 MB/sec execute 192 sec latency 10.562 ms 2024-03-25T05:44:55.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 593727 9.92 MB/sec execute 193 sec latency 21.301 ms 2024-03-25T05:44:56.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 596083 9.93 MB/sec execute 194 sec latency 19.020 ms 2024-03-25T05:44:57.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 597512 9.92 MB/sec execute 195 sec latency 12.552 ms 2024-03-25T05:44:58.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 599270 9.90 MB/sec execute 196 sec latency 224.869 ms 2024-03-25T05:44:59.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 600971 9.91 MB/sec execute 197 sec latency 8.801 ms 2024-03-25T05:45:00.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 603610 9.93 MB/sec execute 198 sec latency 17.094 ms 2024-03-25T05:45:01.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 604987 9.92 MB/sec execute 199 sec latency 12.676 ms 2024-03-25T05:45:02.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 607594 9.95 MB/sec execute 200 sec latency 16.791 ms 2024-03-25T05:45:03.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 608993 9.93 MB/sec execute 201 sec latency 25.268 ms 2024-03-25T05:45:04.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 611287 9.95 MB/sec execute 202 sec latency 13.312 ms 2024-03-25T05:45:05.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 613311 9.94 MB/sec execute 203 sec latency 17.386 ms 2024-03-25T05:45:06.337 INFO:tasks.workunit.client.0.smithi102.stdout: 1 614976 9.95 MB/sec execute 204 sec latency 11.175 ms 2024-03-25T05:45:07.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 617203 9.95 MB/sec execute 205 sec latency 27.180 ms 2024-03-25T05:45:07.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:45:07.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:45:08.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 618721 9.94 MB/sec execute 206 sec latency 14.138 ms 2024-03-25T05:45:09.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 621354 9.96 MB/sec execute 207 sec latency 15.299 ms 2024-03-25T05:45:10.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 622697 9.95 MB/sec execute 208 sec latency 21.885 ms 2024-03-25T05:45:11.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 625288 9.98 MB/sec execute 209 sec latency 10.225 ms 2024-03-25T05:45:12.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 626613 9.96 MB/sec execute 210 sec latency 18.401 ms 2024-03-25T05:45:13.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 628869 9.98 MB/sec execute 211 sec latency 11.194 ms 2024-03-25T05:45:14.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 630266 9.96 MB/sec execute 212 sec latency 21.470 ms 2024-03-25T05:45:15.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 632605 9.97 MB/sec execute 213 sec latency 9.472 ms 2024-03-25T05:45:16.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 634664 9.96 MB/sec execute 214 sec latency 22.989 ms 2024-03-25T05:45:17.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 636388 9.97 MB/sec execute 215 sec latency 18.598 ms 2024-03-25T05:45:18.338 INFO:tasks.workunit.client.0.smithi102.stdout: 1 638147 9.96 MB/sec execute 216 sec latency 250.645 ms 2024-03-25T05:45:19.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 638915 9.94 MB/sec execute 217 sec latency 475.943 ms 2024-03-25T05:45:20.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 639720 9.92 MB/sec execute 218 sec latency 313.442 ms 2024-03-25T05:45:21.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 640488 9.89 MB/sec execute 219 sec latency 29.359 ms 2024-03-25T05:45:22.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 643054 9.92 MB/sec execute 220 sec latency 9.510 ms 2024-03-25T05:45:23.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 644504 9.90 MB/sec execute 221 sec latency 13.962 ms 2024-03-25T05:45:24.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 646021 9.89 MB/sec execute 222 sec latency 259.193 ms 2024-03-25T05:45:25.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 647091 9.87 MB/sec execute 223 sec latency 121.321 ms 2024-03-25T05:45:26.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 648908 9.86 MB/sec execute 224 sec latency 24.646 ms 2024-03-25T05:45:27.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 650567 9.87 MB/sec execute 225 sec latency 16.248 ms 2024-03-25T05:45:28.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 653201 9.89 MB/sec execute 226 sec latency 9.797 ms 2024-03-25T05:45:29.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 654384 9.87 MB/sec execute 227 sec latency 24.281 ms 2024-03-25T05:45:30.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 657045 9.90 MB/sec execute 228 sec latency 14.517 ms 2024-03-25T05:45:31.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 658269 9.87 MB/sec execute 229 sec latency 26.063 ms 2024-03-25T05:45:32.339 INFO:tasks.workunit.client.0.smithi102.stdout: 1 660771 9.90 MB/sec execute 230 sec latency 11.080 ms 2024-03-25T05:45:33.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 662189 9.88 MB/sec execute 231 sec latency 16.747 ms 2024-03-25T05:45:34.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 664384 9.90 MB/sec execute 232 sec latency 11.668 ms 2024-03-25T05:45:35.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 665967 9.88 MB/sec execute 233 sec latency 26.385 ms 2024-03-25T05:45:36.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 668001 9.90 MB/sec execute 234 sec latency 18.795 ms 2024-03-25T05:45:37.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 670064 9.88 MB/sec execute 235 sec latency 10.303 ms 2024-03-25T05:45:38.109 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:45:38.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:45:38.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 671707 9.89 MB/sec execute 236 sec latency 24.710 ms 2024-03-25T05:45:39.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 674000 9.90 MB/sec execute 237 sec latency 19.700 ms 2024-03-25T05:45:40.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 675477 9.89 MB/sec execute 238 sec latency 27.085 ms 2024-03-25T05:45:41.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 678047 9.91 MB/sec execute 239 sec latency 15.408 ms 2024-03-25T05:45:42.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 679112 9.89 MB/sec execute 240 sec latency 18.874 ms 2024-03-25T05:45:43.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 681515 9.90 MB/sec execute 241 sec latency 12.105 ms 2024-03-25T05:45:44.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 682771 9.89 MB/sec execute 242 sec latency 21.710 ms 2024-03-25T05:45:45.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 685368 9.92 MB/sec execute 243 sec latency 10.751 ms 2024-03-25T05:45:46.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 686379 9.89 MB/sec execute 244 sec latency 16.667 ms 2024-03-25T05:45:47.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 689034 9.91 MB/sec execute 245 sec latency 10.879 ms 2024-03-25T05:45:48.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 690454 9.90 MB/sec execute 246 sec latency 14.692 ms 2024-03-25T05:45:49.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 692759 9.92 MB/sec execute 247 sec latency 11.776 ms 2024-03-25T05:45:50.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 694632 9.90 MB/sec execute 248 sec latency 18.123 ms 2024-03-25T05:45:51.340 INFO:tasks.workunit.client.0.smithi102.stdout: 1 696522 9.91 MB/sec execute 249 sec latency 27.643 ms 2024-03-25T05:45:52.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 698968 9.92 MB/sec execute 250 sec latency 19.656 ms 2024-03-25T05:45:53.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 700324 9.91 MB/sec execute 251 sec latency 21.781 ms 2024-03-25T05:45:54.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 702804 9.93 MB/sec execute 252 sec latency 15.509 ms 2024-03-25T05:45:55.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 703249 9.90 MB/sec execute 253 sec latency 559.634 ms 2024-03-25T05:45:56.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 704099 9.87 MB/sec execute 254 sec latency 87.451 ms 2024-03-25T05:45:57.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 705469 9.86 MB/sec execute 255 sec latency 25.285 ms 2024-03-25T05:45:58.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 707077 9.87 MB/sec execute 256 sec latency 34.645 ms 2024-03-25T05:45:59.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 708232 9.85 MB/sec execute 257 sec latency 292.328 ms 2024-03-25T05:46:00.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 710447 9.86 MB/sec execute 258 sec latency 100.033 ms 2024-03-25T05:46:01.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 711147 9.83 MB/sec execute 259 sec latency 179.192 ms 2024-03-25T05:46:02.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 712805 9.82 MB/sec execute 260 sec latency 27.335 ms 2024-03-25T05:46:03.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 714431 9.83 MB/sec execute 261 sec latency 15.553 ms 2024-03-25T05:46:04.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 716680 9.84 MB/sec execute 262 sec latency 21.822 ms 2024-03-25T05:46:05.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 718055 9.82 MB/sec execute 263 sec latency 19.343 ms 2024-03-25T05:46:06.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 720488 9.84 MB/sec execute 264 sec latency 33.360 ms 2024-03-25T05:46:07.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 721730 9.82 MB/sec execute 265 sec latency 15.528 ms 2024-03-25T05:46:08.282 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:46:08.290 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:46:08.341 INFO:tasks.workunit.client.0.smithi102.stdout: 1 724231 9.84 MB/sec execute 266 sec latency 12.332 ms 2024-03-25T05:46:08.399 INFO:tasks.ceph.mds.a.smithi102.stderr:2024-03-25T05:46:08.409+0000 7f2deba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46503) UID: 0 2024-03-25T05:46:08.400 INFO:tasks.ceph.mds.c.smithi102.stderr:2024-03-25T05:46:08.409+0000 7f147b800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46503) UID: 0 2024-03-25T05:46:08.400 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:46:08.409+0000 7f9adf000640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46503) UID: 0 2024-03-25T05:46:09.342 INFO:tasks.workunit.client.0.smithi102.stdout: 1 725328 9.82 MB/sec execute 267 sec latency 20.559 ms 2024-03-25T05:46:10.342 INFO:tasks.workunit.client.0.smithi102.stdout: 1 727945 9.85 MB/sec execute 268 sec latency 20.221 ms 2024-03-25T05:46:11.344 INFO:tasks.workunit.client.0.smithi102.stdout: 1 728925 9.82 MB/sec execute 269 sec latency 30.922 ms 2024-03-25T05:46:12.342 INFO:tasks.workunit.client.0.smithi102.stdout: 1 731436 9.85 MB/sec execute 270 sec latency 20.639 ms 2024-03-25T05:46:13.342 INFO:tasks.workunit.client.0.smithi102.stdout: 1 732409 9.82 MB/sec execute 271 sec latency 37.711 ms 2024-03-25T05:46:14.342 INFO:tasks.workunit.client.0.smithi102.stdout: 1 735020 9.84 MB/sec execute 272 sec latency 23.889 ms 2024-03-25T05:46:15.344 INFO:tasks.workunit.client.0.smithi102.stdout: 1 736088 9.82 MB/sec execute 273 sec latency 29.401 ms 2024-03-25T05:46:16.344 INFO:tasks.workunit.client.0.smithi102.stdout: 1 738690 9.84 MB/sec execute 274 sec latency 11.304 ms 2024-03-25T05:46:17.344 INFO:tasks.workunit.client.0.smithi102.stdout: 1 739793 9.82 MB/sec execute 275 sec latency 38.818 ms 2024-03-25T05:46:18.344 INFO:tasks.workunit.client.0.smithi102.stdout: 1 742331 9.84 MB/sec execute 276 sec latency 12.692 ms 2024-03-25T05:46:19.344 INFO:tasks.workunit.client.0.smithi102.stdout: 1 743624 9.83 MB/sec execute 277 sec latency 27.888 ms 2024-03-25T05:46:20.345 INFO:tasks.workunit.client.0.smithi102.stdout: 1 745877 9.84 MB/sec execute 278 sec latency 29.406 ms 2024-03-25T05:46:21.345 INFO:tasks.workunit.client.0.smithi102.stdout: 1 747344 9.83 MB/sec execute 279 sec latency 36.651 ms 2024-03-25T05:46:22.345 INFO:tasks.workunit.client.0.smithi102.stdout: 1 749541 9.84 MB/sec execute 280 sec latency 30.473 ms 2024-03-25T05:46:23.346 INFO:tasks.workunit.client.0.smithi102.stdout: 1 751109 9.83 MB/sec execute 281 sec latency 31.262 ms 2024-03-25T05:46:24.345 INFO:tasks.workunit.client.0.smithi102.stdout: 1 753139 9.84 MB/sec execute 282 sec latency 25.112 ms 2024-03-25T05:46:25.345 INFO:tasks.workunit.client.0.smithi102.stdout: 1 754969 9.82 MB/sec execute 283 sec latency 24.492 ms 2024-03-25T05:46:26.345 INFO:tasks.workunit.client.0.smithi102.stdout: 1 756713 9.84 MB/sec execute 284 sec latency 36.065 ms 2024-03-25T05:46:27.346 INFO:tasks.workunit.client.0.smithi102.stdout: 1 758713 9.83 MB/sec execute 285 sec latency 26.291 ms 2024-03-25T05:46:28.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 760472 9.84 MB/sec execute 286 sec latency 11.231 ms 2024-03-25T05:46:29.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 762875 9.84 MB/sec execute 287 sec latency 12.801 ms 2024-03-25T05:46:30.348 INFO:tasks.workunit.client.0.smithi102.stdout: 1 764222 9.83 MB/sec execute 288 sec latency 20.299 ms 2024-03-25T05:46:31.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 766175 9.84 MB/sec execute 289 sec latency 102.981 ms 2024-03-25T05:46:32.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 767552 9.83 MB/sec execute 290 sec latency 39.536 ms 2024-03-25T05:46:33.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 769979 9.84 MB/sec execute 291 sec latency 24.370 ms 2024-03-25T05:46:34.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 771302 9.83 MB/sec execute 292 sec latency 32.471 ms 2024-03-25T05:46:35.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 774009 9.86 MB/sec execute 293 sec latency 21.927 ms 2024-03-25T05:46:36.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 774849 9.83 MB/sec execute 294 sec latency 106.244 ms 2024-03-25T05:46:37.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 776766 9.83 MB/sec execute 295 sec latency 45.264 ms 2024-03-25T05:46:38.348 INFO:tasks.workunit.client.0.smithi102.stdout: 1 778371 9.83 MB/sec execute 296 sec latency 23.641 ms 2024-03-25T05:46:39.347 INFO:tasks.workunit.client.0.smithi102.stdout: 1 780961 9.84 MB/sec execute 297 sec latency 32.349 ms 2024-03-25T05:46:40.348 INFO:tasks.workunit.client.0.smithi102.stdout: 1 782207 9.83 MB/sec execute 298 sec latency 23.810 ms 2024-03-25T05:46:41.348 INFO:tasks.workunit.client.0.smithi102.stdout: 1 784312 9.84 MB/sec execute 299 sec latency 45.830 ms 2024-03-25T05:46:42.350 INFO:tasks.workunit.client.0.smithi102.stdout: 1 785462 9.82 MB/sec execute 300 sec latency 107.205 ms 2024-03-25T05:46:43.350 INFO:tasks.workunit.client.0.smithi102.stdout: 1 787118 9.81 MB/sec execute 301 sec latency 50.136 ms 2024-03-25T05:46:44.350 INFO:tasks.workunit.client.0.smithi102.stdout: 1 788653 9.82 MB/sec execute 302 sec latency 213.172 ms 2024-03-25T05:46:45.350 INFO:tasks.workunit.client.0.smithi102.stdout: 1 790619 9.81 MB/sec execute 303 sec latency 22.752 ms 2024-03-25T05:46:46.355 INFO:tasks.workunit.client.0.smithi102.stdout: 1 792207 9.82 MB/sec execute 304 sec latency 37.760 ms 2024-03-25T05:46:47.352 INFO:tasks.workunit.client.0.smithi102.stdout: 1 792221 9.79 MB/sec execute 305 sec latency 246.118 ms 2024-03-25T05:46:48.354 INFO:tasks.workunit.client.0.smithi102.stdout: 1 792563 9.76 MB/sec execute 306 sec latency 274.069 ms 2024-03-25T05:46:49.355 INFO:tasks.workunit.client.0.smithi102.stdout: 1 793260 9.74 MB/sec execute 307 sec latency 49.421 ms 2024-03-25T05:46:50.355 INFO:tasks.workunit.client.0.smithi102.stdout: 1 795533 9.75 MB/sec execute 308 sec latency 27.232 ms 2024-03-25T05:46:51.355 INFO:tasks.workunit.client.0.smithi102.stdout: 1 797097 9.74 MB/sec execute 309 sec latency 16.079 ms 2024-03-25T05:46:52.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 798876 9.75 MB/sec execute 310 sec latency 215.573 ms 2024-03-25T05:46:53.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 799457 9.72 MB/sec execute 311 sec latency 40.198 ms 2024-03-25T05:46:54.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 801632 9.72 MB/sec execute 312 sec latency 27.692 ms 2024-03-25T05:46:55.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 803144 9.72 MB/sec execute 313 sec latency 10.945 ms 2024-03-25T05:46:56.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 805423 9.73 MB/sec execute 314 sec latency 14.162 ms 2024-03-25T05:46:57.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 806714 9.72 MB/sec execute 315 sec latency 26.927 ms 2024-03-25T05:46:58.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 808947 9.73 MB/sec execute 316 sec latency 18.263 ms 2024-03-25T05:46:59.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 810307 9.72 MB/sec execute 317 sec latency 11.684 ms 2024-03-25T05:47:00.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 812712 9.73 MB/sec execute 318 sec latency 24.733 ms 2024-03-25T05:47:01.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 814034 9.72 MB/sec execute 319 sec latency 10.923 ms 2024-03-25T05:47:02.356 INFO:tasks.workunit.client.0.smithi102.stdout: 1 816568 9.74 MB/sec execute 320 sec latency 30.661 ms 2024-03-25T05:47:03.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 818019 9.73 MB/sec execute 321 sec latency 10.155 ms 2024-03-25T05:47:04.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 820295 9.74 MB/sec execute 322 sec latency 22.417 ms 2024-03-25T05:47:05.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 821693 9.73 MB/sec execute 323 sec latency 19.625 ms 2024-03-25T05:47:06.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 824012 9.74 MB/sec execute 324 sec latency 11.073 ms 2024-03-25T05:47:07.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 825578 9.73 MB/sec execute 325 sec latency 29.916 ms 2024-03-25T05:47:08.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 827614 9.74 MB/sec execute 326 sec latency 32.556 ms 2024-03-25T05:47:09.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 829594 9.73 MB/sec execute 327 sec latency 26.488 ms 2024-03-25T05:47:10.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 831343 9.74 MB/sec execute 328 sec latency 16.317 ms 2024-03-25T05:47:11.357 INFO:tasks.workunit.client.0.smithi102.stdout: 1 833542 9.75 MB/sec execute 329 sec latency 29.008 ms 2024-03-25T05:47:12.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 835126 9.74 MB/sec execute 330 sec latency 10.032 ms 2024-03-25T05:47:13.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 837721 9.75 MB/sec execute 331 sec latency 25.323 ms 2024-03-25T05:47:14.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 838850 9.74 MB/sec execute 332 sec latency 25.754 ms 2024-03-25T05:47:15.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 841567 9.76 MB/sec execute 333 sec latency 11.192 ms 2024-03-25T05:47:16.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 842936 9.75 MB/sec execute 334 sec latency 20.827 ms 2024-03-25T05:47:17.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 845280 9.77 MB/sec execute 335 sec latency 27.730 ms 2024-03-25T05:47:18.359 INFO:tasks.workunit.client.0.smithi102.stdout: 1 845445 9.74 MB/sec execute 336 sec latency 324.972 ms 2024-03-25T05:47:19.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 846010 9.71 MB/sec execute 337 sec latency 119.285 ms 2024-03-25T05:47:20.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 847355 9.70 MB/sec execute 338 sec latency 24.124 ms 2024-03-25T05:47:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 849107 9.71 MB/sec execute 339 sec latency 27.350 ms 2024-03-25T05:47:22.358 INFO:tasks.workunit.client.0.smithi102.stdout: 1 851170 9.70 MB/sec execute 340 sec latency 15.325 ms 2024-03-25T05:47:23.359 INFO:tasks.workunit.client.0.smithi102.stdout: 1 852395 9.71 MB/sec execute 341 sec latency 106.988 ms 2024-03-25T05:47:24.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 852843 9.68 MB/sec execute 342 sec latency 218.116 ms 2024-03-25T05:47:25.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 854793 9.68 MB/sec execute 343 sec latency 40.318 ms 2024-03-25T05:47:26.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 856391 9.68 MB/sec execute 344 sec latency 10.884 ms 2024-03-25T05:47:27.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 858531 9.68 MB/sec execute 345 sec latency 18.397 ms 2024-03-25T05:47:28.361 INFO:tasks.workunit.client.0.smithi102.stdout: 1 859947 9.68 MB/sec execute 346 sec latency 12.177 ms 2024-03-25T05:47:29.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 862214 9.69 MB/sec execute 347 sec latency 22.166 ms 2024-03-25T05:47:30.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 863718 9.68 MB/sec execute 348 sec latency 12.540 ms 2024-03-25T05:47:31.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 866107 9.69 MB/sec execute 349 sec latency 20.574 ms 2024-03-25T05:47:32.360 INFO:tasks.workunit.client.0.smithi102.stdout: 1 867285 9.68 MB/sec execute 350 sec latency 19.338 ms 2024-03-25T05:47:33.361 INFO:tasks.workunit.client.0.smithi102.stdout: 1 869813 9.70 MB/sec execute 351 sec latency 24.130 ms 2024-03-25T05:47:34.361 INFO:tasks.workunit.client.0.smithi102.stdout: 1 870903 9.68 MB/sec execute 352 sec latency 25.439 ms 2024-03-25T05:47:35.361 INFO:tasks.workunit.client.0.smithi102.stdout: 1 873489 9.70 MB/sec execute 353 sec latency 14.515 ms 2024-03-25T05:47:36.362 INFO:tasks.workunit.client.0.smithi102.stdout: 1 874664 9.68 MB/sec execute 354 sec latency 14.697 ms 2024-03-25T05:47:37.362 INFO:tasks.workunit.client.0.smithi102.stdout: 1 877151 9.70 MB/sec execute 355 sec latency 9.309 ms 2024-03-25T05:47:38.362 INFO:tasks.workunit.client.0.smithi102.stdout: 1 878252 9.68 MB/sec execute 356 sec latency 27.683 ms 2024-03-25T05:47:39.362 INFO:tasks.workunit.client.0.smithi102.stdout: 1 880691 9.70 MB/sec execute 357 sec latency 12.003 ms 2024-03-25T05:47:40.362 INFO:tasks.workunit.client.0.smithi102.stdout: 1 882116 9.69 MB/sec execute 358 sec latency 19.008 ms 2024-03-25T05:47:41.362 INFO:tasks.workunit.client.0.smithi102.stdout: 1 884281 9.70 MB/sec execute 359 sec latency 32.258 ms 2024-03-25T05:47:42.362 INFO:tasks.workunit.client.0.smithi102.stdout: 1 885510 9.69 MB/sec execute 360 sec latency 60.049 ms 2024-03-25T05:47:43.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 887819 9.70 MB/sec execute 361 sec latency 10.879 ms 2024-03-25T05:47:44.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 889125 9.69 MB/sec execute 362 sec latency 26.939 ms 2024-03-25T05:47:45.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 891380 9.70 MB/sec execute 363 sec latency 12.024 ms 2024-03-25T05:47:46.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 892668 9.69 MB/sec execute 364 sec latency 20.814 ms 2024-03-25T05:47:47.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 894975 9.70 MB/sec execute 365 sec latency 15.864 ms 2024-03-25T05:47:48.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 896433 9.68 MB/sec execute 366 sec latency 34.447 ms 2024-03-25T05:47:49.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 898341 9.69 MB/sec execute 367 sec latency 249.133 ms 2024-03-25T05:47:50.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 899457 9.68 MB/sec execute 368 sec latency 27.065 ms 2024-03-25T05:47:51.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 901961 9.69 MB/sec execute 369 sec latency 11.666 ms 2024-03-25T05:47:52.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 903201 9.68 MB/sec execute 370 sec latency 24.169 ms 2024-03-25T05:47:53.363 INFO:tasks.workunit.client.0.smithi102.stdout: 1 905546 9.69 MB/sec execute 371 sec latency 19.301 ms 2024-03-25T05:47:54.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 905563 9.67 MB/sec execute 372 sec latency 366.798 ms 2024-03-25T05:47:55.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 905682 9.64 MB/sec execute 373 sec latency 258.997 ms 2024-03-25T05:47:56.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 906158 9.62 MB/sec execute 374 sec latency 29.567 ms 2024-03-25T05:47:57.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 907054 9.61 MB/sec execute 375 sec latency 31.380 ms 2024-03-25T05:47:58.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 909051 9.62 MB/sec execute 376 sec latency 33.548 ms 2024-03-25T05:47:59.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 910242 9.60 MB/sec execute 377 sec latency 34.717 ms 2024-03-25T05:48:00.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 912612 9.62 MB/sec execute 378 sec latency 11.826 ms 2024-03-25T05:48:01.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 913834 9.60 MB/sec execute 379 sec latency 24.581 ms 2024-03-25T05:48:02.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 916151 9.62 MB/sec execute 380 sec latency 14.062 ms 2024-03-25T05:48:03.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 917037 9.62 MB/sec execute 381 sec latency 70.814 ms 2024-03-25T05:48:04.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 919033 9.64 MB/sec execute 382 sec latency 29.108 ms 2024-03-25T05:48:05.364 INFO:tasks.workunit.client.0.smithi102.stdout: 1 920722 9.65 MB/sec execute 383 sec latency 42.057 ms 2024-03-25T05:48:06.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 921191 9.62 MB/sec execute 384 sec latency 190.840 ms 2024-03-25T05:48:07.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 922689 9.61 MB/sec execute 385 sec latency 37.988 ms 2024-03-25T05:48:08.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 924350 9.62 MB/sec execute 386 sec latency 15.468 ms 2024-03-25T05:48:09.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 926392 9.62 MB/sec execute 387 sec latency 14.338 ms 2024-03-25T05:48:10.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 927948 9.62 MB/sec execute 388 sec latency 13.241 ms 2024-03-25T05:48:11.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 929770 9.61 MB/sec execute 389 sec latency 29.024 ms 2024-03-25T05:48:12.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 931435 9.62 MB/sec execute 390 sec latency 17.636 ms 2024-03-25T05:48:13.365 INFO:tasks.workunit.client.0.smithi102.stdout: 1 933778 9.63 MB/sec execute 391 sec latency 10.055 ms 2024-03-25T05:48:14.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 935142 9.62 MB/sec execute 392 sec latency 29.964 ms 2024-03-25T05:48:15.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 937825 9.63 MB/sec execute 393 sec latency 9.214 ms 2024-03-25T05:48:16.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 938886 9.62 MB/sec execute 394 sec latency 27.283 ms 2024-03-25T05:48:17.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 941354 9.63 MB/sec execute 395 sec latency 23.594 ms 2024-03-25T05:48:18.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 942370 9.62 MB/sec execute 396 sec latency 26.202 ms 2024-03-25T05:48:19.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 944887 9.63 MB/sec execute 397 sec latency 11.622 ms 2024-03-25T05:48:20.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 945907 9.62 MB/sec execute 398 sec latency 31.358 ms 2024-03-25T05:48:21.366 INFO:tasks.workunit.client.0.smithi102.stdout: 1 948078 9.63 MB/sec execute 399 sec latency 23.117 ms 2024-03-25T05:48:22.367 INFO:tasks.workunit.client.0.smithi102.stdout: 1 949363 9.62 MB/sec execute 400 sec latency 29.237 ms 2024-03-25T05:48:23.367 INFO:tasks.workunit.client.0.smithi102.stdout: 1 951371 9.62 MB/sec execute 401 sec latency 16.609 ms 2024-03-25T05:48:24.367 INFO:tasks.workunit.client.0.smithi102.stdout: 1 952538 9.62 MB/sec execute 402 sec latency 270.470 ms 2024-03-25T05:48:25.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 953888 9.61 MB/sec execute 403 sec latency 19.327 ms 2024-03-25T05:48:26.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 955731 9.61 MB/sec execute 404 sec latency 234.148 ms 2024-03-25T05:48:27.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 956122 9.59 MB/sec execute 405 sec latency 253.615 ms 2024-03-25T05:48:28.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 956485 9.57 MB/sec execute 406 sec latency 43.677 ms 2024-03-25T05:48:29.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 958327 9.57 MB/sec execute 407 sec latency 28.558 ms 2024-03-25T05:48:30.370 INFO:tasks.workunit.client.0.smithi102.stdout: 1 959891 9.57 MB/sec execute 408 sec latency 12.735 ms 2024-03-25T05:48:31.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 961734 9.56 MB/sec execute 409 sec latency 40.617 ms 2024-03-25T05:48:32.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 963517 9.57 MB/sec execute 410 sec latency 9.645 ms 2024-03-25T05:48:33.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 965712 9.57 MB/sec execute 411 sec latency 34.536 ms 2024-03-25T05:48:34.368 INFO:tasks.workunit.client.0.smithi102.stdout: 1 967203 9.57 MB/sec execute 412 sec latency 9.575 ms 2024-03-25T05:48:35.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 969740 9.58 MB/sec execute 413 sec latency 31.345 ms 2024-03-25T05:48:36.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 971146 9.58 MB/sec execute 414 sec latency 11.768 ms 2024-03-25T05:48:37.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 973565 9.59 MB/sec execute 415 sec latency 23.970 ms 2024-03-25T05:48:38.370 INFO:tasks.workunit.client.0.smithi102.stdout: 1 974656 9.58 MB/sec execute 416 sec latency 46.883 ms 2024-03-25T05:48:39.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 977101 9.59 MB/sec execute 417 sec latency 19.748 ms 2024-03-25T05:48:40.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 978540 9.58 MB/sec execute 418 sec latency 12.877 ms 2024-03-25T05:48:41.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 980813 9.59 MB/sec execute 419 sec latency 27.914 ms 2024-03-25T05:48:42.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 982087 9.58 MB/sec execute 420 sec latency 25.562 ms 2024-03-25T05:48:43.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 984256 9.59 MB/sec execute 421 sec latency 16.925 ms 2024-03-25T05:48:44.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 984853 9.57 MB/sec execute 422 sec latency 288.355 ms 2024-03-25T05:48:45.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 986985 9.57 MB/sec execute 423 sec latency 23.880 ms 2024-03-25T05:48:46.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 988349 9.57 MB/sec execute 424 sec latency 14.603 ms 2024-03-25T05:48:47.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 990260 9.57 MB/sec execute 425 sec latency 26.212 ms 2024-03-25T05:48:48.369 INFO:tasks.workunit.client.0.smithi102.stdout: 1 991020 9.56 MB/sec execute 426 sec latency 369.219 ms 2024-03-25T05:48:49.370 INFO:tasks.workunit.client.0.smithi102.stdout: 1 991925 9.55 MB/sec execute 427 sec latency 118.023 ms 2024-03-25T05:48:50.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 992790 9.54 MB/sec execute 428 sec latency 41.176 ms 2024-03-25T05:48:51.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 994997 9.55 MB/sec execute 429 sec latency 21.815 ms 2024-03-25T05:48:52.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 996247 9.54 MB/sec execute 430 sec latency 23.752 ms 2024-03-25T05:48:53.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 998559 9.55 MB/sec execute 431 sec latency 13.577 ms 2024-03-25T05:48:54.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 999982 9.54 MB/sec execute 432 sec latency 23.410 ms 2024-03-25T05:48:55.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1002208 9.55 MB/sec execute 433 sec latency 18.070 ms 2024-03-25T05:48:56.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1004355 9.54 MB/sec execute 434 sec latency 13.342 ms 2024-03-25T05:48:57.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1006102 9.55 MB/sec execute 435 sec latency 16.101 ms 2024-03-25T05:48:58.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1008386 9.55 MB/sec execute 436 sec latency 28.818 ms 2024-03-25T05:48:59.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1009831 9.55 MB/sec execute 437 sec latency 60.300 ms 2024-03-25T05:49:00.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1012464 9.57 MB/sec execute 438 sec latency 13.237 ms 2024-03-25T05:49:01.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1013573 9.55 MB/sec execute 439 sec latency 22.834 ms 2024-03-25T05:49:02.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1016056 9.57 MB/sec execute 440 sec latency 13.186 ms 2024-03-25T05:49:03.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1017118 9.55 MB/sec execute 441 sec latency 19.457 ms 2024-03-25T05:49:04.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1019681 9.57 MB/sec execute 442 sec latency 23.957 ms 2024-03-25T05:49:05.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1021051 9.56 MB/sec execute 443 sec latency 14.859 ms 2024-03-25T05:49:06.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1023203 9.57 MB/sec execute 444 sec latency 22.301 ms 2024-03-25T05:49:07.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1024326 9.55 MB/sec execute 445 sec latency 11.352 ms 2024-03-25T05:49:08.371 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1026774 9.57 MB/sec execute 446 sec latency 21.614 ms 2024-03-25T05:49:09.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1027926 9.55 MB/sec execute 447 sec latency 12.784 ms 2024-03-25T05:49:10.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1030035 9.56 MB/sec execute 448 sec latency 125.835 ms 2024-03-25T05:49:11.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1031058 9.55 MB/sec execute 449 sec latency 14.657 ms 2024-03-25T05:49:12.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1033736 9.57 MB/sec execute 450 sec latency 29.133 ms 2024-03-25T05:49:13.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1034965 9.55 MB/sec execute 451 sec latency 12.664 ms 2024-03-25T05:49:14.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1037462 9.57 MB/sec execute 452 sec latency 23.022 ms 2024-03-25T05:49:15.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1039009 9.56 MB/sec execute 453 sec latency 11.466 ms 2024-03-25T05:49:16.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1041161 9.57 MB/sec execute 454 sec latency 18.288 ms 2024-03-25T05:49:17.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1042853 9.56 MB/sec execute 455 sec latency 18.535 ms 2024-03-25T05:49:18.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1044801 9.57 MB/sec execute 456 sec latency 12.210 ms 2024-03-25T05:49:19.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1046805 9.56 MB/sec execute 457 sec latency 16.477 ms 2024-03-25T05:49:20.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1048646 9.57 MB/sec execute 458 sec latency 10.778 ms 2024-03-25T05:49:21.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1050724 9.57 MB/sec execute 459 sec latency 55.559 ms 2024-03-25T05:49:22.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1052335 9.57 MB/sec execute 460 sec latency 9.415 ms 2024-03-25T05:49:23.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1054879 9.58 MB/sec execute 461 sec latency 17.385 ms 2024-03-25T05:49:24.372 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1055132 9.57 MB/sec execute 462 sec latency 334.191 ms 2024-03-25T05:49:25.004 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:49:25.010 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:49:25.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1055257 9.55 MB/sec execute 463 sec latency 525.440 ms 2024-03-25T05:49:26.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1055488 9.53 MB/sec execute 464 sec latency 272.748 ms 2024-03-25T05:49:27.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1055999 9.51 MB/sec execute 465 sec latency 32.542 ms 2024-03-25T05:49:28.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1058231 9.52 MB/sec execute 466 sec latency 27.159 ms 2024-03-25T05:49:29.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1059578 9.51 MB/sec execute 467 sec latency 12.471 ms 2024-03-25T05:49:30.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1062119 9.52 MB/sec execute 468 sec latency 24.357 ms 2024-03-25T05:49:31.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1063127 9.51 MB/sec execute 469 sec latency 22.809 ms 2024-03-25T05:49:32.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1065769 9.53 MB/sec execute 470 sec latency 11.680 ms 2024-03-25T05:49:33.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1066906 9.51 MB/sec execute 471 sec latency 19.255 ms 2024-03-25T05:49:34.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1069452 9.53 MB/sec execute 472 sec latency 25.624 ms 2024-03-25T05:49:35.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1070847 9.52 MB/sec execute 473 sec latency 9.532 ms 2024-03-25T05:49:36.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1073136 9.53 MB/sec execute 474 sec latency 21.709 ms 2024-03-25T05:49:37.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1074696 9.52 MB/sec execute 475 sec latency 25.885 ms 2024-03-25T05:49:38.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1076671 9.53 MB/sec execute 476 sec latency 23.321 ms 2024-03-25T05:49:39.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1078418 9.52 MB/sec execute 477 sec latency 15.026 ms 2024-03-25T05:49:40.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1080263 9.53 MB/sec execute 478 sec latency 10.633 ms 2024-03-25T05:49:41.373 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1082209 9.52 MB/sec execute 479 sec latency 31.855 ms 2024-03-25T05:49:42.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1083954 9.53 MB/sec execute 480 sec latency 9.206 ms 2024-03-25T05:49:43.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1085810 9.52 MB/sec execute 481 sec latency 30.089 ms 2024-03-25T05:49:44.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1087433 9.53 MB/sec execute 482 sec latency 9.888 ms 2024-03-25T05:49:45.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1089363 9.52 MB/sec execute 483 sec latency 26.533 ms 2024-03-25T05:49:46.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1090979 9.53 MB/sec execute 484 sec latency 10.725 ms 2024-03-25T05:49:47.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1092913 9.52 MB/sec execute 485 sec latency 25.621 ms 2024-03-25T05:49:48.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1094501 9.53 MB/sec execute 486 sec latency 12.453 ms 2024-03-25T05:49:49.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1096195 9.52 MB/sec execute 487 sec latency 19.414 ms 2024-03-25T05:49:50.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1098127 9.53 MB/sec execute 488 sec latency 20.661 ms 2024-03-25T05:49:51.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1100500 9.53 MB/sec execute 489 sec latency 12.267 ms 2024-03-25T05:49:52.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1101865 9.53 MB/sec execute 490 sec latency 25.288 ms 2024-03-25T05:49:53.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1104311 9.54 MB/sec execute 491 sec latency 20.894 ms 2024-03-25T05:49:54.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1105607 9.53 MB/sec execute 492 sec latency 14.337 ms 2024-03-25T05:49:55.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1108219 9.55 MB/sec execute 493 sec latency 25.980 ms 2024-03-25T05:49:55.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:49:55.908 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:49:56.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1109302 9.53 MB/sec execute 494 sec latency 22.786 ms 2024-03-25T05:49:57.377 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1111899 9.55 MB/sec execute 495 sec latency 10.844 ms 2024-03-25T05:49:58.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1113042 9.53 MB/sec execute 496 sec latency 21.746 ms 2024-03-25T05:49:59.374 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1115565 9.55 MB/sec execute 497 sec latency 13.907 ms 2024-03-25T05:50:00.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1116037 9.53 MB/sec execute 498 sec latency 362.744 ms 2024-03-25T05:50:01.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1116250 9.51 MB/sec execute 499 sec latency 436.001 ms 2024-03-25T05:50:02.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1117663 9.51 MB/sec execute 500 sec latency 26.136 ms 2024-03-25T05:50:03.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1119263 9.51 MB/sec execute 501 sec latency 27.305 ms 2024-03-25T05:50:04.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1120853 9.50 MB/sec execute 502 sec latency 35.507 ms 2024-03-25T05:50:05.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1122416 9.51 MB/sec execute 503 sec latency 231.386 ms 2024-03-25T05:50:06.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1123106 9.49 MB/sec execute 504 sec latency 103.529 ms 2024-03-25T05:50:07.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1123923 9.48 MB/sec execute 505 sec latency 305.730 ms 2024-03-25T05:50:08.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1126270 9.49 MB/sec execute 506 sec latency 11.549 ms 2024-03-25T05:50:09.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1127861 9.48 MB/sec execute 507 sec latency 28.548 ms 2024-03-25T05:50:10.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1129979 9.49 MB/sec execute 508 sec latency 10.315 ms 2024-03-25T05:50:11.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1132277 9.50 MB/sec execute 509 sec latency 24.009 ms 2024-03-25T05:50:12.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1133848 9.49 MB/sec execute 510 sec latency 14.312 ms 2024-03-25T05:50:13.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1136298 9.50 MB/sec execute 511 sec latency 22.467 ms 2024-03-25T05:50:14.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1137646 9.50 MB/sec execute 512 sec latency 12.189 ms 2024-03-25T05:50:15.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1140306 9.51 MB/sec execute 513 sec latency 34.558 ms 2024-03-25T05:50:16.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1141694 9.50 MB/sec execute 514 sec latency 23.495 ms 2024-03-25T05:50:17.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1144083 9.51 MB/sec execute 515 sec latency 11.726 ms 2024-03-25T05:50:18.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1145885 9.51 MB/sec execute 516 sec latency 28.616 ms 2024-03-25T05:50:19.375 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1147829 9.51 MB/sec execute 517 sec latency 11.190 ms 2024-03-25T05:50:20.377 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1150170 9.52 MB/sec execute 518 sec latency 22.870 ms 2024-03-25T05:50:21.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1151625 9.51 MB/sec execute 519 sec latency 16.925 ms 2024-03-25T05:50:22.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1154172 9.52 MB/sec execute 520 sec latency 13.876 ms 2024-03-25T05:50:23.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1155268 9.51 MB/sec execute 521 sec latency 32.038 ms 2024-03-25T05:50:24.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1157903 9.53 MB/sec execute 522 sec latency 11.967 ms 2024-03-25T05:50:25.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1158929 9.52 MB/sec execute 523 sec latency 26.049 ms 2024-03-25T05:50:26.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:50:26.046 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:50:26.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1161590 9.53 MB/sec execute 524 sec latency 26.908 ms 2024-03-25T05:50:27.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1162877 9.52 MB/sec execute 525 sec latency 19.967 ms 2024-03-25T05:50:28.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1165266 9.53 MB/sec execute 526 sec latency 17.973 ms 2024-03-25T05:50:29.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1166709 9.52 MB/sec execute 527 sec latency 22.230 ms 2024-03-25T05:50:30.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1169021 9.53 MB/sec execute 528 sec latency 11.003 ms 2024-03-25T05:50:31.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1171036 9.53 MB/sec execute 529 sec latency 24.177 ms 2024-03-25T05:50:32.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1172825 9.53 MB/sec execute 530 sec latency 20.136 ms 2024-03-25T05:50:33.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1175634 9.55 MB/sec execute 531 sec latency 18.075 ms 2024-03-25T05:50:34.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1176878 9.54 MB/sec execute 532 sec latency 22.632 ms 2024-03-25T05:50:35.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1179511 9.55 MB/sec execute 533 sec latency 13.129 ms 2024-03-25T05:50:36.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1180190 9.53 MB/sec execute 534 sec latency 68.920 ms 2024-03-25T05:50:37.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1182897 9.55 MB/sec execute 535 sec latency 13.500 ms 2024-03-25T05:50:38.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1184357 9.54 MB/sec execute 536 sec latency 23.555 ms 2024-03-25T05:50:39.376 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1186717 9.55 MB/sec execute 537 sec latency 9.748 ms 2024-03-25T05:50:40.377 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1188698 9.55 MB/sec execute 538 sec latency 19.434 ms 2024-03-25T05:50:41.377 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1189818 9.55 MB/sec execute 539 sec latency 383.693 ms 2024-03-25T05:50:42.377 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1190139 9.53 MB/sec execute 540 sec latency 480.369 ms 2024-03-25T05:50:43.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1190581 9.52 MB/sec execute 541 sec latency 35.835 ms 2024-03-25T05:50:44.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1193026 9.52 MB/sec execute 542 sec latency 24.008 ms 2024-03-25T05:50:45.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1194172 9.52 MB/sec execute 543 sec latency 33.631 ms 2024-03-25T05:50:46.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1197015 9.53 MB/sec execute 544 sec latency 24.362 ms 2024-03-25T05:50:47.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1197222 9.51 MB/sec execute 545 sec latency 126.018 ms 2024-03-25T05:50:48.378 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1197875 9.50 MB/sec execute 546 sec latency 21.535 ms 2024-03-25T05:50:49.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1200448 9.51 MB/sec execute 547 sec latency 22.476 ms 2024-03-25T05:50:50.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1201462 9.50 MB/sec execute 548 sec latency 18.443 ms 2024-03-25T05:50:51.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1204025 9.51 MB/sec execute 549 sec latency 11.466 ms 2024-03-25T05:50:52.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1205023 9.50 MB/sec execute 550 sec latency 23.094 ms 2024-03-25T05:50:53.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1207395 9.51 MB/sec execute 551 sec latency 14.298 ms 2024-03-25T05:50:54.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1208566 9.50 MB/sec execute 552 sec latency 22.229 ms 2024-03-25T05:50:55.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1211105 9.51 MB/sec execute 553 sec latency 25.549 ms 2024-03-25T05:50:56.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:50:56.348 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:50:56.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1212105 9.50 MB/sec execute 554 sec latency 18.395 ms 2024-03-25T05:50:57.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1214670 9.51 MB/sec execute 555 sec latency 10.055 ms 2024-03-25T05:50:58.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1215651 9.50 MB/sec execute 556 sec latency 27.211 ms 2024-03-25T05:50:59.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1218291 9.51 MB/sec execute 557 sec latency 11.562 ms 2024-03-25T05:51:00.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1219314 9.50 MB/sec execute 558 sec latency 21.605 ms 2024-03-25T05:51:01.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1221751 9.51 MB/sec execute 559 sec latency 12.172 ms 2024-03-25T05:51:02.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1222917 9.50 MB/sec execute 560 sec latency 30.659 ms 2024-03-25T05:51:03.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1225501 9.52 MB/sec execute 561 sec latency 12.261 ms 2024-03-25T05:51:04.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1226833 9.51 MB/sec execute 562 sec latency 15.216 ms 2024-03-25T05:51:05.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1229226 9.52 MB/sec execute 563 sec latency 10.975 ms 2024-03-25T05:51:06.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1231212 9.51 MB/sec execute 564 sec latency 23.479 ms 2024-03-25T05:51:07.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1232854 9.52 MB/sec execute 565 sec latency 20.958 ms 2024-03-25T05:51:08.379 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1234840 9.51 MB/sec execute 566 sec latency 20.101 ms 2024-03-25T05:51:09.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1236489 9.52 MB/sec execute 567 sec latency 24.483 ms 2024-03-25T05:51:10.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1238907 9.52 MB/sec execute 568 sec latency 11.244 ms 2024-03-25T05:51:11.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1240292 9.52 MB/sec execute 569 sec latency 22.325 ms 2024-03-25T05:51:12.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1242843 9.53 MB/sec execute 570 sec latency 23.043 ms 2024-03-25T05:51:13.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1244065 9.52 MB/sec execute 571 sec latency 23.692 ms 2024-03-25T05:51:14.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1246721 9.53 MB/sec execute 572 sec latency 9.946 ms 2024-03-25T05:51:15.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1247983 9.53 MB/sec execute 573 sec latency 28.398 ms 2024-03-25T05:51:16.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1250388 9.53 MB/sec execute 574 sec latency 8.886 ms 2024-03-25T05:51:17.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1251391 9.52 MB/sec execute 575 sec latency 96.899 ms 2024-03-25T05:51:18.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1253670 9.53 MB/sec execute 576 sec latency 23.053 ms 2024-03-25T05:51:19.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1254601 9.52 MB/sec execute 577 sec latency 23.650 ms 2024-03-25T05:51:20.380 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1257306 9.53 MB/sec execute 578 sec latency 10.104 ms 2024-03-25T05:51:21.381 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1258458 9.52 MB/sec execute 579 sec latency 25.011 ms 2024-03-25T05:51:22.381 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1260101 9.52 MB/sec execute 580 sec latency 303.479 ms 2024-03-25T05:51:23.381 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1260207 9.51 MB/sec execute 581 sec latency 392.747 ms 2024-03-25T05:51:24.381 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1260997 9.50 MB/sec execute 582 sec latency 20.479 ms 2024-03-25T05:51:25.381 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1261935 9.49 MB/sec execute 583 sec latency 21.752 ms 2024-03-25T05:51:26.381 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1264597 9.50 MB/sec execute 584 sec latency 9.817 ms 2024-03-25T05:51:26.454 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:51:26.459 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:51:27.381 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1266645 9.50 MB/sec execute 585 sec latency 22.924 ms 2024-03-25T05:51:28.382 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1267931 9.50 MB/sec execute 586 sec latency 355.713 ms 2024-03-25T05:51:29.382 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1268953 9.49 MB/sec execute 587 sec latency 361.919 ms 2024-03-25T05:51:30.382 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1270288 9.48 MB/sec execute 588 sec latency 27.367 ms 2024-03-25T05:51:31.382 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1272074 9.49 MB/sec execute 589 sec latency 29.000 ms 2024-03-25T05:51:32.383 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1274583 9.49 MB/sec execute 590 sec latency 76.871 ms 2024-03-25T05:51:33.383 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1276045 9.49 MB/sec execute 591 sec latency 17.312 ms 2024-03-25T05:51:34.383 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1278683 9.50 MB/sec execute 592 sec latency 19.586 ms 2024-03-25T05:51:35.384 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1280147 9.50 MB/sec execute 593 sec latency 23.660 ms 2024-03-25T05:51:36.383 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1282427 9.50 MB/sec execute 594 sec latency 14.319 ms 2024-03-25T05:51:37.383 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1284436 9.50 MB/sec execute 595 sec latency 28.897 ms 2024-03-25T05:51:38.384 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1286102 9.50 MB/sec execute 596 sec latency 28.648 ms 2024-03-25T05:51:39.385 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1288070 9.50 MB/sec execute 597 sec latency 28.549 ms 2024-03-25T05:51:40.385 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1289698 9.50 MB/sec execute 598 sec latency 12.580 ms 2024-03-25T05:51:41.385 INFO:tasks.workunit.client.0.smithi102.stdout: 1 1291879 9.51 MB/sec execute 599 sec latency 16.594 ms 2024-03-25T05:51:42.385 INFO:tasks.workunit.client.0.smithi102.stdout: 1 cleanup 600 sec 2024-03-25T05:51:42.597 INFO:tasks.workunit.client.0.smithi102.stdout: 0 cleanup 600 sec 2024-03-25T05:51:42.597 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-03-25T05:51:42.597 INFO:tasks.workunit.client.0.smithi102.stdout: Operation Count AvgLat MaxLat 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: ---------------------------------------- 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: NTCreateX 181765 1.132 435.991 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Close 133508 0.006 1.039 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Rename 7698 4.969 313.429 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Unlink 36718 1.988 274.055 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Deltree 4 84.875 96.416 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Mkdir 2 0.025 0.028 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Qpathinfo 164783 0.858 559.622 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Qfileinfo 28858 0.003 0.430 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Qfsinfo 30218 0.305 36.671 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Sfileinfo 14810 0.046 3.445 2024-03-25T05:51:42.598 INFO:tasks.workunit.client.0.smithi102.stdout: Find 63709 0.229 250.962 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stdout: WriteX 90528 0.041 369.207 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stdout: ReadX 284981 0.036 383.679 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stdout: LockX 592 0.692 4.216 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stdout: UnlockX 592 0.629 6.138 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stdout: Flush 12744 7.587 660.114 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stdout:Throughput 9.50571 MB/sec 1 clients 1 procs max_latency=660.126 ms 2024-03-25T05:51:42.599 INFO:tasks.workunit.client.0.smithi102.stderr:+ dbench 10 2024-03-25T05:51:42.600 INFO:tasks.workunit.client.0.smithi102.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-03-25T05:51:42.600 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-03-25T05:51:42.600 INFO:tasks.workunit.client.0.smithi102.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-03-25T05:51:42.603 INFO:tasks.workunit.client.0.smithi102.stdout:9 of 10 processes prepared for launch 0 sec 2024-03-25T05:51:42.703 INFO:tasks.workunit.client.0.smithi102.stdout:10 of 10 processes prepared for launch 0 sec 2024-03-25T05:51:42.704 INFO:tasks.workunit.client.0.smithi102.stdout:releasing clients 2024-03-25T05:51:43.703 INFO:tasks.workunit.client.0.smithi102.stdout: 10 364 130.45 MB/sec warmup 1 sec latency 34.743 ms 2024-03-25T05:51:44.704 INFO:tasks.workunit.client.0.smithi102.stdout: 10 737 106.49 MB/sec warmup 2 sec latency 65.665 ms 2024-03-25T05:51:45.704 INFO:tasks.workunit.client.0.smithi102.stdout: 10 1015 74.70 MB/sec warmup 3 sec latency 99.253 ms 2024-03-25T05:51:46.704 INFO:tasks.workunit.client.0.smithi102.stdout: 10 1526 65.20 MB/sec warmup 4 sec latency 175.103 ms 2024-03-25T05:51:47.704 INFO:tasks.workunit.client.0.smithi102.stdout: 10 2239 54.52 MB/sec warmup 5 sec latency 332.818 ms 2024-03-25T05:51:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: 10 2520 47.94 MB/sec warmup 6 sec latency 362.942 ms 2024-03-25T05:51:49.704 INFO:tasks.workunit.client.0.smithi102.stdout: 10 2545 41.17 MB/sec warmup 7 sec latency 1076.529 ms 2024-03-25T05:51:50.705 INFO:tasks.workunit.client.0.smithi102.stdout: 10 2879 40.72 MB/sec warmup 8 sec latency 854.019 ms 2024-03-25T05:51:51.705 INFO:tasks.workunit.client.0.smithi102.stdout: 10 3182 38.14 MB/sec warmup 9 sec latency 93.317 ms 2024-03-25T05:51:52.705 INFO:tasks.workunit.client.0.smithi102.stdout: 10 3582 38.23 MB/sec warmup 10 sec latency 75.864 ms 2024-03-25T05:51:53.708 INFO:tasks.workunit.client.0.smithi102.stdout: 10 3813 36.03 MB/sec warmup 11 sec latency 92.278 ms 2024-03-25T05:51:54.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 3868 33.11 MB/sec warmup 12 sec latency 291.612 ms 2024-03-25T05:51:55.709 INFO:tasks.workunit.client.0.smithi102.stdout: 10 3950 30.79 MB/sec warmup 13 sec latency 657.661 ms 2024-03-25T05:51:56.577 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:51:56.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:51:56.708 INFO:tasks.workunit.client.0.smithi102.stdout: 10 4066 28.60 MB/sec warmup 14 sec latency 130.418 ms 2024-03-25T05:51:57.709 INFO:tasks.workunit.client.0.smithi102.stdout: 10 4215 26.83 MB/sec warmup 15 sec latency 129.655 ms 2024-03-25T05:51:58.709 INFO:tasks.workunit.client.0.smithi102.stdout: 10 4368 25.37 MB/sec warmup 16 sec latency 121.891 ms 2024-03-25T05:51:59.709 INFO:tasks.workunit.client.0.smithi102.stdout: 10 4705 24.68 MB/sec warmup 17 sec latency 65.710 ms 2024-03-25T05:52:00.709 INFO:tasks.workunit.client.0.smithi102.stdout: 10 5187 24.94 MB/sec warmup 18 sec latency 69.567 ms 2024-03-25T05:52:01.711 INFO:tasks.workunit.client.0.smithi102.stdout: 10 5868 24.70 MB/sec warmup 19 sec latency 58.648 ms 2024-03-25T05:52:02.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 6199 24.89 MB/sec warmup 20 sec latency 337.038 ms 2024-03-25T05:52:03.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 6842 25.89 MB/sec warmup 21 sec latency 43.286 ms 2024-03-25T05:52:04.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 7259 26.47 MB/sec warmup 22 sec latency 84.176 ms 2024-03-25T05:52:05.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 7433 25.65 MB/sec warmup 23 sec latency 79.398 ms 2024-03-25T05:52:06.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 7560 24.60 MB/sec warmup 24 sec latency 111.028 ms 2024-03-25T05:52:07.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 7727 23.70 MB/sec warmup 25 sec latency 110.627 ms 2024-03-25T05:52:08.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 7934 22.99 MB/sec warmup 26 sec latency 156.207 ms 2024-03-25T05:52:09.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 8405 23.39 MB/sec warmup 27 sec latency 69.359 ms 2024-03-25T05:52:10.712 INFO:tasks.workunit.client.0.smithi102.stdout: 10 8968 22.94 MB/sec warmup 28 sec latency 88.087 ms 2024-03-25T05:52:11.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 9475 22.86 MB/sec warmup 29 sec latency 72.486 ms 2024-03-25T05:52:12.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 9991 23.66 MB/sec warmup 30 sec latency 53.223 ms 2024-03-25T05:52:13.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 10476 24.01 MB/sec warmup 31 sec latency 75.339 ms 2024-03-25T05:52:14.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 10785 24.10 MB/sec warmup 32 sec latency 81.493 ms 2024-03-25T05:52:15.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 10915 23.50 MB/sec warmup 33 sec latency 129.787 ms 2024-03-25T05:52:16.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 11058 22.98 MB/sec warmup 34 sec latency 101.077 ms 2024-03-25T05:52:17.713 INFO:tasks.workunit.client.0.smithi102.stdout: 10 11157 22.33 MB/sec warmup 35 sec latency 291.932 ms 2024-03-25T05:52:18.714 INFO:tasks.workunit.client.0.smithi102.stdout: 10 11342 21.82 MB/sec warmup 36 sec latency 97.156 ms 2024-03-25T05:52:19.715 INFO:tasks.workunit.client.0.smithi102.stdout: 10 11662 21.53 MB/sec warmup 37 sec latency 61.216 ms 2024-03-25T05:52:20.716 INFO:tasks.workunit.client.0.smithi102.stdout: 10 11871 21.41 MB/sec warmup 38 sec latency 600.837 ms 2024-03-25T05:52:21.716 INFO:tasks.workunit.client.0.smithi102.stdout: 10 11886 20.86 MB/sec warmup 39 sec latency 899.869 ms 2024-03-25T05:52:22.716 INFO:tasks.workunit.client.0.smithi102.stdout: 10 11944 20.42 MB/sec warmup 40 sec latency 1220.905 ms 2024-03-25T05:52:23.717 INFO:tasks.workunit.client.0.smithi102.stdout: 10 12237 20.26 MB/sec warmup 41 sec latency 136.910 ms 2024-03-25T05:52:24.717 INFO:tasks.workunit.client.0.smithi102.stdout: 10 12651 19.97 MB/sec warmup 42 sec latency 101.377 ms 2024-03-25T05:52:25.717 INFO:tasks.workunit.client.0.smithi102.stdout: 10 12974 19.80 MB/sec warmup 43 sec latency 109.069 ms 2024-03-25T05:52:26.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 13367 20.19 MB/sec warmup 44 sec latency 84.980 ms 2024-03-25T05:52:26.747 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:52:26.753 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:52:26.872 INFO:tasks.ceph.mds.a.smithi102.stderr:2024-03-25T05:52:26.882+0000 7f2deba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46667) UID: 0 2024-03-25T05:52:26.873 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:52:26.882+0000 7f9adf000640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46667) UID: 0 2024-03-25T05:52:26.873 INFO:tasks.ceph.mds.c.smithi102.stderr:2024-03-25T05:52:26.882+0000 7f147b800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46667) UID: 0 2024-03-25T05:52:27.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 13926 20.63 MB/sec warmup 45 sec latency 61.820 ms 2024-03-25T05:52:28.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 14224 20.73 MB/sec warmup 46 sec latency 78.046 ms 2024-03-25T05:52:29.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 14435 20.55 MB/sec warmup 47 sec latency 69.909 ms 2024-03-25T05:52:30.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 14587 20.26 MB/sec warmup 48 sec latency 84.178 ms 2024-03-25T05:52:31.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 14706 19.86 MB/sec warmup 49 sec latency 89.747 ms 2024-03-25T05:52:32.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 14852 19.52 MB/sec warmup 50 sec latency 135.915 ms 2024-03-25T05:52:33.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 15039 19.25 MB/sec warmup 51 sec latency 102.032 ms 2024-03-25T05:52:34.721 INFO:tasks.workunit.client.0.smithi102.stdout: 10 15363 19.29 MB/sec warmup 52 sec latency 89.836 ms 2024-03-25T05:52:35.718 INFO:tasks.workunit.client.0.smithi102.stdout: 10 15814 19.30 MB/sec warmup 53 sec latency 75.254 ms 2024-03-25T05:52:36.719 INFO:tasks.workunit.client.0.smithi102.stdout: 10 16283 19.12 MB/sec warmup 54 sec latency 75.369 ms 2024-03-25T05:52:37.719 INFO:tasks.workunit.client.0.smithi102.stdout: 10 16768 19.37 MB/sec warmup 55 sec latency 60.670 ms 2024-03-25T05:52:38.719 INFO:tasks.workunit.client.0.smithi102.stdout: 10 17310 19.83 MB/sec warmup 56 sec latency 44.679 ms 2024-03-25T05:52:39.719 INFO:tasks.workunit.client.0.smithi102.stdout: 10 17670 19.99 MB/sec warmup 57 sec latency 106.918 ms 2024-03-25T05:52:40.719 INFO:tasks.workunit.client.0.smithi102.stdout: 10 17920 19.87 MB/sec warmup 58 sec latency 61.332 ms 2024-03-25T05:52:41.720 INFO:tasks.workunit.client.0.smithi102.stdout: 10 17975 19.59 MB/sec warmup 59 sec latency 530.724 ms 2024-03-25T05:52:42.719 INFO:tasks.workunit.client.0.smithi102.stdout: 10 17983 19.26 MB/sec warmup 60 sec latency 984.069 ms 2024-03-25T05:52:43.720 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18076 18.99 MB/sec warmup 61 sec latency 161.044 ms 2024-03-25T05:52:44.720 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18196 18.72 MB/sec warmup 62 sec latency 158.640 ms 2024-03-25T05:52:45.720 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18353 18.50 MB/sec warmup 63 sec latency 95.426 ms 2024-03-25T05:52:46.720 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18455 18.25 MB/sec warmup 64 sec latency 365.200 ms 2024-03-25T05:52:47.720 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18469 17.97 MB/sec warmup 65 sec latency 950.223 ms 2024-03-25T05:52:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18554 17.76 MB/sec warmup 66 sec latency 1426.480 ms 2024-03-25T05:52:49.724 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18685 17.56 MB/sec warmup 67 sec latency 159.016 ms 2024-03-25T05:52:50.724 INFO:tasks.workunit.client.0.smithi102.stdout: 10 18917 17.57 MB/sec warmup 68 sec latency 117.359 ms 2024-03-25T05:52:51.726 INFO:tasks.workunit.client.0.smithi102.stdout: 10 19273 17.53 MB/sec warmup 69 sec latency 104.480 ms 2024-03-25T05:52:52.724 INFO:tasks.workunit.client.0.smithi102.stdout: 10 19649 17.43 MB/sec warmup 70 sec latency 230.706 ms 2024-03-25T05:52:53.724 INFO:tasks.workunit.client.0.smithi102.stdout: 10 20033 17.34 MB/sec warmup 71 sec latency 368.408 ms 2024-03-25T05:52:54.725 INFO:tasks.workunit.client.0.smithi102.stdout: 10 20399 17.52 MB/sec warmup 72 sec latency 56.233 ms 2024-03-25T05:52:55.725 INFO:tasks.workunit.client.0.smithi102.stdout: 10 20871 17.84 MB/sec warmup 73 sec latency 63.289 ms 2024-03-25T05:52:56.726 INFO:tasks.workunit.client.0.smithi102.stdout: 10 21128 17.84 MB/sec warmup 74 sec latency 109.168 ms 2024-03-25T05:52:57.726 INFO:tasks.workunit.client.0.smithi102.stdout: 10 21426 17.88 MB/sec warmup 75 sec latency 81.512 ms 2024-03-25T05:52:58.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 21552 17.69 MB/sec warmup 76 sec latency 120.855 ms 2024-03-25T05:52:59.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 21700 17.54 MB/sec warmup 77 sec latency 80.208 ms 2024-03-25T05:53:00.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 21864 17.35 MB/sec warmup 78 sec latency 100.859 ms 2024-03-25T05:53:01.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 22051 17.22 MB/sec warmup 79 sec latency 141.472 ms 2024-03-25T05:53:02.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 22274 17.11 MB/sec warmup 80 sec latency 111.423 ms 2024-03-25T05:53:03.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 22736 17.27 MB/sec warmup 81 sec latency 63.133 ms 2024-03-25T05:53:04.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 23248 17.21 MB/sec warmup 82 sec latency 131.827 ms 2024-03-25T05:53:05.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 23746 17.34 MB/sec warmup 83 sec latency 47.507 ms 2024-03-25T05:53:06.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 24224 17.57 MB/sec warmup 84 sec latency 67.611 ms 2024-03-25T05:53:07.727 INFO:tasks.workunit.client.0.smithi102.stdout: 10 24537 17.68 MB/sec warmup 85 sec latency 113.809 ms 2024-03-25T05:53:08.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 24852 17.76 MB/sec warmup 86 sec latency 57.741 ms 2024-03-25T05:53:09.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 25021 17.61 MB/sec warmup 87 sec latency 88.898 ms 2024-03-25T05:53:10.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 25170 17.45 MB/sec warmup 88 sec latency 135.361 ms 2024-03-25T05:53:11.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 25310 17.28 MB/sec warmup 89 sec latency 121.884 ms 2024-03-25T05:53:12.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 25489 17.17 MB/sec warmup 90 sec latency 92.613 ms 2024-03-25T05:53:13.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 25763 17.09 MB/sec warmup 91 sec latency 112.841 ms 2024-03-25T05:53:14.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 26108 17.17 MB/sec warmup 92 sec latency 77.654 ms 2024-03-25T05:53:15.728 INFO:tasks.workunit.client.0.smithi102.stdout: 10 26602 17.18 MB/sec warmup 93 sec latency 58.493 ms 2024-03-25T05:53:16.729 INFO:tasks.workunit.client.0.smithi102.stdout: 10 27095 17.26 MB/sec warmup 94 sec latency 66.443 ms 2024-03-25T05:53:17.730 INFO:tasks.workunit.client.0.smithi102.stdout: 10 27388 17.29 MB/sec warmup 95 sec latency 243.275 ms 2024-03-25T05:53:18.731 INFO:tasks.workunit.client.0.smithi102.stdout: 10 27424 17.12 MB/sec warmup 96 sec latency 1134.591 ms 2024-03-25T05:53:19.731 INFO:tasks.workunit.client.0.smithi102.stdout: 10 27435 16.95 MB/sec warmup 97 sec latency 1569.524 ms 2024-03-25T05:53:20.731 INFO:tasks.workunit.client.0.smithi102.stdout: 10 27720 17.02 MB/sec warmup 98 sec latency 374.800 ms 2024-03-25T05:53:21.731 INFO:tasks.workunit.client.0.smithi102.stdout: 10 27943 16.99 MB/sec warmup 99 sec latency 130.801 ms 2024-03-25T05:53:22.731 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28137 17.03 MB/sec warmup 100 sec latency 143.323 ms 2024-03-25T05:53:23.732 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28208 16.89 MB/sec warmup 101 sec latency 440.892 ms 2024-03-25T05:53:24.732 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28262 16.74 MB/sec warmup 102 sec latency 520.174 ms 2024-03-25T05:53:25.732 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28389 16.65 MB/sec warmup 103 sec latency 103.522 ms 2024-03-25T05:53:26.732 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28496 16.56 MB/sec warmup 104 sec latency 137.410 ms 2024-03-25T05:53:27.732 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28669 16.43 MB/sec warmup 105 sec latency 77.902 ms 2024-03-25T05:53:28.733 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28790 16.29 MB/sec warmup 106 sec latency 349.039 ms 2024-03-25T05:53:29.734 INFO:tasks.workunit.client.0.smithi102.stdout: 10 28909 16.16 MB/sec warmup 107 sec latency 146.774 ms 2024-03-25T05:53:30.737 INFO:tasks.workunit.client.0.smithi102.stdout: 10 29105 16.08 MB/sec warmup 108 sec latency 164.305 ms 2024-03-25T05:53:31.734 INFO:tasks.workunit.client.0.smithi102.stdout: 10 29403 16.11 MB/sec warmup 109 sec latency 95.783 ms 2024-03-25T05:53:32.734 INFO:tasks.workunit.client.0.smithi102.stdout: 10 29753 16.08 MB/sec warmup 110 sec latency 97.438 ms 2024-03-25T05:53:33.734 INFO:tasks.workunit.client.0.smithi102.stdout: 10 30144 16.11 MB/sec warmup 111 sec latency 256.310 ms 2024-03-25T05:53:34.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 30600 16.15 MB/sec warmup 112 sec latency 64.969 ms 2024-03-25T05:53:35.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 31040 16.29 MB/sec warmup 113 sec latency 61.645 ms 2024-03-25T05:53:36.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 31387 16.38 MB/sec warmup 114 sec latency 74.189 ms 2024-03-25T05:53:37.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 31716 16.50 MB/sec warmup 115 sec latency 100.705 ms 2024-03-25T05:53:38.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 31880 16.41 MB/sec warmup 116 sec latency 278.400 ms 2024-03-25T05:53:39.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 32025 16.33 MB/sec warmup 117 sec latency 299.672 ms 2024-03-25T05:53:40.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 32175 16.24 MB/sec warmup 118 sec latency 113.220 ms 2024-03-25T05:53:41.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 32322 16.12 MB/sec warmup 119 sec latency 152.921 ms 2024-03-25T05:53:43.735 INFO:tasks.workunit.client.0.smithi102.stdout: 10 32751 8.85 MB/sec execute 1 sec latency 184.061 ms 2024-03-25T05:53:44.736 INFO:tasks.workunit.client.0.smithi102.stdout: 10 32790 6.11 MB/sec execute 2 sec latency 947.984 ms 2024-03-25T05:53:45.736 INFO:tasks.workunit.client.0.smithi102.stdout: 10 32950 6.50 MB/sec execute 3 sec latency 1068.585 ms 2024-03-25T05:53:46.736 INFO:tasks.workunit.client.0.smithi102.stdout: 10 33245 8.64 MB/sec execute 4 sec latency 121.548 ms 2024-03-25T05:53:47.740 INFO:tasks.workunit.client.0.smithi102.stdout: 10 33523 9.77 MB/sec execute 5 sec latency 135.154 ms 2024-03-25T05:53:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: 10 33933 11.30 MB/sec execute 6 sec latency 138.022 ms 2024-03-25T05:53:49.742 INFO:tasks.workunit.client.0.smithi102.stdout: 10 34340 12.98 MB/sec execute 7 sec latency 85.888 ms 2024-03-25T05:53:50.743 INFO:tasks.workunit.client.0.smithi102.stdout: 10 34733 15.30 MB/sec execute 8 sec latency 74.218 ms 2024-03-25T05:53:51.743 INFO:tasks.workunit.client.0.smithi102.stdout: 10 35100 16.75 MB/sec execute 9 sec latency 78.343 ms 2024-03-25T05:53:52.743 INFO:tasks.workunit.client.0.smithi102.stdout: 10 35369 16.83 MB/sec execute 10 sec latency 94.617 ms 2024-03-25T05:53:53.746 INFO:tasks.workunit.client.0.smithi102.stdout: 10 35539 16.09 MB/sec execute 11 sec latency 112.794 ms 2024-03-25T05:53:54.746 INFO:tasks.workunit.client.0.smithi102.stdout: 10 35696 15.10 MB/sec execute 12 sec latency 129.650 ms 2024-03-25T05:53:55.746 INFO:tasks.workunit.client.0.smithi102.stdout: 10 35836 14.08 MB/sec execute 13 sec latency 131.827 ms 2024-03-25T05:53:56.746 INFO:tasks.workunit.client.0.smithi102.stdout: 10 36055 13.71 MB/sec execute 14 sec latency 106.548 ms 2024-03-25T05:53:57.747 INFO:tasks.workunit.client.0.smithi102.stdout: 10 36430 14.04 MB/sec execute 15 sec latency 67.413 ms 2024-03-25T05:53:58.747 INFO:tasks.workunit.client.0.smithi102.stdout: 10 36868 13.93 MB/sec execute 16 sec latency 78.163 ms 2024-03-25T05:53:59.749 INFO:tasks.workunit.client.0.smithi102.stdout: 10 37368 14.61 MB/sec execute 17 sec latency 48.269 ms 2024-03-25T05:54:00.747 INFO:tasks.workunit.client.0.smithi102.stdout: 10 37860 15.72 MB/sec execute 18 sec latency 74.101 ms 2024-03-25T05:54:01.748 INFO:tasks.workunit.client.0.smithi102.stdout: 10 38210 16.11 MB/sec execute 19 sec latency 161.133 ms 2024-03-25T05:54:02.747 INFO:tasks.workunit.client.0.smithi102.stdout: 10 38516 16.65 MB/sec execute 20 sec latency 154.076 ms 2024-03-25T05:54:03.750 INFO:tasks.workunit.client.0.smithi102.stdout: 10 38810 17.00 MB/sec execute 21 sec latency 82.243 ms 2024-03-25T05:54:04.750 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39017 16.71 MB/sec execute 22 sec latency 94.814 ms 2024-03-25T05:54:05.750 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39133 16.01 MB/sec execute 23 sec latency 150.073 ms 2024-03-25T05:54:06.752 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39274 15.48 MB/sec execute 24 sec latency 122.157 ms 2024-03-25T05:54:07.752 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39459 15.07 MB/sec execute 25 sec latency 129.124 ms 2024-03-25T05:54:08.753 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39597 14.73 MB/sec execute 26 sec latency 318.585 ms 2024-03-25T05:54:09.753 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39860 14.68 MB/sec execute 27 sec latency 126.113 ms 2024-03-25T05:54:10.753 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39890 14.17 MB/sec execute 28 sec latency 1012.215 ms 2024-03-25T05:54:11.761 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39906 13.69 MB/sec execute 29 sec latency 1702.001 ms 2024-03-25T05:54:12.761 INFO:tasks.workunit.client.0.smithi102.stdout: 10 39962 13.35 MB/sec execute 30 sec latency 1405.705 ms 2024-03-25T05:54:13.762 INFO:tasks.workunit.client.0.smithi102.stdout: 10 40136 13.11 MB/sec execute 31 sec latency 280.072 ms 2024-03-25T05:54:14.762 INFO:tasks.workunit.client.0.smithi102.stdout: 10 40412 12.92 MB/sec execute 32 sec latency 124.671 ms 2024-03-25T05:54:15.763 INFO:tasks.workunit.client.0.smithi102.stdout: 10 40612 12.81 MB/sec execute 33 sec latency 305.560 ms 2024-03-25T05:54:16.763 INFO:tasks.workunit.client.0.smithi102.stdout: 10 40827 12.91 MB/sec execute 34 sec latency 285.795 ms 2024-03-25T05:54:17.763 INFO:tasks.workunit.client.0.smithi102.stdout: 10 41071 12.89 MB/sec execute 35 sec latency 142.314 ms 2024-03-25T05:54:18.763 INFO:tasks.workunit.client.0.smithi102.stdout: 10 41533 13.28 MB/sec execute 36 sec latency 117.601 ms 2024-03-25T05:54:19.763 INFO:tasks.workunit.client.0.smithi102.stdout: 10 41922 13.81 MB/sec execute 37 sec latency 65.962 ms 2024-03-25T05:54:20.765 INFO:tasks.workunit.client.0.smithi102.stdout: 10 42227 14.09 MB/sec execute 38 sec latency 88.293 ms 2024-03-25T05:54:21.764 INFO:tasks.workunit.client.0.smithi102.stdout: 10 42484 14.23 MB/sec execute 39 sec latency 84.831 ms 2024-03-25T05:54:22.765 INFO:tasks.workunit.client.0.smithi102.stdout: 10 42621 14.00 MB/sec execute 40 sec latency 114.958 ms 2024-03-25T05:54:23.765 INFO:tasks.workunit.client.0.smithi102.stdout: 10 42722 13.67 MB/sec execute 41 sec latency 230.941 ms 2024-03-25T05:54:24.765 INFO:tasks.workunit.client.0.smithi102.stdout: 10 42840 13.41 MB/sec execute 42 sec latency 299.691 ms 2024-03-25T05:54:25.765 INFO:tasks.workunit.client.0.smithi102.stdout: 10 43031 13.21 MB/sec execute 43 sec latency 95.223 ms 2024-03-25T05:54:26.766 INFO:tasks.workunit.client.0.smithi102.stdout: 10 43302 13.26 MB/sec execute 44 sec latency 86.343 ms 2024-03-25T05:54:27.766 INFO:tasks.workunit.client.0.smithi102.stdout: 10 43568 13.22 MB/sec execute 45 sec latency 99.711 ms 2024-03-25T05:54:28.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 44076 13.23 MB/sec execute 46 sec latency 75.483 ms 2024-03-25T05:54:29.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 44542 13.58 MB/sec execute 47 sec latency 53.602 ms 2024-03-25T05:54:30.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 45151 14.04 MB/sec execute 48 sec latency 50.168 ms 2024-03-25T05:54:31.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 45476 14.40 MB/sec execute 49 sec latency 113.343 ms 2024-03-25T05:54:32.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 45762 14.49 MB/sec execute 50 sec latency 91.433 ms 2024-03-25T05:54:33.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 46055 14.63 MB/sec execute 51 sec latency 61.144 ms 2024-03-25T05:54:34.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 46217 14.45 MB/sec execute 52 sec latency 86.248 ms 2024-03-25T05:54:35.767 INFO:tasks.workunit.client.0.smithi102.stdout: 10 46350 14.22 MB/sec execute 53 sec latency 228.876 ms 2024-03-25T05:54:36.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 46476 14.02 MB/sec execute 54 sec latency 147.182 ms 2024-03-25T05:54:37.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 46697 13.91 MB/sec execute 55 sec latency 95.886 ms 2024-03-25T05:54:38.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 46980 13.91 MB/sec execute 56 sec latency 71.476 ms 2024-03-25T05:54:39.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 47446 13.95 MB/sec execute 57 sec latency 71.326 ms 2024-03-25T05:54:40.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 47964 14.15 MB/sec execute 58 sec latency 51.056 ms 2024-03-25T05:54:41.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 48534 14.51 MB/sec execute 59 sec latency 64.736 ms 2024-03-25T05:54:42.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 48924 14.76 MB/sec execute 60 sec latency 91.013 ms 2024-03-25T05:54:43.768 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49341 15.07 MB/sec execute 61 sec latency 56.888 ms 2024-03-25T05:54:44.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49573 15.07 MB/sec execute 62 sec latency 102.223 ms 2024-03-25T05:54:45.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49711 14.94 MB/sec execute 63 sec latency 103.826 ms 2024-03-25T05:54:46.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49776 14.72 MB/sec execute 64 sec latency 388.368 ms 2024-03-25T05:54:47.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49780 14.49 MB/sec execute 65 sec latency 1229.039 ms 2024-03-25T05:54:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49783 14.27 MB/sec execute 66 sec latency 2229.096 ms 2024-03-25T05:54:49.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49786 14.06 MB/sec execute 67 sec latency 2829.843 ms 2024-03-25T05:54:50.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49867 13.89 MB/sec execute 68 sec latency 2102.794 ms 2024-03-25T05:54:51.769 INFO:tasks.workunit.client.0.smithi102.stdout: 10 49972 13.73 MB/sec execute 69 sec latency 135.598 ms 2024-03-25T05:54:52.771 INFO:tasks.workunit.client.0.smithi102.stdout: 10 50099 13.56 MB/sec execute 70 sec latency 203.355 ms 2024-03-25T05:54:53.771 INFO:tasks.workunit.client.0.smithi102.stdout: 10 50296 13.49 MB/sec execute 71 sec latency 96.237 ms 2024-03-25T05:54:54.771 INFO:tasks.workunit.client.0.smithi102.stdout: 10 50491 13.49 MB/sec execute 72 sec latency 165.272 ms 2024-03-25T05:54:55.771 INFO:tasks.workunit.client.0.smithi102.stdout: 10 50760 13.41 MB/sec execute 73 sec latency 127.797 ms 2024-03-25T05:54:56.771 INFO:tasks.workunit.client.0.smithi102.stdout: 10 51129 13.43 MB/sec execute 74 sec latency 111.820 ms 2024-03-25T05:54:57.772 INFO:tasks.workunit.client.0.smithi102.stdout: 10 51334 13.41 MB/sec execute 75 sec latency 113.005 ms 2024-03-25T05:54:58.772 INFO:tasks.workunit.client.0.smithi102.stdout: 10 51830 13.61 MB/sec execute 76 sec latency 112.034 ms 2024-03-25T05:54:59.772 INFO:tasks.workunit.client.0.smithi102.stdout: 10 52131 13.64 MB/sec execute 77 sec latency 87.440 ms 2024-03-25T05:55:00.772 INFO:tasks.workunit.client.0.smithi102.stdout: 10 52501 13.89 MB/sec execute 78 sec latency 94.574 ms 2024-03-25T05:55:01.772 INFO:tasks.workunit.client.0.smithi102.stdout: 10 52774 13.93 MB/sec execute 79 sec latency 94.494 ms 2024-03-25T05:55:02.772 INFO:tasks.workunit.client.0.smithi102.stdout: 10 53001 13.98 MB/sec execute 80 sec latency 98.950 ms 2024-03-25T05:55:03.772 INFO:tasks.workunit.client.0.smithi102.stdout: 10 53194 13.95 MB/sec execute 81 sec latency 82.150 ms 2024-03-25T05:55:04.774 INFO:tasks.workunit.client.0.smithi102.stdout: 10 53341 13.82 MB/sec execute 82 sec latency 111.391 ms 2024-03-25T05:55:05.774 INFO:tasks.workunit.client.0.smithi102.stdout: 10 53507 13.71 MB/sec execute 83 sec latency 127.735 ms 2024-03-25T05:55:06.775 INFO:tasks.workunit.client.0.smithi102.stdout: 10 53758 13.67 MB/sec execute 84 sec latency 60.012 ms 2024-03-25T05:55:07.775 INFO:tasks.workunit.client.0.smithi102.stdout: 10 54019 13.67 MB/sec execute 85 sec latency 93.151 ms 2024-03-25T05:55:08.776 INFO:tasks.workunit.client.0.smithi102.stdout: 10 54272 13.57 MB/sec execute 86 sec latency 103.820 ms 2024-03-25T05:55:09.775 INFO:tasks.workunit.client.0.smithi102.stdout: 10 54709 13.63 MB/sec execute 87 sec latency 75.917 ms 2024-03-25T05:55:10.777 INFO:tasks.workunit.client.0.smithi102.stdout: 10 55172 13.83 MB/sec execute 88 sec latency 55.322 ms 2024-03-25T05:55:11.777 INFO:tasks.workunit.client.0.smithi102.stdout: 10 55692 13.96 MB/sec execute 89 sec latency 71.798 ms 2024-03-25T05:55:12.777 INFO:tasks.workunit.client.0.smithi102.stdout: 10 56037 14.12 MB/sec execute 90 sec latency 89.383 ms 2024-03-25T05:55:13.777 INFO:tasks.workunit.client.0.smithi102.stdout: 10 56354 14.23 MB/sec execute 91 sec latency 77.305 ms 2024-03-25T05:55:14.777 INFO:tasks.workunit.client.0.smithi102.stdout: 10 56579 14.24 MB/sec execute 92 sec latency 103.464 ms 2024-03-25T05:55:15.778 INFO:tasks.workunit.client.0.smithi102.stdout: 10 56765 14.22 MB/sec execute 93 sec latency 91.481 ms 2024-03-25T05:55:16.778 INFO:tasks.workunit.client.0.smithi102.stdout: 10 56909 14.10 MB/sec execute 94 sec latency 136.654 ms 2024-03-25T05:55:17.778 INFO:tasks.workunit.client.0.smithi102.stdout: 10 57066 14.00 MB/sec execute 95 sec latency 99.948 ms 2024-03-25T05:55:18.778 INFO:tasks.workunit.client.0.smithi102.stdout: 10 57327 13.98 MB/sec execute 96 sec latency 92.741 ms 2024-03-25T05:55:19.778 INFO:tasks.workunit.client.0.smithi102.stdout: 10 57562 13.92 MB/sec execute 97 sec latency 157.369 ms 2024-03-25T05:55:20.778 INFO:tasks.workunit.client.0.smithi102.stdout: 10 57921 13.90 MB/sec execute 98 sec latency 81.402 ms 2024-03-25T05:55:21.779 INFO:tasks.workunit.client.0.smithi102.stdout: 10 58341 13.98 MB/sec execute 99 sec latency 72.206 ms 2024-03-25T05:55:22.779 INFO:tasks.workunit.client.0.smithi102.stdout: 10 58782 14.08 MB/sec execute 100 sec latency 133.734 ms 2024-03-25T05:55:23.779 INFO:tasks.workunit.client.0.smithi102.stdout: 10 59126 14.15 MB/sec execute 101 sec latency 107.612 ms 2024-03-25T05:55:24.780 INFO:tasks.workunit.client.0.smithi102.stdout: 10 59563 14.33 MB/sec execute 102 sec latency 214.897 ms 2024-03-25T05:55:25.780 INFO:tasks.workunit.client.0.smithi102.stdout: 10 59764 14.31 MB/sec execute 103 sec latency 260.020 ms 2024-03-25T05:55:26.781 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60046 14.40 MB/sec execute 104 sec latency 92.109 ms 2024-03-25T05:55:27.781 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60245 14.35 MB/sec execute 105 sec latency 306.341 ms 2024-03-25T05:55:28.782 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60252 14.21 MB/sec execute 106 sec latency 1306.514 ms 2024-03-25T05:55:29.782 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60260 14.08 MB/sec execute 107 sec latency 2062.620 ms 2024-03-25T05:55:30.782 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60272 13.95 MB/sec execute 108 sec latency 2520.566 ms 2024-03-25T05:55:31.782 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60387 13.89 MB/sec execute 109 sec latency 1793.585 ms 2024-03-25T05:55:32.786 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60510 13.79 MB/sec execute 110 sec latency 183.199 ms 2024-03-25T05:55:33.786 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60663 13.72 MB/sec execute 111 sec latency 97.400 ms 2024-03-25T05:55:34.786 INFO:tasks.workunit.client.0.smithi102.stdout: 10 60854 13.69 MB/sec execute 112 sec latency 125.654 ms 2024-03-25T05:55:35.786 INFO:tasks.workunit.client.0.smithi102.stdout: 10 61048 13.66 MB/sec execute 113 sec latency 121.696 ms 2024-03-25T05:55:36.786 INFO:tasks.workunit.client.0.smithi102.stdout: 10 61266 13.56 MB/sec execute 114 sec latency 112.597 ms 2024-03-25T05:55:37.787 INFO:tasks.workunit.client.0.smithi102.stdout: 10 61557 13.51 MB/sec execute 115 sec latency 116.216 ms 2024-03-25T05:55:38.788 INFO:tasks.workunit.client.0.smithi102.stdout: 10 61759 13.49 MB/sec execute 116 sec latency 104.672 ms 2024-03-25T05:55:39.790 INFO:tasks.workunit.client.0.smithi102.stdout: 10 62074 13.59 MB/sec execute 117 sec latency 129.415 ms 2024-03-25T05:55:40.790 INFO:tasks.workunit.client.0.smithi102.stdout: 10 62660 13.74 MB/sec execute 118 sec latency 56.622 ms 2024-03-25T05:55:41.790 INFO:tasks.workunit.client.0.smithi102.stdout: 10 63091 13.88 MB/sec execute 119 sec latency 83.099 ms 2024-03-25T05:55:42.790 INFO:tasks.workunit.client.0.smithi102.stdout: 10 63391 13.90 MB/sec execute 120 sec latency 71.646 ms 2024-03-25T05:55:43.791 INFO:tasks.workunit.client.0.smithi102.stdout: 10 63717 13.99 MB/sec execute 121 sec latency 78.481 ms 2024-03-25T05:55:44.792 INFO:tasks.workunit.client.0.smithi102.stdout: 10 63928 13.95 MB/sec execute 122 sec latency 150.713 ms 2024-03-25T05:55:45.792 INFO:tasks.workunit.client.0.smithi102.stdout: 10 64148 13.91 MB/sec execute 123 sec latency 73.185 ms 2024-03-25T05:55:46.792 INFO:tasks.workunit.client.0.smithi102.stdout: 10 64429 13.91 MB/sec execute 124 sec latency 100.390 ms 2024-03-25T05:55:47.792 INFO:tasks.workunit.client.0.smithi102.stdout: 10 64738 13.90 MB/sec execute 125 sec latency 173.012 ms 2024-03-25T05:55:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: 10 65115 13.87 MB/sec execute 126 sec latency 97.564 ms 2024-03-25T05:55:49.793 INFO:tasks.workunit.client.0.smithi102.stdout: 10 65482 13.96 MB/sec execute 127 sec latency 58.329 ms 2024-03-25T05:55:50.793 INFO:tasks.workunit.client.0.smithi102.stdout: 10 66008 14.08 MB/sec execute 128 sec latency 61.139 ms 2024-03-25T05:55:51.794 INFO:tasks.workunit.client.0.smithi102.stdout: 10 66470 14.20 MB/sec execute 129 sec latency 65.767 ms 2024-03-25T05:55:52.794 INFO:tasks.workunit.client.0.smithi102.stdout: 10 66806 14.27 MB/sec execute 130 sec latency 85.536 ms 2024-03-25T05:55:53.795 INFO:tasks.workunit.client.0.smithi102.stdout: 10 67131 14.32 MB/sec execute 131 sec latency 98.890 ms 2024-03-25T05:55:54.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 67272 14.26 MB/sec execute 132 sec latency 432.968 ms 2024-03-25T05:55:55.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:55:55.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:55:55.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 67376 14.18 MB/sec execute 133 sec latency 481.802 ms 2024-03-25T05:55:56.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 67579 14.16 MB/sec execute 134 sec latency 123.076 ms 2024-03-25T05:55:57.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 67739 14.10 MB/sec execute 135 sec latency 340.789 ms 2024-03-25T05:55:58.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 67999 14.08 MB/sec execute 136 sec latency 307.144 ms 2024-03-25T05:55:59.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 68027 13.98 MB/sec execute 137 sec latency 798.773 ms 2024-03-25T05:56:00.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 68043 13.88 MB/sec execute 138 sec latency 1094.302 ms 2024-03-25T05:56:01.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 68196 13.85 MB/sec execute 139 sec latency 768.947 ms 2024-03-25T05:56:02.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 68416 13.79 MB/sec execute 140 sec latency 129.356 ms 2024-03-25T05:56:03.800 INFO:tasks.workunit.client.0.smithi102.stdout: 10 68697 13.76 MB/sec execute 141 sec latency 95.394 ms 2024-03-25T05:56:04.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 68871 13.76 MB/sec execute 142 sec latency 290.453 ms 2024-03-25T05:56:05.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 69102 13.75 MB/sec execute 143 sec latency 104.778 ms 2024-03-25T05:56:06.799 INFO:tasks.workunit.client.0.smithi102.stdout: 10 69537 13.84 MB/sec execute 144 sec latency 90.066 ms 2024-03-25T05:56:07.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 69861 13.88 MB/sec execute 145 sec latency 209.369 ms 2024-03-25T05:56:08.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 70261 13.98 MB/sec execute 146 sec latency 209.367 ms 2024-03-25T05:56:09.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 70523 14.00 MB/sec execute 147 sec latency 88.026 ms 2024-03-25T05:56:10.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 70824 14.01 MB/sec execute 148 sec latency 57.637 ms 2024-03-25T05:56:11.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 70954 13.94 MB/sec execute 149 sec latency 142.951 ms 2024-03-25T05:56:12.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 71108 13.89 MB/sec execute 150 sec latency 153.585 ms 2024-03-25T05:56:13.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 71393 13.89 MB/sec execute 151 sec latency 338.697 ms 2024-03-25T05:56:14.802 INFO:tasks.workunit.client.0.smithi102.stdout: 10 71770 13.93 MB/sec execute 152 sec latency 177.053 ms 2024-03-25T05:56:15.803 INFO:tasks.workunit.client.0.smithi102.stdout: 10 71850 13.85 MB/sec execute 153 sec latency 496.489 ms 2024-03-25T05:56:16.803 INFO:tasks.workunit.client.0.smithi102.stdout: 10 72200 13.83 MB/sec execute 154 sec latency 137.240 ms 2024-03-25T05:56:17.803 INFO:tasks.workunit.client.0.smithi102.stdout: 10 72509 13.88 MB/sec execute 155 sec latency 84.327 ms 2024-03-25T05:56:18.803 INFO:tasks.workunit.client.0.smithi102.stdout: 10 73043 14.00 MB/sec execute 156 sec latency 46.738 ms 2024-03-25T05:56:19.804 INFO:tasks.workunit.client.0.smithi102.stdout: 10 73473 14.09 MB/sec execute 157 sec latency 108.034 ms 2024-03-25T05:56:20.804 INFO:tasks.workunit.client.0.smithi102.stdout: 10 73556 14.01 MB/sec execute 158 sec latency 513.011 ms 2024-03-25T05:56:21.804 INFO:tasks.workunit.client.0.smithi102.stdout: 10 73722 14.02 MB/sec execute 159 sec latency 188.569 ms 2024-03-25T05:56:22.805 INFO:tasks.workunit.client.0.smithi102.stdout: 10 73895 13.97 MB/sec execute 160 sec latency 181.768 ms 2024-03-25T05:56:23.805 INFO:tasks.workunit.client.0.smithi102.stdout: 10 74255 14.04 MB/sec execute 161 sec latency 50.545 ms 2024-03-25T05:56:24.805 INFO:tasks.workunit.client.0.smithi102.stdout: 10 74457 14.00 MB/sec execute 162 sec latency 141.268 ms 2024-03-25T05:56:25.805 INFO:tasks.workunit.client.0.smithi102.stdout: 10 74706 13.96 MB/sec execute 163 sec latency 88.933 ms 2024-03-25T05:56:26.805 INFO:tasks.workunit.client.0.smithi102.stdout: 10 75074 14.00 MB/sec execute 164 sec latency 49.589 ms 2024-03-25T05:56:27.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:56:27.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:56:27.805 INFO:tasks.workunit.client.0.smithi102.stdout: 10 75455 13.99 MB/sec execute 165 sec latency 106.911 ms 2024-03-25T05:56:28.805 INFO:tasks.workunit.client.0.smithi102.stdout: 10 75775 13.99 MB/sec execute 166 sec latency 207.543 ms 2024-03-25T05:56:29.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 76225 14.10 MB/sec execute 167 sec latency 64.034 ms 2024-03-25T05:56:30.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 76731 14.17 MB/sec execute 168 sec latency 75.051 ms 2024-03-25T05:56:31.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 77151 14.27 MB/sec execute 169 sec latency 55.239 ms 2024-03-25T05:56:32.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 77388 14.27 MB/sec execute 170 sec latency 124.319 ms 2024-03-25T05:56:33.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 77670 14.30 MB/sec execute 171 sec latency 79.414 ms 2024-03-25T05:56:34.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 77890 14.26 MB/sec execute 172 sec latency 143.130 ms 2024-03-25T05:56:35.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 77982 14.20 MB/sec execute 173 sec latency 641.784 ms 2024-03-25T05:56:36.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 78107 14.15 MB/sec execute 174 sec latency 614.724 ms 2024-03-25T05:56:37.807 INFO:tasks.workunit.client.0.smithi102.stdout: 10 78308 14.10 MB/sec execute 175 sec latency 104.268 ms 2024-03-25T05:56:38.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 78597 14.12 MB/sec execute 176 sec latency 88.354 ms 2024-03-25T05:56:39.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 79014 14.12 MB/sec execute 177 sec latency 60.291 ms 2024-03-25T05:56:40.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 79239 14.08 MB/sec execute 178 sec latency 435.753 ms 2024-03-25T05:56:41.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 79288 14.01 MB/sec execute 179 sec latency 578.658 ms 2024-03-25T05:56:42.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 79557 14.07 MB/sec execute 180 sec latency 168.326 ms 2024-03-25T05:56:43.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 79844 14.08 MB/sec execute 181 sec latency 102.697 ms 2024-03-25T05:56:44.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 80168 14.08 MB/sec execute 182 sec latency 122.843 ms 2024-03-25T05:56:45.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 80470 14.14 MB/sec execute 183 sec latency 86.833 ms 2024-03-25T05:56:46.808 INFO:tasks.workunit.client.0.smithi102.stdout: 10 80875 14.21 MB/sec execute 184 sec latency 45.370 ms 2024-03-25T05:56:47.809 INFO:tasks.workunit.client.0.smithi102.stdout: 10 81106 14.21 MB/sec execute 185 sec latency 100.588 ms 2024-03-25T05:56:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: 10 81256 14.18 MB/sec execute 186 sec latency 217.065 ms 2024-03-25T05:56:49.809 INFO:tasks.workunit.client.0.smithi102.stdout: 10 81470 14.14 MB/sec execute 187 sec latency 134.486 ms 2024-03-25T05:56:50.809 INFO:tasks.workunit.client.0.smithi102.stdout: 10 81753 14.14 MB/sec execute 188 sec latency 72.039 ms 2024-03-25T05:56:51.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 82138 14.16 MB/sec execute 189 sec latency 60.580 ms 2024-03-25T05:56:52.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 82548 14.14 MB/sec execute 190 sec latency 67.834 ms 2024-03-25T05:56:53.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 82977 14.20 MB/sec execute 191 sec latency 170.767 ms 2024-03-25T05:56:54.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 83370 14.27 MB/sec execute 192 sec latency 290.350 ms 2024-03-25T05:56:55.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 83840 14.33 MB/sec execute 193 sec latency 184.383 ms 2024-03-25T05:56:56.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 83892 14.28 MB/sec execute 194 sec latency 1006.482 ms 2024-03-25T05:56:57.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 84039 14.26 MB/sec execute 195 sec latency 384.031 ms 2024-03-25T05:56:58.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 84289 14.26 MB/sec execute 196 sec latency 89.108 ms 2024-03-25T05:56:58.869 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:56:58.876 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:56:59.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 84464 14.25 MB/sec execute 197 sec latency 93.501 ms 2024-03-25T05:57:00.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 84694 14.25 MB/sec execute 198 sec latency 96.983 ms 2024-03-25T05:57:01.810 INFO:tasks.workunit.client.0.smithi102.stdout: 10 84825 14.21 MB/sec execute 199 sec latency 417.455 ms 2024-03-25T05:57:02.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 84933 14.16 MB/sec execute 200 sec latency 413.637 ms 2024-03-25T05:57:03.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 85046 14.10 MB/sec execute 201 sec latency 153.521 ms 2024-03-25T05:57:04.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 85187 14.08 MB/sec execute 202 sec latency 393.349 ms 2024-03-25T05:57:05.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 85486 14.09 MB/sec execute 203 sec latency 92.998 ms 2024-03-25T05:57:06.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 85886 14.08 MB/sec execute 204 sec latency 73.296 ms 2024-03-25T05:57:07.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 86350 14.11 MB/sec execute 205 sec latency 68.055 ms 2024-03-25T05:57:08.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 86836 14.20 MB/sec execute 206 sec latency 65.436 ms 2024-03-25T05:57:09.811 INFO:tasks.workunit.client.0.smithi102.stdout: 10 87426 14.32 MB/sec execute 207 sec latency 75.885 ms 2024-03-25T05:57:10.812 INFO:tasks.workunit.client.0.smithi102.stdout: 10 87767 14.35 MB/sec execute 208 sec latency 71.005 ms 2024-03-25T05:57:11.812 INFO:tasks.workunit.client.0.smithi102.stdout: 10 88038 14.36 MB/sec execute 209 sec latency 132.200 ms 2024-03-25T05:57:12.812 INFO:tasks.workunit.client.0.smithi102.stdout: 10 88284 14.35 MB/sec execute 210 sec latency 151.339 ms 2024-03-25T05:57:13.812 INFO:tasks.workunit.client.0.smithi102.stdout: 10 88462 14.32 MB/sec execute 211 sec latency 190.405 ms 2024-03-25T05:57:14.812 INFO:tasks.workunit.client.0.smithi102.stdout: 10 88685 14.30 MB/sec execute 212 sec latency 98.460 ms 2024-03-25T05:57:15.812 INFO:tasks.workunit.client.0.smithi102.stdout: 10 88996 14.31 MB/sec execute 213 sec latency 69.778 ms 2024-03-25T05:57:16.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 89444 14.32 MB/sec execute 214 sec latency 65.407 ms 2024-03-25T05:57:17.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 89920 14.34 MB/sec execute 215 sec latency 54.010 ms 2024-03-25T05:57:18.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 90446 14.43 MB/sec execute 216 sec latency 54.923 ms 2024-03-25T05:57:19.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 90972 14.51 MB/sec execute 217 sec latency 82.185 ms 2024-03-25T05:57:20.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 91309 14.57 MB/sec execute 218 sec latency 74.831 ms 2024-03-25T05:57:21.814 INFO:tasks.workunit.client.0.smithi102.stdout: 10 91615 14.58 MB/sec execute 219 sec latency 112.254 ms 2024-03-25T05:57:22.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 91638 14.52 MB/sec execute 220 sec latency 572.527 ms 2024-03-25T05:57:23.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 91708 14.48 MB/sec execute 221 sec latency 618.505 ms 2024-03-25T05:57:24.813 INFO:tasks.workunit.client.0.smithi102.stdout: 10 91873 14.46 MB/sec execute 222 sec latency 97.676 ms 2024-03-25T05:57:25.814 INFO:tasks.workunit.client.0.smithi102.stdout: 10 92004 14.41 MB/sec execute 223 sec latency 108.691 ms 2024-03-25T05:57:26.814 INFO:tasks.workunit.client.0.smithi102.stdout: 10 92125 14.37 MB/sec execute 224 sec latency 111.553 ms 2024-03-25T05:57:27.814 INFO:tasks.workunit.client.0.smithi102.stdout: 10 92245 14.33 MB/sec execute 225 sec latency 515.447 ms 2024-03-25T05:57:28.814 INFO:tasks.workunit.client.0.smithi102.stdout: 10 92337 14.28 MB/sec execute 226 sec latency 697.758 ms 2024-03-25T05:57:29.034 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:57:29.048 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T05:57:29.211 INFO:tasks.ceph.mds.a.smithi102.stderr:2024-03-25T05:57:29.220+0000 7f2deba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46752) UID: 0 2024-03-25T05:57:29.211 INFO:tasks.ceph.mds.c.smithi102.stderr:2024-03-25T05:57:29.221+0000 7f147b800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46752) UID: 0 2024-03-25T05:57:29.212 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T05:57:29.222+0000 7f9adf000640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46752) UID: 0 2024-03-25T05:57:29.815 INFO:tasks.workunit.client.0.smithi102.stdout: 10 92520 14.26 MB/sec execute 227 sec latency 113.504 ms 2024-03-25T05:57:30.815 INFO:tasks.workunit.client.0.smithi102.stdout: 10 92715 14.23 MB/sec execute 228 sec latency 133.019 ms 2024-03-25T05:57:31.815 INFO:tasks.workunit.client.0.smithi102.stdout: 10 92903 14.20 MB/sec execute 229 sec latency 161.456 ms 2024-03-25T05:57:32.815 INFO:tasks.workunit.client.0.smithi102.stdout: 10 93394 14.23 MB/sec execute 230 sec latency 73.021 ms 2024-03-25T05:57:33.820 INFO:tasks.workunit.client.0.smithi102.stdout: 10 93816 14.26 MB/sec execute 231 sec latency 74.490 ms 2024-03-25T05:57:34.820 INFO:tasks.workunit.client.0.smithi102.stdout: 10 94217 14.30 MB/sec execute 232 sec latency 77.924 ms 2024-03-25T05:57:35.820 INFO:tasks.workunit.client.0.smithi102.stdout: 10 94629 14.39 MB/sec execute 233 sec latency 72.910 ms 2024-03-25T05:57:36.823 INFO:tasks.workunit.client.0.smithi102.stdout: 10 94974 14.44 MB/sec execute 234 sec latency 90.271 ms 2024-03-25T05:57:37.823 INFO:tasks.workunit.client.0.smithi102.stdout: 10 95205 14.42 MB/sec execute 235 sec latency 96.233 ms 2024-03-25T05:57:38.824 INFO:tasks.workunit.client.0.smithi102.stdout: 10 95379 14.40 MB/sec execute 236 sec latency 112.180 ms 2024-03-25T05:57:39.824 INFO:tasks.workunit.client.0.smithi102.stdout: 10 95483 14.36 MB/sec execute 237 sec latency 342.323 ms 2024-03-25T05:57:40.825 INFO:tasks.workunit.client.0.smithi102.stdout: 10 95683 14.32 MB/sec execute 238 sec latency 98.566 ms 2024-03-25T05:57:41.828 INFO:tasks.workunit.client.0.smithi102.stdout: 10 95826 14.30 MB/sec execute 239 sec latency 128.975 ms 2024-03-25T05:57:42.827 INFO:tasks.workunit.client.0.smithi102.stdout: 10 96061 14.28 MB/sec execute 240 sec latency 160.387 ms 2024-03-25T05:57:43.827 INFO:tasks.workunit.client.0.smithi102.stdout: 10 96079 14.22 MB/sec execute 241 sec latency 762.621 ms 2024-03-25T05:57:44.828 INFO:tasks.workunit.client.0.smithi102.stdout: 10 96252 14.20 MB/sec execute 242 sec latency 860.503 ms 2024-03-25T05:57:45.828 INFO:tasks.workunit.client.0.smithi102.stdout: 10 96444 14.16 MB/sec execute 243 sec latency 162.222 ms 2024-03-25T05:57:46.828 INFO:tasks.workunit.client.0.smithi102.stdout: 10 96679 14.14 MB/sec execute 244 sec latency 145.926 ms 2024-03-25T05:57:47.828 INFO:tasks.workunit.client.0.smithi102.stdout: 10 97103 14.18 MB/sec execute 245 sec latency 75.949 ms 2024-03-25T05:57:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: 10 97300 14.17 MB/sec execute 246 sec latency 495.500 ms 2024-03-25T05:57:49.829 INFO:tasks.workunit.client.0.smithi102.stdout: 10 97611 14.19 MB/sec execute 247 sec latency 102.670 ms 2024-03-25T05:57:50.830 INFO:tasks.workunit.client.0.smithi102.stdout: 10 97899 14.19 MB/sec execute 248 sec latency 108.838 ms 2024-03-25T05:57:51.831 INFO:tasks.workunit.client.0.smithi102.stdout: 10 98249 14.25 MB/sec execute 249 sec latency 82.230 ms 2024-03-25T05:57:52.831 INFO:tasks.workunit.client.0.smithi102.stdout: 10 98612 14.28 MB/sec execute 250 sec latency 53.879 ms 2024-03-25T05:57:53.831 INFO:tasks.workunit.client.0.smithi102.stdout: 10 98782 14.27 MB/sec execute 251 sec latency 108.557 ms 2024-03-25T05:57:54.831 INFO:tasks.workunit.client.0.smithi102.stdout: 10 98900 14.24 MB/sec execute 252 sec latency 259.265 ms 2024-03-25T05:57:55.831 INFO:tasks.workunit.client.0.smithi102.stdout: 10 98900 14.18 MB/sec execute 253 sec latency 1259.380 ms 2024-03-25T05:57:56.831 INFO:tasks.workunit.client.0.smithi102.stdout: 10 99045 14.15 MB/sec execute 254 sec latency 1343.595 ms 2024-03-25T05:57:57.832 INFO:tasks.workunit.client.0.smithi102.stdout: 10 99213 14.12 MB/sec execute 255 sec latency 123.988 ms 2024-03-25T05:57:58.835 INFO:tasks.workunit.client.0.smithi102.stdout: 10 99257 14.07 MB/sec execute 256 sec latency 735.927 ms 2024-03-25T05:57:59.834 INFO:tasks.workunit.client.0.smithi102.stdout: 10 99374 14.04 MB/sec execute 257 sec latency 981.934 ms 2024-03-25T05:58:00.834 INFO:tasks.workunit.client.0.smithi102.stdout: 10 99545 14.02 MB/sec execute 258 sec latency 120.657 ms 2024-03-25T05:58:01.834 INFO:tasks.workunit.client.0.smithi102.stdout: 10 99702 13.98 MB/sec execute 259 sec latency 149.673 ms 2024-03-25T05:58:02.834 INFO:tasks.workunit.client.0.smithi102.stdout: 10 99982 13.98 MB/sec execute 260 sec latency 114.631 ms 2024-03-25T05:58:03.835 INFO:tasks.workunit.client.0.smithi102.stdout: 10 100207 13.95 MB/sec execute 261 sec latency 297.010 ms 2024-03-25T05:58:04.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 100441 13.94 MB/sec execute 262 sec latency 257.682 ms 2024-03-25T05:58:05.835 INFO:tasks.workunit.client.0.smithi102.stdout: 10 100749 13.95 MB/sec execute 263 sec latency 354.141 ms 2024-03-25T05:58:06.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 101113 14.00 MB/sec execute 264 sec latency 91.223 ms 2024-03-25T05:58:07.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 101534 14.03 MB/sec execute 265 sec latency 60.712 ms 2024-03-25T05:58:08.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 101884 14.08 MB/sec execute 266 sec latency 61.830 ms 2024-03-25T05:58:09.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 102102 14.07 MB/sec execute 267 sec latency 93.932 ms 2024-03-25T05:58:10.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 102312 14.06 MB/sec execute 268 sec latency 252.326 ms 2024-03-25T05:58:11.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 102461 14.04 MB/sec execute 269 sec latency 180.808 ms 2024-03-25T05:58:12.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 102648 14.02 MB/sec execute 270 sec latency 132.715 ms 2024-03-25T05:58:13.837 INFO:tasks.workunit.client.0.smithi102.stdout: 10 102769 14.00 MB/sec execute 271 sec latency 341.651 ms 2024-03-25T05:58:14.836 INFO:tasks.workunit.client.0.smithi102.stdout: 10 102788 13.95 MB/sec execute 272 sec latency 874.677 ms 2024-03-25T05:58:15.837 INFO:tasks.workunit.client.0.smithi102.stdout: 10 103001 13.94 MB/sec execute 273 sec latency 94.649 ms 2024-03-25T05:58:16.837 INFO:tasks.workunit.client.0.smithi102.stdout: 10 103138 13.90 MB/sec execute 274 sec latency 156.946 ms 2024-03-25T05:58:17.837 INFO:tasks.workunit.client.0.smithi102.stdout: 10 103478 13.91 MB/sec execute 275 sec latency 88.412 ms 2024-03-25T05:58:18.837 INFO:tasks.workunit.client.0.smithi102.stdout: 10 103685 13.88 MB/sec execute 276 sec latency 353.216 ms 2024-03-25T05:58:19.837 INFO:tasks.workunit.client.0.smithi102.stdout: 10 103920 13.86 MB/sec execute 277 sec latency 477.988 ms 2024-03-25T05:58:20.837 INFO:tasks.workunit.client.0.smithi102.stdout: 10 104152 13.86 MB/sec execute 278 sec latency 169.698 ms 2024-03-25T05:58:21.840 INFO:tasks.workunit.client.0.smithi102.stdout: 10 104514 13.89 MB/sec execute 279 sec latency 73.685 ms 2024-03-25T05:58:22.840 INFO:tasks.workunit.client.0.smithi102.stdout: 10 104840 13.92 MB/sec execute 280 sec latency 83.287 ms 2024-03-25T05:58:23.840 INFO:tasks.workunit.client.0.smithi102.stdout: 10 105251 13.96 MB/sec execute 281 sec latency 74.654 ms 2024-03-25T05:58:24.840 INFO:tasks.workunit.client.0.smithi102.stdout: 10 105576 13.98 MB/sec execute 282 sec latency 53.560 ms 2024-03-25T05:58:25.840 INFO:tasks.workunit.client.0.smithi102.stdout: 10 105781 13.98 MB/sec execute 283 sec latency 91.469 ms 2024-03-25T05:58:26.841 INFO:tasks.workunit.client.0.smithi102.stdout: 10 105988 13.97 MB/sec execute 284 sec latency 141.107 ms 2024-03-25T05:58:27.841 INFO:tasks.workunit.client.0.smithi102.stdout: 10 106169 13.96 MB/sec execute 285 sec latency 119.531 ms 2024-03-25T05:58:28.841 INFO:tasks.workunit.client.0.smithi102.stdout: 10 106373 13.95 MB/sec execute 286 sec latency 116.316 ms 2024-03-25T05:58:29.841 INFO:tasks.workunit.client.0.smithi102.stdout: 10 106651 13.93 MB/sec execute 287 sec latency 73.096 ms 2024-03-25T05:58:30.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 106958 13.93 MB/sec execute 288 sec latency 93.511 ms 2024-03-25T05:58:31.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 107331 13.94 MB/sec execute 289 sec latency 68.308 ms 2024-03-25T05:58:32.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 107677 13.95 MB/sec execute 290 sec latency 100.526 ms 2024-03-25T05:58:33.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 108046 13.98 MB/sec execute 291 sec latency 98.454 ms 2024-03-25T05:58:34.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 108490 14.03 MB/sec execute 292 sec latency 89.865 ms 2024-03-25T05:58:35.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 108858 14.07 MB/sec execute 293 sec latency 81.304 ms 2024-03-25T05:58:36.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 109165 14.07 MB/sec execute 294 sec latency 97.911 ms 2024-03-25T05:58:37.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 109380 14.05 MB/sec execute 295 sec latency 107.855 ms 2024-03-25T05:58:38.842 INFO:tasks.workunit.client.0.smithi102.stdout: 10 109594 14.06 MB/sec execute 296 sec latency 113.445 ms 2024-03-25T05:58:39.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 109856 14.06 MB/sec execute 297 sec latency 81.889 ms 2024-03-25T05:58:40.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 110127 14.06 MB/sec execute 298 sec latency 111.738 ms 2024-03-25T05:58:41.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 110435 14.05 MB/sec execute 299 sec latency 91.004 ms 2024-03-25T05:58:42.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 110801 14.05 MB/sec execute 300 sec latency 55.307 ms 2024-03-25T05:58:43.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 111106 14.05 MB/sec execute 301 sec latency 98.938 ms 2024-03-25T05:58:44.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 111436 14.07 MB/sec execute 302 sec latency 105.647 ms 2024-03-25T05:58:45.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 111805 14.11 MB/sec execute 303 sec latency 103.247 ms 2024-03-25T05:58:46.843 INFO:tasks.workunit.client.0.smithi102.stdout: 10 112215 14.14 MB/sec execute 304 sec latency 54.965 ms 2024-03-25T05:58:47.847 INFO:tasks.workunit.client.0.smithi102.stdout: 10 112505 14.16 MB/sec execute 305 sec latency 91.696 ms 2024-03-25T05:58:48.847 INFO:tasks.workunit.client.0.smithi102.stdout: 10 112783 14.16 MB/sec execute 306 sec latency 106.306 ms 2024-03-25T05:58:49.850 INFO:tasks.workunit.client.0.smithi102.stdout: 10 112924 14.13 MB/sec execute 307 sec latency 341.116 ms 2024-03-25T05:58:50.851 INFO:tasks.workunit.client.0.smithi102.stdout: 10 112933 14.09 MB/sec execute 308 sec latency 1026.211 ms 2024-03-25T05:58:51.851 INFO:tasks.workunit.client.0.smithi102.stdout: 10 112936 14.04 MB/sec execute 309 sec latency 2026.275 ms 2024-03-25T05:58:52.852 INFO:tasks.workunit.client.0.smithi102.stdout: 10 112942 14.00 MB/sec execute 310 sec latency 2780.868 ms 2024-03-25T05:58:53.855 INFO:tasks.workunit.client.0.smithi102.stdout: 10 113000 13.96 MB/sec execute 311 sec latency 726.451 ms 2024-03-25T05:58:54.856 INFO:tasks.workunit.client.0.smithi102.stdout: 10 113159 13.95 MB/sec execute 312 sec latency 148.857 ms 2024-03-25T05:58:55.856 INFO:tasks.workunit.client.0.smithi102.stdout: 10 113308 13.93 MB/sec execute 313 sec latency 163.408 ms 2024-03-25T05:58:56.856 INFO:tasks.workunit.client.0.smithi102.stdout: 10 113481 13.90 MB/sec execute 314 sec latency 129.811 ms 2024-03-25T05:58:57.856 INFO:tasks.workunit.client.0.smithi102.stdout: 10 113662 13.90 MB/sec execute 315 sec latency 134.736 ms 2024-03-25T05:58:58.859 INFO:tasks.workunit.client.0.smithi102.stdout: 10 113813 13.88 MB/sec execute 316 sec latency 134.416 ms 2024-03-25T05:58:59.860 INFO:tasks.workunit.client.0.smithi102.stdout: 10 114021 13.85 MB/sec execute 317 sec latency 135.426 ms 2024-03-25T05:59:00.860 INFO:tasks.workunit.client.0.smithi102.stdout: 10 114220 13.84 MB/sec execute 318 sec latency 262.780 ms 2024-03-25T05:59:01.860 INFO:tasks.workunit.client.0.smithi102.stdout: 10 114347 13.81 MB/sec execute 319 sec latency 159.212 ms 2024-03-25T05:59:02.860 INFO:tasks.workunit.client.0.smithi102.stdout: 10 114532 13.78 MB/sec execute 320 sec latency 150.251 ms 2024-03-25T05:59:03.861 INFO:tasks.workunit.client.0.smithi102.stdout: 10 114753 13.79 MB/sec execute 321 sec latency 141.774 ms 2024-03-25T05:59:04.862 INFO:tasks.workunit.client.0.smithi102.stdout: 10 114925 13.77 MB/sec execute 322 sec latency 117.788 ms 2024-03-25T05:59:05.863 INFO:tasks.workunit.client.0.smithi102.stdout: 10 115350 13.82 MB/sec execute 323 sec latency 91.011 ms 2024-03-25T05:59:06.863 INFO:tasks.workunit.client.0.smithi102.stdout: 10 115722 13.85 MB/sec execute 324 sec latency 94.945 ms 2024-03-25T05:59:07.863 INFO:tasks.workunit.client.0.smithi102.stdout: 10 116044 13.88 MB/sec execute 325 sec latency 96.115 ms 2024-03-25T05:59:08.863 INFO:tasks.workunit.client.0.smithi102.stdout: 10 116349 13.89 MB/sec execute 326 sec latency 87.967 ms 2024-03-25T05:59:09.863 INFO:tasks.workunit.client.0.smithi102.stdout: 10 116570 13.87 MB/sec execute 327 sec latency 150.254 ms 2024-03-25T05:59:10.866 INFO:tasks.workunit.client.0.smithi102.stdout: 10 116704 13.85 MB/sec execute 328 sec latency 143.561 ms 2024-03-25T05:59:11.867 INFO:tasks.workunit.client.0.smithi102.stdout: 10 116885 13.83 MB/sec execute 329 sec latency 156.627 ms 2024-03-25T05:59:12.868 INFO:tasks.workunit.client.0.smithi102.stdout: 10 117085 13.82 MB/sec execute 330 sec latency 139.435 ms 2024-03-25T05:59:13.868 INFO:tasks.workunit.client.0.smithi102.stdout: 10 117352 13.82 MB/sec execute 331 sec latency 98.291 ms 2024-03-25T05:59:14.868 INFO:tasks.workunit.client.0.smithi102.stdout: 10 117772 13.83 MB/sec execute 332 sec latency 75.657 ms 2024-03-25T05:59:15.868 INFO:tasks.workunit.client.0.smithi102.stdout: 10 118127 13.83 MB/sec execute 333 sec latency 109.738 ms 2024-03-25T05:59:16.868 INFO:tasks.workunit.client.0.smithi102.stdout: 10 118522 13.88 MB/sec execute 334 sec latency 112.127 ms 2024-03-25T05:59:17.869 INFO:tasks.workunit.client.0.smithi102.stdout: 10 119061 13.94 MB/sec execute 335 sec latency 51.689 ms 2024-03-25T05:59:18.869 INFO:tasks.workunit.client.0.smithi102.stdout: 10 119397 13.95 MB/sec execute 336 sec latency 71.079 ms 2024-03-25T05:59:19.869 INFO:tasks.workunit.client.0.smithi102.stdout: 10 119594 13.95 MB/sec execute 337 sec latency 96.174 ms 2024-03-25T05:59:20.869 INFO:tasks.workunit.client.0.smithi102.stdout: 10 119806 13.94 MB/sec execute 338 sec latency 88.410 ms 2024-03-25T05:59:21.870 INFO:tasks.workunit.client.0.smithi102.stdout: 10 120009 13.94 MB/sec execute 339 sec latency 99.951 ms 2024-03-25T05:59:22.871 INFO:tasks.workunit.client.0.smithi102.stdout: 10 120241 13.92 MB/sec execute 340 sec latency 111.981 ms 2024-03-25T05:59:23.871 INFO:tasks.workunit.client.0.smithi102.stdout: 10 120440 13.90 MB/sec execute 341 sec latency 141.507 ms 2024-03-25T05:59:24.871 INFO:tasks.workunit.client.0.smithi102.stdout: 10 120660 13.90 MB/sec execute 342 sec latency 116.309 ms 2024-03-25T05:59:25.871 INFO:tasks.workunit.client.0.smithi102.stdout: 10 120913 13.89 MB/sec execute 343 sec latency 171.722 ms 2024-03-25T05:59:26.871 INFO:tasks.workunit.client.0.smithi102.stdout: 10 121196 13.88 MB/sec execute 344 sec latency 133.548 ms 2024-03-25T05:59:27.871 INFO:tasks.workunit.client.0.smithi102.stdout: 10 121445 13.88 MB/sec execute 345 sec latency 104.135 ms 2024-03-25T05:59:28.871 INFO:tasks.workunit.client.0.smithi102.stdout: 10 121822 13.89 MB/sec execute 346 sec latency 102.039 ms 2024-03-25T05:59:29.872 INFO:tasks.workunit.client.0.smithi102.stdout: 10 122232 13.94 MB/sec execute 347 sec latency 59.036 ms 2024-03-25T05:59:30.872 INFO:tasks.workunit.client.0.smithi102.stdout: 10 122561 13.96 MB/sec execute 348 sec latency 180.108 ms 2024-03-25T05:59:31.876 INFO:tasks.workunit.client.0.smithi102.stdout: 10 122562 13.92 MB/sec execute 349 sec latency 1154.906 ms 2024-03-25T05:59:32.876 INFO:tasks.workunit.client.0.smithi102.stdout: 10 122623 13.88 MB/sec execute 350 sec latency 1598.951 ms 2024-03-25T05:59:33.876 INFO:tasks.workunit.client.0.smithi102.stdout: 10 122804 13.87 MB/sec execute 351 sec latency 176.680 ms 2024-03-25T05:59:34.876 INFO:tasks.workunit.client.0.smithi102.stdout: 10 122946 13.86 MB/sec execute 352 sec latency 169.471 ms 2024-03-25T05:59:35.876 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123054 13.84 MB/sec execute 353 sec latency 311.948 ms 2024-03-25T05:59:36.876 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123127 13.82 MB/sec execute 354 sec latency 581.330 ms 2024-03-25T05:59:37.877 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123129 13.78 MB/sec execute 355 sec latency 1524.648 ms 2024-03-25T05:59:38.877 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123185 13.75 MB/sec execute 356 sec latency 1465.674 ms 2024-03-25T05:59:39.877 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123318 13.73 MB/sec execute 357 sec latency 207.373 ms 2024-03-25T05:59:40.877 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123461 13.71 MB/sec execute 358 sec latency 195.703 ms 2024-03-25T05:59:41.877 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123621 13.70 MB/sec execute 359 sec latency 277.994 ms 2024-03-25T05:59:42.877 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123768 13.68 MB/sec execute 360 sec latency 103.412 ms 2024-03-25T05:59:43.878 INFO:tasks.workunit.client.0.smithi102.stdout: 10 123937 13.66 MB/sec execute 361 sec latency 118.395 ms 2024-03-25T05:59:44.878 INFO:tasks.workunit.client.0.smithi102.stdout: 10 124094 13.64 MB/sec execute 362 sec latency 119.327 ms 2024-03-25T05:59:45.878 INFO:tasks.workunit.client.0.smithi102.stdout: 10 124273 13.63 MB/sec execute 363 sec latency 141.692 ms 2024-03-25T05:59:46.878 INFO:tasks.workunit.client.0.smithi102.stdout: 10 124671 13.63 MB/sec execute 364 sec latency 59.603 ms 2024-03-25T05:59:47.878 INFO:tasks.workunit.client.0.smithi102.stdout: 10 124948 13.64 MB/sec execute 365 sec latency 113.861 ms 2024-03-25T05:59:48.879 INFO:tasks.workunit.client.0.smithi102.stdout: 10 125307 13.65 MB/sec execute 366 sec latency 129.618 ms 2024-03-25T05:59:49.879 INFO:tasks.workunit.client.0.smithi102.stdout: 10 125687 13.68 MB/sec execute 367 sec latency 86.904 ms 2024-03-25T05:59:50.880 INFO:tasks.workunit.client.0.smithi102.stdout: 10 126114 13.72 MB/sec execute 368 sec latency 55.697 ms 2024-03-25T05:59:51.880 INFO:tasks.workunit.client.0.smithi102.stdout: 10 126444 13.72 MB/sec execute 369 sec latency 113.273 ms 2024-03-25T05:59:52.880 INFO:tasks.workunit.client.0.smithi102.stdout: 10 126693 13.74 MB/sec execute 370 sec latency 84.731 ms 2024-03-25T05:59:53.880 INFO:tasks.workunit.client.0.smithi102.stdout: 10 126902 13.73 MB/sec execute 371 sec latency 120.682 ms 2024-03-25T05:59:54.880 INFO:tasks.workunit.client.0.smithi102.stdout: 10 127112 13.73 MB/sec execute 372 sec latency 114.712 ms 2024-03-25T05:59:55.880 INFO:tasks.workunit.client.0.smithi102.stdout: 10 127343 13.73 MB/sec execute 373 sec latency 102.471 ms 2024-03-25T05:59:56.880 INFO:tasks.workunit.client.0.smithi102.stdout: 10 127495 13.70 MB/sec execute 374 sec latency 161.072 ms 2024-03-25T05:59:57.881 INFO:tasks.workunit.client.0.smithi102.stdout: 10 127722 13.68 MB/sec execute 375 sec latency 136.776 ms 2024-03-25T05:59:58.881 INFO:tasks.workunit.client.0.smithi102.stdout: 10 128019 13.67 MB/sec execute 376 sec latency 73.104 ms 2024-03-25T05:59:59.882 INFO:tasks.workunit.client.0.smithi102.stdout: 10 128305 13.68 MB/sec execute 377 sec latency 118.941 ms 2024-03-25T06:00:00.882 INFO:tasks.workunit.client.0.smithi102.stdout: 10 128585 13.68 MB/sec execute 378 sec latency 94.793 ms 2024-03-25T06:00:01.882 INFO:tasks.workunit.client.0.smithi102.stdout: 10 129037 13.71 MB/sec execute 379 sec latency 68.248 ms 2024-03-25T06:00:02.882 INFO:tasks.workunit.client.0.smithi102.stdout: 10 129398 13.75 MB/sec execute 380 sec latency 146.815 ms 2024-03-25T06:00:03.889 INFO:tasks.workunit.client.0.smithi102.stdout: 10 129812 13.77 MB/sec execute 381 sec latency 80.629 ms 2024-03-25T06:00:04.888 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130037 13.77 MB/sec execute 382 sec latency 102.398 ms 2024-03-25T06:00:05.890 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130334 13.79 MB/sec execute 383 sec latency 57.330 ms 2024-03-25T06:00:06.889 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130515 13.78 MB/sec execute 384 sec latency 112.190 ms 2024-03-25T06:00:07.892 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130637 13.76 MB/sec execute 385 sec latency 348.059 ms 2024-03-25T06:00:08.894 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130656 13.73 MB/sec execute 386 sec latency 1126.085 ms 2024-03-25T06:00:09.903 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130698 13.70 MB/sec execute 387 sec latency 1849.299 ms 2024-03-25T06:00:10.903 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130798 13.67 MB/sec execute 388 sec latency 182.621 ms 2024-03-25T06:00:11.903 INFO:tasks.workunit.client.0.smithi102.stdout: 10 130920 13.65 MB/sec execute 389 sec latency 185.327 ms 2024-03-25T06:00:12.906 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131045 13.63 MB/sec execute 390 sec latency 205.145 ms 2024-03-25T06:00:13.906 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131115 13.60 MB/sec execute 391 sec latency 582.087 ms 2024-03-25T06:00:14.906 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131135 13.57 MB/sec execute 392 sec latency 930.294 ms 2024-03-25T06:00:15.906 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131294 13.56 MB/sec execute 393 sec latency 496.584 ms 2024-03-25T06:00:16.910 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131401 13.53 MB/sec execute 394 sec latency 361.300 ms 2024-03-25T06:00:17.910 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131588 13.51 MB/sec execute 395 sec latency 123.482 ms 2024-03-25T06:00:18.910 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131789 13.49 MB/sec execute 396 sec latency 210.663 ms 2024-03-25T06:00:19.910 INFO:tasks.workunit.client.0.smithi102.stdout: 10 131991 13.48 MB/sec execute 397 sec latency 135.258 ms 2024-03-25T06:00:20.910 INFO:tasks.workunit.client.0.smithi102.stdout: 10 132401 13.51 MB/sec execute 398 sec latency 117.012 ms 2024-03-25T06:00:21.910 INFO:tasks.workunit.client.0.smithi102.stdout: 10 132703 13.52 MB/sec execute 399 sec latency 273.673 ms 2024-03-25T06:00:22.912 INFO:tasks.workunit.client.0.smithi102.stdout: 10 133053 13.55 MB/sec execute 400 sec latency 100.974 ms 2024-03-25T06:00:23.913 INFO:tasks.workunit.client.0.smithi102.stdout: 10 133401 13.56 MB/sec execute 401 sec latency 118.634 ms 2024-03-25T06:00:24.913 INFO:tasks.workunit.client.0.smithi102.stdout: 10 133663 13.58 MB/sec execute 402 sec latency 148.553 ms 2024-03-25T06:00:25.913 INFO:tasks.workunit.client.0.smithi102.stdout: 10 133851 13.58 MB/sec execute 403 sec latency 124.699 ms 2024-03-25T06:00:26.913 INFO:tasks.workunit.client.0.smithi102.stdout: 10 134032 13.57 MB/sec execute 404 sec latency 103.780 ms 2024-03-25T06:00:27.916 INFO:tasks.workunit.client.0.smithi102.stdout: 10 134180 13.55 MB/sec execute 405 sec latency 126.575 ms 2024-03-25T06:00:28.916 INFO:tasks.workunit.client.0.smithi102.stdout: 10 134353 13.54 MB/sec execute 406 sec latency 108.381 ms 2024-03-25T06:00:29.917 INFO:tasks.workunit.client.0.smithi102.stdout: 10 134577 13.53 MB/sec execute 407 sec latency 99.388 ms 2024-03-25T06:00:30.917 INFO:tasks.workunit.client.0.smithi102.stdout: 10 134866 13.53 MB/sec execute 408 sec latency 71.409 ms 2024-03-25T06:00:31.917 INFO:tasks.workunit.client.0.smithi102.stdout: 10 135197 13.52 MB/sec execute 409 sec latency 121.376 ms 2024-03-25T06:00:32.919 INFO:tasks.workunit.client.0.smithi102.stdout: 10 135523 13.53 MB/sec execute 410 sec latency 100.223 ms 2024-03-25T06:00:33.919 INFO:tasks.workunit.client.0.smithi102.stdout: 10 135917 13.55 MB/sec execute 411 sec latency 89.038 ms 2024-03-25T06:00:34.920 INFO:tasks.workunit.client.0.smithi102.stdout: 10 136217 13.55 MB/sec execute 412 sec latency 106.926 ms 2024-03-25T06:00:35.920 INFO:tasks.workunit.client.0.smithi102.stdout: 10 136578 13.58 MB/sec execute 413 sec latency 141.853 ms 2024-03-25T06:00:36.920 INFO:tasks.workunit.client.0.smithi102.stdout: 10 136902 13.60 MB/sec execute 414 sec latency 92.352 ms 2024-03-25T06:00:37.920 INFO:tasks.workunit.client.0.smithi102.stdout: 10 137171 13.61 MB/sec execute 415 sec latency 112.157 ms 2024-03-25T06:00:38.920 INFO:tasks.workunit.client.0.smithi102.stdout: 10 137370 13.60 MB/sec execute 416 sec latency 119.375 ms 2024-03-25T06:00:39.920 INFO:tasks.workunit.client.0.smithi102.stdout: 10 137553 13.60 MB/sec execute 417 sec latency 143.471 ms 2024-03-25T06:00:40.921 INFO:tasks.workunit.client.0.smithi102.stdout: 10 137726 13.59 MB/sec execute 418 sec latency 98.228 ms 2024-03-25T06:00:41.921 INFO:tasks.workunit.client.0.smithi102.stdout: 10 137889 13.57 MB/sec execute 419 sec latency 162.768 ms 2024-03-25T06:00:42.921 INFO:tasks.workunit.client.0.smithi102.stdout: 10 138073 13.56 MB/sec execute 420 sec latency 104.923 ms 2024-03-25T06:00:43.921 INFO:tasks.workunit.client.0.smithi102.stdout: 10 138318 13.55 MB/sec execute 421 sec latency 99.886 ms 2024-03-25T06:00:44.921 INFO:tasks.workunit.client.0.smithi102.stdout: 10 138491 13.53 MB/sec execute 422 sec latency 277.307 ms 2024-03-25T06:00:45.922 INFO:tasks.workunit.client.0.smithi102.stdout: 10 138813 13.53 MB/sec execute 423 sec latency 106.031 ms 2024-03-25T06:00:46.922 INFO:tasks.workunit.client.0.smithi102.stdout: 10 139179 13.54 MB/sec execute 424 sec latency 112.378 ms 2024-03-25T06:00:47.922 INFO:tasks.workunit.client.0.smithi102.stdout: 10 139590 13.56 MB/sec execute 425 sec latency 80.049 ms 2024-03-25T06:00:48.922 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140072 13.61 MB/sec execute 426 sec latency 120.462 ms 2024-03-25T06:00:49.923 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140153 13.58 MB/sec execute 427 sec latency 814.551 ms 2024-03-25T06:00:50.922 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140160 13.55 MB/sec execute 428 sec latency 1741.338 ms 2024-03-25T06:00:51.922 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140279 13.55 MB/sec execute 429 sec latency 1246.232 ms 2024-03-25T06:00:52.922 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140483 13.55 MB/sec execute 430 sec latency 139.506 ms 2024-03-25T06:00:53.931 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140606 13.53 MB/sec execute 431 sec latency 298.181 ms 2024-03-25T06:00:54.927 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140680 13.51 MB/sec execute 432 sec latency 709.490 ms 2024-03-25T06:00:55.932 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140700 13.48 MB/sec execute 433 sec latency 1624.456 ms 2024-03-25T06:00:56.933 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140770 13.45 MB/sec execute 434 sec latency 1629.789 ms 2024-03-25T06:00:57.933 INFO:tasks.workunit.client.0.smithi102.stdout: 10 140946 13.45 MB/sec execute 435 sec latency 117.664 ms 2024-03-25T06:00:58.933 INFO:tasks.workunit.client.0.smithi102.stdout: 10 141058 13.43 MB/sec execute 436 sec latency 238.202 ms 2024-03-25T06:00:59.933 INFO:tasks.workunit.client.0.smithi102.stdout: 10 141230 13.43 MB/sec execute 437 sec latency 279.236 ms 2024-03-25T06:01:00.934 INFO:tasks.workunit.client.0.smithi102.stdout: 10 141414 13.42 MB/sec execute 438 sec latency 128.405 ms 2024-03-25T06:01:01.934 INFO:tasks.workunit.client.0.smithi102.stdout: 10 141547 13.40 MB/sec execute 439 sec latency 153.250 ms 2024-03-25T06:01:02.934 INFO:tasks.workunit.client.0.smithi102.stdout: 10 141708 13.39 MB/sec execute 440 sec latency 172.147 ms 2024-03-25T06:01:03.934 INFO:tasks.workunit.client.0.smithi102.stdout: 10 141928 13.37 MB/sec execute 441 sec latency 113.995 ms 2024-03-25T06:01:04.934 INFO:tasks.workunit.client.0.smithi102.stdout: 10 142290 13.38 MB/sec execute 442 sec latency 75.198 ms 2024-03-25T06:01:05.935 INFO:tasks.workunit.client.0.smithi102.stdout: 10 142581 13.38 MB/sec execute 443 sec latency 125.471 ms 2024-03-25T06:01:06.935 INFO:tasks.workunit.client.0.smithi102.stdout: 10 142952 13.39 MB/sec execute 444 sec latency 85.857 ms 2024-03-25T06:01:07.935 INFO:tasks.workunit.client.0.smithi102.stdout: 10 143336 13.41 MB/sec execute 445 sec latency 82.577 ms 2024-03-25T06:01:08.936 INFO:tasks.workunit.client.0.smithi102.stdout: 10 143784 13.45 MB/sec execute 446 sec latency 94.722 ms 2024-03-25T06:01:09.937 INFO:tasks.workunit.client.0.smithi102.stdout: 10 144162 13.48 MB/sec execute 447 sec latency 67.276 ms 2024-03-25T06:01:10.937 INFO:tasks.workunit.client.0.smithi102.stdout: 10 144385 13.48 MB/sec execute 448 sec latency 112.088 ms 2024-03-25T06:01:11.937 INFO:tasks.workunit.client.0.smithi102.stdout: 10 144655 13.48 MB/sec execute 449 sec latency 101.233 ms 2024-03-25T06:01:12.939 INFO:tasks.workunit.client.0.smithi102.stdout: 10 144886 13.48 MB/sec execute 450 sec latency 153.718 ms 2024-03-25T06:01:13.939 INFO:tasks.workunit.client.0.smithi102.stdout: 10 145208 13.47 MB/sec execute 451 sec latency 57.072 ms 2024-03-25T06:01:14.940 INFO:tasks.workunit.client.0.smithi102.stdout: 10 145429 13.47 MB/sec execute 452 sec latency 98.833 ms 2024-03-25T06:01:15.943 INFO:tasks.workunit.client.0.smithi102.stdout: 10 145794 13.47 MB/sec execute 453 sec latency 84.271 ms 2024-03-25T06:01:16.944 INFO:tasks.workunit.client.0.smithi102.stdout: 10 146170 13.48 MB/sec execute 454 sec latency 85.585 ms 2024-03-25T06:01:17.944 INFO:tasks.workunit.client.0.smithi102.stdout: 10 146621 13.50 MB/sec execute 455 sec latency 88.862 ms 2024-03-25T06:01:18.944 INFO:tasks.workunit.client.0.smithi102.stdout: 10 147087 13.54 MB/sec execute 456 sec latency 92.209 ms 2024-03-25T06:01:19.945 INFO:tasks.workunit.client.0.smithi102.stdout: 10 147478 13.56 MB/sec execute 457 sec latency 81.429 ms 2024-03-25T06:01:20.945 INFO:tasks.workunit.client.0.smithi102.stdout: 10 147836 13.58 MB/sec execute 458 sec latency 89.013 ms 2024-03-25T06:01:21.945 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148026 13.58 MB/sec execute 459 sec latency 97.210 ms 2024-03-25T06:01:22.945 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148264 13.59 MB/sec execute 460 sec latency 86.001 ms 2024-03-25T06:01:23.947 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148453 13.57 MB/sec execute 461 sec latency 106.550 ms 2024-03-25T06:01:24.945 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148664 13.56 MB/sec execute 462 sec latency 359.433 ms 2024-03-25T06:01:25.945 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148757 13.54 MB/sec execute 463 sec latency 459.369 ms 2024-03-25T06:01:26.945 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148767 13.51 MB/sec execute 464 sec latency 1453.544 ms 2024-03-25T06:01:27.946 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148776 13.48 MB/sec execute 465 sec latency 2196.628 ms 2024-03-25T06:01:28.946 INFO:tasks.workunit.client.0.smithi102.stdout: 10 148863 13.46 MB/sec execute 466 sec latency 1288.790 ms 2024-03-25T06:01:29.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:01:29.143 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:01:29.948 INFO:tasks.workunit.client.0.smithi102.stdout: 10 149032 13.45 MB/sec execute 467 sec latency 142.769 ms 2024-03-25T06:01:30.948 INFO:tasks.workunit.client.0.smithi102.stdout: 10 149268 13.44 MB/sec execute 468 sec latency 90.422 ms 2024-03-25T06:01:31.948 INFO:tasks.workunit.client.0.smithi102.stdout: 10 149517 13.44 MB/sec execute 469 sec latency 121.716 ms 2024-03-25T06:01:32.948 INFO:tasks.workunit.client.0.smithi102.stdout: 10 149731 13.43 MB/sec execute 470 sec latency 112.869 ms 2024-03-25T06:01:33.948 INFO:tasks.workunit.client.0.smithi102.stdout: 10 150072 13.44 MB/sec execute 471 sec latency 111.590 ms 2024-03-25T06:01:34.948 INFO:tasks.workunit.client.0.smithi102.stdout: 10 150304 13.44 MB/sec execute 472 sec latency 105.623 ms 2024-03-25T06:01:35.949 INFO:tasks.workunit.client.0.smithi102.stdout: 10 150561 13.44 MB/sec execute 473 sec latency 138.231 ms 2024-03-25T06:01:36.952 INFO:tasks.workunit.client.0.smithi102.stdout: 10 151027 13.48 MB/sec execute 474 sec latency 82.172 ms 2024-03-25T06:01:37.952 INFO:tasks.workunit.client.0.smithi102.stdout: 10 151412 13.51 MB/sec execute 475 sec latency 67.363 ms 2024-03-25T06:01:38.952 INFO:tasks.workunit.client.0.smithi102.stdout: 10 151648 13.51 MB/sec execute 476 sec latency 113.177 ms 2024-03-25T06:01:39.953 INFO:tasks.workunit.client.0.smithi102.stdout: 10 151832 13.51 MB/sec execute 477 sec latency 180.744 ms 2024-03-25T06:01:40.953 INFO:tasks.workunit.client.0.smithi102.stdout: 10 152039 13.49 MB/sec execute 478 sec latency 122.848 ms 2024-03-25T06:01:41.953 INFO:tasks.workunit.client.0.smithi102.stdout: 10 152144 13.47 MB/sec execute 479 sec latency 488.243 ms 2024-03-25T06:01:42.953 INFO:tasks.workunit.client.0.smithi102.stdout: 10 152206 13.45 MB/sec execute 480 sec latency 713.551 ms 2024-03-25T06:01:43.953 INFO:tasks.workunit.client.0.smithi102.stdout: 10 152332 13.43 MB/sec execute 481 sec latency 151.550 ms 2024-03-25T06:01:44.953 INFO:tasks.workunit.client.0.smithi102.stdout: 10 152425 13.41 MB/sec execute 482 sec latency 327.794 ms 2024-03-25T06:01:45.953 INFO:tasks.workunit.client.0.smithi102.stdout: 10 152653 13.41 MB/sec execute 483 sec latency 117.395 ms 2024-03-25T06:01:46.954 INFO:tasks.workunit.client.0.smithi102.stdout: 10 152898 13.40 MB/sec execute 484 sec latency 264.980 ms 2024-03-25T06:01:47.954 INFO:tasks.workunit.client.0.smithi102.stdout: 10 153154 13.40 MB/sec execute 485 sec latency 114.232 ms 2024-03-25T06:01:48.954 INFO:tasks.workunit.client.0.smithi102.stdout: 10 153548 13.41 MB/sec execute 486 sec latency 93.433 ms 2024-03-25T06:01:49.955 INFO:tasks.workunit.client.0.smithi102.stdout: 10 154053 13.44 MB/sec execute 487 sec latency 45.664 ms 2024-03-25T06:01:50.954 INFO:tasks.workunit.client.0.smithi102.stdout: 10 154601 13.48 MB/sec execute 488 sec latency 49.380 ms 2024-03-25T06:01:51.955 INFO:tasks.workunit.client.0.smithi102.stdout: 10 154886 13.50 MB/sec execute 489 sec latency 83.929 ms 2024-03-25T06:01:52.954 INFO:tasks.workunit.client.0.smithi102.stdout: 10 155172 13.51 MB/sec execute 490 sec latency 82.430 ms 2024-03-25T06:01:53.954 INFO:tasks.workunit.client.0.smithi102.stdout: 10 155481 13.52 MB/sec execute 491 sec latency 67.534 ms 2024-03-25T06:01:54.958 INFO:tasks.workunit.client.0.smithi102.stdout: 10 155705 13.51 MB/sec execute 492 sec latency 108.088 ms 2024-03-25T06:01:55.958 INFO:tasks.workunit.client.0.smithi102.stdout: 10 155908 13.49 MB/sec execute 493 sec latency 96.501 ms 2024-03-25T06:01:56.958 INFO:tasks.workunit.client.0.smithi102.stdout: 10 156211 13.51 MB/sec execute 494 sec latency 92.491 ms 2024-03-25T06:01:57.959 INFO:tasks.workunit.client.0.smithi102.stdout: 10 156555 13.50 MB/sec execute 495 sec latency 102.716 ms 2024-03-25T06:01:58.959 INFO:tasks.workunit.client.0.smithi102.stdout: 10 156947 13.50 MB/sec execute 496 sec latency 97.924 ms 2024-03-25T06:01:59.303 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:01:59.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:01:59.959 INFO:tasks.workunit.client.0.smithi102.stdout: 10 157387 13.53 MB/sec execute 497 sec latency 65.656 ms 2024-03-25T06:02:00.959 INFO:tasks.workunit.client.0.smithi102.stdout: 10 157926 13.58 MB/sec execute 498 sec latency 47.279 ms 2024-03-25T06:02:01.959 INFO:tasks.workunit.client.0.smithi102.stdout: 10 158326 13.60 MB/sec execute 499 sec latency 73.915 ms 2024-03-25T06:02:02.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 158524 13.59 MB/sec execute 500 sec latency 93.471 ms 2024-03-25T06:02:03.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 158781 13.61 MB/sec execute 501 sec latency 111.453 ms 2024-03-25T06:02:04.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 159003 13.60 MB/sec execute 502 sec latency 98.347 ms 2024-03-25T06:02:05.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 159181 13.59 MB/sec execute 503 sec latency 120.359 ms 2024-03-25T06:02:06.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 159464 13.58 MB/sec execute 504 sec latency 89.669 ms 2024-03-25T06:02:07.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 159832 13.59 MB/sec execute 505 sec latency 70.562 ms 2024-03-25T06:02:08.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 160215 13.59 MB/sec execute 506 sec latency 96.645 ms 2024-03-25T06:02:09.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 160560 13.60 MB/sec execute 507 sec latency 103.787 ms 2024-03-25T06:02:10.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 160947 13.63 MB/sec execute 508 sec latency 86.092 ms 2024-03-25T06:02:11.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 161407 13.66 MB/sec execute 509 sec latency 80.665 ms 2024-03-25T06:02:12.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 161707 13.66 MB/sec execute 510 sec latency 78.944 ms 2024-03-25T06:02:13.960 INFO:tasks.workunit.client.0.smithi102.stdout: 10 161981 13.66 MB/sec execute 511 sec latency 102.821 ms 2024-03-25T06:02:14.961 INFO:tasks.workunit.client.0.smithi102.stdout: 10 162229 13.66 MB/sec execute 512 sec latency 92.368 ms 2024-03-25T06:02:15.961 INFO:tasks.workunit.client.0.smithi102.stdout: 10 162524 13.67 MB/sec execute 513 sec latency 98.580 ms 2024-03-25T06:02:16.961 INFO:tasks.workunit.client.0.smithi102.stdout: 10 162786 13.67 MB/sec execute 514 sec latency 104.673 ms 2024-03-25T06:02:17.961 INFO:tasks.workunit.client.0.smithi102.stdout: 10 162966 13.66 MB/sec execute 515 sec latency 390.306 ms 2024-03-25T06:02:18.961 INFO:tasks.workunit.client.0.smithi102.stdout: 10 163228 13.66 MB/sec execute 516 sec latency 73.038 ms 2024-03-25T06:02:19.961 INFO:tasks.workunit.client.0.smithi102.stdout: 10 163433 13.65 MB/sec execute 517 sec latency 337.385 ms 2024-03-25T06:02:20.964 INFO:tasks.workunit.client.0.smithi102.stdout: 10 163876 13.66 MB/sec execute 518 sec latency 62.937 ms 2024-03-25T06:02:21.964 INFO:tasks.workunit.client.0.smithi102.stdout: 10 164179 13.66 MB/sec execute 519 sec latency 73.212 ms 2024-03-25T06:02:22.965 INFO:tasks.workunit.client.0.smithi102.stdout: 10 164342 13.66 MB/sec execute 520 sec latency 674.966 ms 2024-03-25T06:02:23.967 INFO:tasks.workunit.client.0.smithi102.stdout: 10 164350 13.64 MB/sec execute 521 sec latency 1345.755 ms 2024-03-25T06:02:24.965 INFO:tasks.workunit.client.0.smithi102.stdout: 10 164357 13.61 MB/sec execute 522 sec latency 1551.886 ms 2024-03-25T06:02:25.965 INFO:tasks.workunit.client.0.smithi102.stdout: 10 164508 13.61 MB/sec execute 523 sec latency 1541.867 ms 2024-03-25T06:02:26.965 INFO:tasks.workunit.client.0.smithi102.stdout: 10 164788 13.61 MB/sec execute 524 sec latency 108.017 ms 2024-03-25T06:02:27.965 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165044 13.61 MB/sec execute 525 sec latency 181.281 ms 2024-03-25T06:02:28.969 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165082 13.59 MB/sec execute 526 sec latency 537.137 ms 2024-03-25T06:02:29.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:02:29.510 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:02:29.644 INFO:tasks.ceph.mds.a.smithi102.stderr:2024-03-25T06:02:29.652+0000 7f2deba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46836) UID: 0 2024-03-25T06:02:29.644 INFO:tasks.ceph.mds.c.smithi102.stderr:2024-03-25T06:02:29.653+0000 7f147b800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46836) UID: 0 2024-03-25T06:02:29.644 INFO:tasks.ceph.mds.e.smithi102.stderr:2024-03-25T06:02:29.652+0000 7f9adf000640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46836) UID: 0 2024-03-25T06:02:29.969 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165134 13.57 MB/sec execute 527 sec latency 802.476 ms 2024-03-25T06:02:30.969 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165313 13.57 MB/sec execute 528 sec latency 121.837 ms 2024-03-25T06:02:31.969 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165458 13.56 MB/sec execute 529 sec latency 133.015 ms 2024-03-25T06:02:32.971 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165619 13.54 MB/sec execute 530 sec latency 100.440 ms 2024-03-25T06:02:33.971 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165826 13.54 MB/sec execute 531 sec latency 103.722 ms 2024-03-25T06:02:34.971 INFO:tasks.workunit.client.0.smithi102.stdout: 10 165977 13.53 MB/sec execute 532 sec latency 98.271 ms 2024-03-25T06:02:35.971 INFO:tasks.workunit.client.0.smithi102.stdout: 10 166085 13.51 MB/sec execute 533 sec latency 142.540 ms 2024-03-25T06:02:36.975 INFO:tasks.workunit.client.0.smithi102.stdout: 10 166248 13.51 MB/sec execute 534 sec latency 172.561 ms 2024-03-25T06:02:37.975 INFO:tasks.workunit.client.0.smithi102.stdout: 10 166418 13.50 MB/sec execute 535 sec latency 121.841 ms 2024-03-25T06:02:38.975 INFO:tasks.workunit.client.0.smithi102.stdout: 10 166578 13.48 MB/sec execute 536 sec latency 110.921 ms 2024-03-25T06:02:39.976 INFO:tasks.workunit.client.0.smithi102.stdout: 10 166833 13.49 MB/sec execute 537 sec latency 130.489 ms 2024-03-25T06:02:40.976 INFO:tasks.workunit.client.0.smithi102.stdout: 10 167093 13.48 MB/sec execute 538 sec latency 100.694 ms 2024-03-25T06:02:41.976 INFO:tasks.workunit.client.0.smithi102.stdout: 10 167403 13.49 MB/sec execute 539 sec latency 107.920 ms 2024-03-25T06:02:42.976 INFO:tasks.workunit.client.0.smithi102.stdout: 10 167678 13.48 MB/sec execute 540 sec latency 80.696 ms 2024-03-25T06:02:43.976 INFO:tasks.workunit.client.0.smithi102.stdout: 10 168024 13.51 MB/sec execute 541 sec latency 82.390 ms 2024-03-25T06:02:44.977 INFO:tasks.workunit.client.0.smithi102.stdout: 10 168365 13.51 MB/sec execute 542 sec latency 157.403 ms 2024-03-25T06:02:45.979 INFO:tasks.workunit.client.0.smithi102.stdout: 10 168672 13.52 MB/sec execute 543 sec latency 97.602 ms 2024-03-25T06:02:46.979 INFO:tasks.workunit.client.0.smithi102.stdout: 10 168916 13.52 MB/sec execute 544 sec latency 89.071 ms 2024-03-25T06:02:47.979 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169170 13.53 MB/sec execute 545 sec latency 117.489 ms 2024-03-25T06:02:48.981 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169261 13.51 MB/sec execute 546 sec latency 609.833 ms 2024-03-25T06:02:49.980 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169316 13.49 MB/sec execute 547 sec latency 1116.988 ms 2024-03-25T06:02:50.980 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169529 13.48 MB/sec execute 548 sec latency 101.236 ms 2024-03-25T06:02:51.982 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169649 13.47 MB/sec execute 549 sec latency 129.451 ms 2024-03-25T06:02:52.985 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169813 13.46 MB/sec execute 550 sec latency 133.405 ms 2024-03-25T06:02:53.985 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169932 13.44 MB/sec execute 551 sec latency 542.174 ms 2024-03-25T06:02:54.986 INFO:tasks.workunit.client.0.smithi102.stdout: 10 169973 13.43 MB/sec execute 552 sec latency 1019.365 ms 2024-03-25T06:02:55.987 INFO:tasks.workunit.client.0.smithi102.stdout: 10 170143 13.41 MB/sec execute 553 sec latency 155.620 ms 2024-03-25T06:02:56.986 INFO:tasks.workunit.client.0.smithi102.stdout: 10 170312 13.41 MB/sec execute 554 sec latency 190.766 ms 2024-03-25T06:02:57.986 INFO:tasks.workunit.client.0.smithi102.stdout: 10 170521 13.41 MB/sec execute 555 sec latency 184.524 ms 2024-03-25T06:02:58.986 INFO:tasks.workunit.client.0.smithi102.stdout: 10 170852 13.40 MB/sec execute 556 sec latency 89.867 ms 2024-03-25T06:02:59.986 INFO:tasks.workunit.client.0.smithi102.stdout: 10 171166 13.41 MB/sec execute 557 sec latency 75.827 ms 2024-03-25T06:03:00.987 INFO:tasks.workunit.client.0.smithi102.stdout: 10 171551 13.43 MB/sec execute 558 sec latency 85.948 ms 2024-03-25T06:03:01.987 INFO:tasks.workunit.client.0.smithi102.stdout: 10 171854 13.43 MB/sec execute 559 sec latency 121.845 ms 2024-03-25T06:03:02.987 INFO:tasks.workunit.client.0.smithi102.stdout: 10 172177 13.45 MB/sec execute 560 sec latency 87.637 ms 2024-03-25T06:03:03.988 INFO:tasks.workunit.client.0.smithi102.stdout: 10 172408 13.45 MB/sec execute 561 sec latency 110.855 ms 2024-03-25T06:03:04.990 INFO:tasks.workunit.client.0.smithi102.stdout: 10 172736 13.46 MB/sec execute 562 sec latency 82.286 ms 2024-03-25T06:03:05.991 INFO:tasks.workunit.client.0.smithi102.stdout: 10 172902 13.46 MB/sec execute 563 sec latency 331.414 ms 2024-03-25T06:03:06.991 INFO:tasks.workunit.client.0.smithi102.stdout: 10 173183 13.45 MB/sec execute 564 sec latency 82.069 ms 2024-03-25T06:03:07.991 INFO:tasks.workunit.client.0.smithi102.stdout: 10 173367 13.44 MB/sec execute 565 sec latency 100.850 ms 2024-03-25T06:03:08.992 INFO:tasks.workunit.client.0.smithi102.stdout: 10 173572 13.44 MB/sec execute 566 sec latency 202.626 ms 2024-03-25T06:03:09.993 INFO:tasks.workunit.client.0.smithi102.stdout: 10 173579 13.41 MB/sec execute 567 sec latency 1035.031 ms 2024-03-25T06:03:10.993 INFO:tasks.workunit.client.0.smithi102.stdout: 10 173635 13.39 MB/sec execute 568 sec latency 1140.773 ms 2024-03-25T06:03:11.994 INFO:tasks.workunit.client.0.smithi102.stdout: 10 173813 13.39 MB/sec execute 569 sec latency 183.511 ms 2024-03-25T06:03:12.994 INFO:tasks.workunit.client.0.smithi102.stdout: 10 174024 13.38 MB/sec execute 570 sec latency 144.633 ms 2024-03-25T06:03:13.995 INFO:tasks.workunit.client.0.smithi102.stdout: 10 174189 13.37 MB/sec execute 571 sec latency 117.558 ms 2024-03-25T06:03:14.995 INFO:tasks.workunit.client.0.smithi102.stdout: 10 174293 13.35 MB/sec execute 572 sec latency 610.817 ms 2024-03-25T06:03:15.995 INFO:tasks.workunit.client.0.smithi102.stdout: 10 174529 13.35 MB/sec execute 573 sec latency 109.229 ms 2024-03-25T06:03:16.996 INFO:tasks.workunit.client.0.smithi102.stdout: 10 174755 13.35 MB/sec execute 574 sec latency 111.591 ms 2024-03-25T06:03:17.996 INFO:tasks.workunit.client.0.smithi102.stdout: 10 175188 13.37 MB/sec execute 575 sec latency 58.563 ms 2024-03-25T06:03:18.996 INFO:tasks.workunit.client.0.smithi102.stdout: 10 175597 13.39 MB/sec execute 576 sec latency 55.575 ms 2024-03-25T06:03:19.996 INFO:tasks.workunit.client.0.smithi102.stdout: 10 175803 13.39 MB/sec execute 577 sec latency 177.078 ms 2024-03-25T06:03:20.997 INFO:tasks.workunit.client.0.smithi102.stdout: 10 175962 13.38 MB/sec execute 578 sec latency 138.383 ms 2024-03-25T06:03:21.997 INFO:tasks.workunit.client.0.smithi102.stdout: 10 176189 13.39 MB/sec execute 579 sec latency 139.509 ms 2024-03-25T06:03:22.997 INFO:tasks.workunit.client.0.smithi102.stdout: 10 176464 13.40 MB/sec execute 580 sec latency 69.547 ms 2024-03-25T06:03:23.997 INFO:tasks.workunit.client.0.smithi102.stdout: 10 176596 13.38 MB/sec execute 581 sec latency 186.239 ms 2024-03-25T06:03:24.999 INFO:tasks.workunit.client.0.smithi102.stdout: 10 176811 13.37 MB/sec execute 582 sec latency 110.525 ms 2024-03-25T06:03:25.999 INFO:tasks.workunit.client.0.smithi102.stdout: 10 177010 13.36 MB/sec execute 583 sec latency 112.436 ms 2024-03-25T06:03:26.999 INFO:tasks.workunit.client.0.smithi102.stdout: 10 177275 13.36 MB/sec execute 584 sec latency 105.114 ms 2024-03-25T06:03:27.999 INFO:tasks.workunit.client.0.smithi102.stdout: 10 177540 13.36 MB/sec execute 585 sec latency 112.528 ms 2024-03-25T06:03:28.999 INFO:tasks.workunit.client.0.smithi102.stdout: 10 177885 13.36 MB/sec execute 586 sec latency 80.026 ms 2024-03-25T06:03:30.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 178257 13.38 MB/sec execute 587 sec latency 77.239 ms 2024-03-25T06:03:31.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 178605 13.39 MB/sec execute 588 sec latency 102.934 ms 2024-03-25T06:03:32.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 178992 13.40 MB/sec execute 589 sec latency 93.677 ms 2024-03-25T06:03:33.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 179324 13.42 MB/sec execute 590 sec latency 73.492 ms 2024-03-25T06:03:34.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 179537 13.42 MB/sec execute 591 sec latency 110.373 ms 2024-03-25T06:03:35.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 179793 13.42 MB/sec execute 592 sec latency 81.243 ms 2024-03-25T06:03:36.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 180046 13.42 MB/sec execute 593 sec latency 80.785 ms 2024-03-25T06:03:37.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 180226 13.42 MB/sec execute 594 sec latency 119.143 ms 2024-03-25T06:03:38.000 INFO:tasks.workunit.client.0.smithi102.stdout: 10 180489 13.40 MB/sec execute 595 sec latency 82.429 ms 2024-03-25T06:03:39.001 INFO:tasks.workunit.client.0.smithi102.stdout: 10 180789 13.40 MB/sec execute 596 sec latency 63.786 ms 2024-03-25T06:03:40.002 INFO:tasks.workunit.client.0.smithi102.stdout: 10 181018 13.41 MB/sec execute 597 sec latency 438.535 ms 2024-03-25T06:03:41.002 INFO:tasks.workunit.client.0.smithi102.stdout: 10 181046 13.39 MB/sec execute 598 sec latency 772.722 ms 2024-03-25T06:03:42.002 INFO:tasks.workunit.client.0.smithi102.stdout: 10 181238 13.37 MB/sec execute 599 sec latency 532.731 ms 2024-03-25T06:03:43.003 INFO:tasks.workunit.client.0.smithi102.stdout: 10 cleanup 600 sec 2024-03-25T06:03:44.004 INFO:tasks.workunit.client.0.smithi102.stdout: 10 cleanup 601 sec 2024-03-25T06:03:45.004 INFO:tasks.workunit.client.0.smithi102.stdout: 10 cleanup 602 sec 2024-03-25T06:03:46.004 INFO:tasks.workunit.client.0.smithi102.stdout: 10 cleanup 603 sec 2024-03-25T06:03:47.007 INFO:tasks.workunit.client.0.smithi102.stdout: 9 cleanup 604 sec 2024-03-25T06:03:47.678 INFO:tasks.workunit.client.0.smithi102.stdout: 0 cleanup 605 sec 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Operation Count AvgLat MaxLat 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: ---------------------------------------- 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: NTCreateX 257467 9.295 2645.680 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Close 189177 0.006 5.253 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Rename 10924 37.755 1288.777 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Unlink 51922 15.851 1346.545 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Qpathinfo 233647 6.689 2102.785 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Qfileinfo 40778 0.003 1.685 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Qfsinfo 42747 0.618 26.241 2024-03-25T06:03:47.679 INFO:tasks.workunit.client.0.smithi102.stdout: Sfileinfo 21055 1.836 978.342 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout: Find 90244 1.467 2829.830 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout: WriteX 127318 0.330 1335.574 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout: ReadX 403756 0.078 1629.777 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout: LockX 838 12.942 306.499 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout: UnlockX 838 11.517 173.793 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout: Flush 18073 28.278 2780.857 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-03-25T06:03:47.680 INFO:tasks.workunit.client.0.smithi102.stdout:Throughput 13.3745 MB/sec 10 clients 10 procs max_latency=2829.843 ms 2024-03-25T06:03:47.681 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-25T06:03:47.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-25T06:03:49.991 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-03-25T06:03:49.992 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-25T06:03:51.978 DEBUG:teuthology.parallel:result is None 2024-03-25T06:03:51.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-25T06:03:52.205 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-25T06:03:52.205 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-25T06:03:52.215 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-25T06:03:52.215 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T06:03:52.215 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-25T06:03:53.882 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-25T06:03:53.882 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-25T06:03:53.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T06:03:56.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.122+0000 7f9bd1e00640 1 Processor -- start 2024-03-25T06:03:56.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.122+0000 7f9bd1e00640 1 -- start start 2024-03-25T06:03:56.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd1e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9bcc14e3d0 0x7f9bcc070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc0c5d40 0x7f9bcc15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd1e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc0724e0 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd1e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc072970 con 0x7f9bcc14e3d0 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd1e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0c6250 con 0x7f9bcc0c5d40 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd0a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9bcc14e3d0 0x7f9bcc070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bcbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc0c5d40 0x7f9bcc15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd0a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9bcc14e3d0 0x7f9bcc070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37002/0 (socket says 172.21.15.102:37002) 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bd0a00640 1 -- 172.21.15.102:0/1450203371 learned_addr learned my addr 172.21.15.102:0/1450203371 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.124+0000 7f9bcbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc0c5d40 0x7f9bcc15afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38060/0 (socket says 172.21.15.102:38060) 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.125+0000 7f9bd0a00640 1 -- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc0c5d40 msgr2=0x7f9bcc15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.125+0000 7f9bd0a00640 1 --2- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc0c5d40 0x7f9bcc15afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.125+0000 7f9bd0a00640 1 -- 172.21.15.102:0/1450203371 >> v1:172.21.15.102:6789/0 conn(0x7f9bcc15b4e0 legacy=0x7f9bcc0c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.125+0000 7f9bd0a00640 1 -- 172.21.15.102:0/1450203371 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc06f170 con 0x7f9bcc14e3d0 2024-03-25T06:03:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.125+0000 7f9bcbe00640 1 --2- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc0c5d40 0x7f9bcc15afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:03:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.126+0000 7f9bd0a00640 1 --2- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc14e3d0 0x7f9bcc070de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009870 tx=0x7f9bc002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d556db8d1d780914 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.126+0000 7f9bcb400640 1 -- 172.21.15.102:0/1450203371 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0030840 con 0x7f9bcc14e3d0 2024-03-25T06:03:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.126+0000 7f9bcb400640 1 -- 172.21.15.102:0/1450203371 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc00309a0 con 0x7f9bcc14e3d0 2024-03-25T06:03:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.126+0000 7f9bcb400640 1 -- 172.21.15.102:0/1450203371 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0030d30 con 0x7f9bcc14e3d0 2024-03-25T06:03:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.127+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc14e3d0 msgr2=0x7f9bcc070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.127+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc14e3d0 0x7f9bcc070de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009870 tx=0x7f9bc002b980 comp rx=0 tx=0).stop 2024-03-25T06:03:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.127+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1450203371 shutdown_connections 2024-03-25T06:03:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.127+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc0c5d40 0x7f9bcc15afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.127+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1450203371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc14e3d0 0x7f9bcc070de0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.127+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1450203371 >> 172.21.15.102:0/1450203371 conn(0x7f9bcc0cb340 msgr2=0x7f9bcc0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.127+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1450203371 shutdown_connections 2024-03-25T06:03:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.128+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1450203371 wait complete. 2024-03-25T06:03:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.130+0000 7f9bd1e00640 1 Processor -- start 2024-03-25T06:03:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.130+0000 7f9bd1e00640 1 -- start start 2024-03-25T06:03:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.131+0000 7f9bd1e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bcc0c5d40 0x7f9bcc159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.131+0000 7f9bd1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc14e3d0 0x7f9bcc1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.131+0000 7f9bd1e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc15b4e0 0x7f9bcc1429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.131+0000 7f9bd1e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc158b70 con 0x7f9bcc0c5d40 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.131+0000 7f9bd1e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc1442c0 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.131+0000 7f9bd1e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc142f10 con 0x7f9bcc14e3d0 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc15b4e0 0x7f9bcc1429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd0a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bcc0c5d40 0x7f9bcc159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc15b4e0 0x7f9bcc1429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37018/0 (socket says 172.21.15.102:37018) 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 -- 172.21.15.102:0/1796853437 learned_addr learned my addr 172.21.15.102:0/1796853437 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bcbe00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc14e3d0 0x7f9bcc1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 -- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc14e3d0 msgr2=0x7f9bcc1592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc14e3d0 0x7f9bcc1592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 -- 172.21.15.102:0/1796853437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bcc0c5d40 msgr2=0x7f9bcc159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bcc0c5d40 0x7f9bcc159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd1400640 1 -- 172.21.15.102:0/1796853437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8009400 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.132+0000 7f9bd0a00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bcc0c5d40 0x7f9bcc159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:03:56.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.133+0000 7f9bd1400640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc15b4e0 0x7f9bcc1429d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400c7d0 tx=0x7f9bc400cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:56.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.133+0000 7f9bc8c00640 1 -- 172.21.15.102:0/1796853437 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4003b70 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.133+0000 7f9bc8c00640 1 -- 172.21.15.102:0/1796853437 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4003cf0 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.133+0000 7f9bc8c00640 1 -- 172.21.15.102:0/1796853437 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400aa90 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.133+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc00094d0 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.133+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc144b00 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.134+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc04f2f0 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.137+0000 7f9bc8c00640 1 -- 172.21.15.102:0/1796853437 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9bc400abf0 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.138+0000 7f9bc8c00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9bac06b810 0x7f9bac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.138+0000 7f9bc8c00640 1 -- 172.21.15.102:0/1796853437 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f9bc408ada0 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.138+0000 7f9bd0a00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9bac06b810 0x7f9bac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.139+0000 7f9bd0a00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9bac06b810 0x7f9bac06dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0036000 tx=0x7f9bc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:56.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.140+0000 7f9bc8c00640 1 -- 172.21.15.102:0/1796853437 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9bc4055410 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.389+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bcc159950 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.390+0000 7f9bc8c00640 1 -- 172.21.15.102:0/1796853437 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19031 (secure 0 0 0) 0x7f9bc4003e60 con 0x7f9bcc15b4e0 2024-03-25T06:03:56.384 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:03:56.384 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":27,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:38:20.630095+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9bac06b810 msgr2=0x7f9bac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9bac06b810 0x7f9bac06dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0036000 tx=0x7f9bc0008030 comp rx=0 tx=0).stop 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc15b4e0 msgr2=0x7f9bcc1429d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc15b4e0 0x7f9bcc1429d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400c7d0 tx=0x7f9bc400cc90 comp rx=0 tx=0).stop 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 shutdown_connections 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9bac06b810 0x7f9bac06dcd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bcc15b4e0 0x7f9bcc1429d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bcc14e3d0 0x7f9bcc1592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 --2- 172.21.15.102:0/1796853437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bcc0c5d40 0x7f9bcc159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 >> 172.21.15.102:0/1796853437 conn(0x7f9bcc0cb340 msgr2=0x7f9bcc148b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 shutdown_connections 2024-03-25T06:03:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.393+0000 7f9bd1e00640 1 -- 172.21.15.102:0/1796853437 wait complete. 2024-03-25T06:03:56.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-25T05:37:25.079908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-25T05:37:29.008596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-25T05:37:29.891587+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-25T05:37:33.466049+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-25T06:03:56.405 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-25T06:03:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.609+0000 7f08dea00640 1 Processor -- start 2024-03-25T06:03:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.609+0000 7f08dea00640 1 -- start start 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.610+0000 7f08dea00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f08d80c7070 0x7f08d80c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.610+0000 7f08dea00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d80c8070 con 0x7f08d80c7c50 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.610+0000 7f08dea00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d80c8300 con 0x7f08d8158330 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.610+0000 7f08dea00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d815e150 con 0x7f08d80c7070 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.610+0000 7f08dcc00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f08d80c7c50 0x7f08d80c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47384/0 (socket says 172.21.15.102:47384) 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.611+0000 7f08dcc00640 1 -- 172.21.15.102:0/2086532622 learned_addr learned my addr 172.21.15.102:0/2086532622 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.611+0000 7f08de000640 1 --2- 172.21.15.102:0/2086532622 >> v2:172.21.15.187:3300/0 conn(0x7f08d80c7070 0x7f08d80c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.611+0000 7f08d7e00640 1 -- 172.21.15.102:0/2086532622 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154457346 0 0) 0x7f08d80c8300 con 0x7f08d8158330 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.611+0000 7f08d7e00640 1 -- 172.21.15.102:0/2086532622 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c0003520 con 0x7f08d8158330 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.611+0000 7f08de000640 1 -- 172.21.15.102:0/2086532622 >> v1:172.21.15.187:6789/0 conn(0x7f08d8158330 legacy=0x7f08d81615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.611+0000 7f08de000640 1 -- 172.21.15.102:0/2086532622 >> v1:172.21.15.102:6789/0 conn(0x7f08d80c7c50 legacy=0x7f08d80c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.611+0000 7f08de000640 1 -- 172.21.15.102:0/2086532622 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d815e430 con 0x7f08d80c7070 2024-03-25T06:03:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.612+0000 7f08de000640 1 --2- 172.21.15.102:0/2086532622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7070 0x7f08d80c74e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009d90 tx=0x7f08d002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6129a5b165d52412 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.612+0000 7f08d7e00640 1 -- 172.21.15.102:0/2086532622 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d002cd80 con 0x7f08d80c7070 2024-03-25T06:03:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08d7e00640 1 -- 172.21.15.102:0/2086532622 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0034440 con 0x7f08d80c7070 2024-03-25T06:03:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08d7e00640 1 -- 172.21.15.102:0/2086532622 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00347d0 con 0x7f08d80c7070 2024-03-25T06:03:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08dea00640 1 -- 172.21.15.102:0/2086532622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7070 msgr2=0x7f08d80c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08dea00640 1 --2- 172.21.15.102:0/2086532622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7070 0x7f08d80c74e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009d90 tx=0x7f08d002bfd0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08dea00640 1 -- 172.21.15.102:0/2086532622 shutdown_connections 2024-03-25T06:03:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08dea00640 1 --2- 172.21.15.102:0/2086532622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7070 0x7f08d80c74e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08dea00640 1 -- 172.21.15.102:0/2086532622 >> 172.21.15.102:0/2086532622 conn(0x7f08d806afb0 msgr2=0x7f08d806b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08dea00640 1 -- 172.21.15.102:0/2086532622 shutdown_connections 2024-03-25T06:03:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.613+0000 7f08dea00640 1 -- 172.21.15.102:0/2086532622 wait complete. 2024-03-25T06:03:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.615+0000 7f08dea00640 1 Processor -- start 2024-03-25T06:03:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.615+0000 7f08dea00640 1 -- start start 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d80c7070 0x7f08d8152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7c50 0x7f08d8160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08d8158330 0x7f08d8160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dea00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d8158fe0 con 0x7f08d80c7070 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dea00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d81f4a30 con 0x7f08d80c7c50 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d8158710 con 0x7f08d8158330 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dcc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7c50 0x7f08d8160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08dd600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d80c7070 0x7f08d8152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08de000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08d8158330 0x7f08d8160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08de000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08d8158330 0x7f08d8160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38068/0 (socket says 172.21.15.102:38068) 2024-03-25T06:03:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.616+0000 7f08de000640 1 -- 172.21.15.102:0/3972719144 learned_addr learned my addr 172.21.15.102:0/3972719144 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.617+0000 7f08de000640 1 -- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7c50 msgr2=0x7f08d8160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.617+0000 7f08de000640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7c50 0x7f08d8160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.617+0000 7f08de000640 1 -- 172.21.15.102:0/3972719144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d80c7070 msgr2=0x7f08d8152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.617+0000 7f08de000640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d80c7070 0x7f08d8152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.617+0000 7f08de000640 1 -- 172.21.15.102:0/3972719144 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0009a70 con 0x7f08d8158330 2024-03-25T06:03:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.617+0000 7f08dd600640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d80c7070 0x7f08d8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:03:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.617+0000 7f08de000640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08d8158330 0x7f08d8160a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009d90 tx=0x7f08d0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.618+0000 7f08d5600640 1 -- 172.21.15.102:0/3972719144 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0040650 con 0x7f08d8158330 2024-03-25T06:03:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.618+0000 7f08d5600640 1 -- 172.21.15.102:0/3972719144 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d00407b0 con 0x7f08d8158330 2024-03-25T06:03:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.618+0000 7f08d5600640 1 -- 172.21.15.102:0/3972719144 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0040b60 con 0x7f08d8158330 2024-03-25T06:03:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.618+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d8158940 con 0x7f08d8158330 2024-03-25T06:03:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.618+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d81f4750 con 0x7f08d8158330 2024-03-25T06:03:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.619+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d804f2f0 con 0x7f08d8158330 2024-03-25T06:03:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.620+0000 7f08d5600640 1 -- 172.21.15.102:0/3972719144 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08d0040cc0 con 0x7f08d8158330 2024-03-25T06:03:56.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.621+0000 7f08d5600640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f08b806b840 0x7f08b806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:56.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.621+0000 7f08d5600640 1 -- 172.21.15.102:0/3972719144 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f08d00ad350 con 0x7f08d8158330 2024-03-25T06:03:56.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.621+0000 7f08dd600640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f08b806b840 0x7f08b806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:56.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.622+0000 7f08dd600640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f08b806b840 0x7f08b806dd00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08cc007fd0 tx=0x7f08cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:56.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.630+0000 7f08d5600640 1 -- 172.21.15.102:0/3972719144 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f08d00779d0 con 0x7f08d8158330 2024-03-25T06:03:56.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.840+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08d80c6970 con 0x7f08d8158330 2024-03-25T06:03:56.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.840+0000 7f08d5600640 1 -- 172.21.15.102:0/3972719144 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08d0009450 con 0x7f08d8158330 2024-03-25T06:03:56.836 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-03-25T06:03:56.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f08b806b840 msgr2=0x7f08b806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f08b806b840 0x7f08b806dd00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08cc007fd0 tx=0x7f08cc009040 comp rx=0 tx=0).stop 2024-03-25T06:03:56.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08d8158330 msgr2=0x7f08d8160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:56.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08d8158330 0x7f08d8160a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009d90 tx=0x7f08d0004a40 comp rx=0 tx=0).stop 2024-03-25T06:03:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 shutdown_connections 2024-03-25T06:03:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f08b806b840 0x7f08b806dd00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08d8158330 0x7f08d8160a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08d80c7c50 0x7f08d8160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 --2- 172.21.15.102:0/3972719144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d80c7070 0x7f08d8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 >> 172.21.15.102:0/3972719144 conn(0x7f08d806afb0 msgr2=0x7f08d80c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 shutdown_connections 2024-03-25T06:03:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:56.843+0000 7f08dea00640 1 -- 172.21.15.102:0/3972719144 wait complete. 2024-03-25T06:03:56.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-25T06:03:57.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.029+0000 7fab06c00640 1 Processor -- start 2024-03-25T06:03:57.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.029+0000 7fab06c00640 1 -- start start 2024-03-25T06:03:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.030+0000 7fab06c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab00154260 0x7fab000cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.030+0000 7fab06c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fab000cb620 0x7fab000c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.030+0000 7fab06c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab000c8220 con 0x7fab00153e80 2024-03-25T06:03:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.030+0000 7fab06c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000c8500 con 0x7fab000cb620 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.030+0000 7fab06c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000ca320 con 0x7fab00154260 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.031+0000 7fab04e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab00154260 0x7fab000cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.031+0000 7fab04e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab00154260 0x7fab000cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38074/0 (socket says 172.21.15.102:38074) 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.031+0000 7fab04e00640 1 -- 172.21.15.102:0/3164165982 learned_addr learned my addr 172.21.15.102:0/3164165982 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.031+0000 7fab06200640 1 --2- 172.21.15.102:0/3164165982 >> v2:172.21.15.102:3300/0 conn(0x7fab000cb620 0x7fab000c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.031+0000 7fab04e00640 1 -- 172.21.15.102:0/3164165982 >> v2:172.21.15.102:3300/0 conn(0x7fab000cb620 msgr2=0x7fab000c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.031+0000 7fab04e00640 1 --2- 172.21.15.102:0/3164165982 >> v2:172.21.15.102:3300/0 conn(0x7fab000cb620 0x7fab000c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.031+0000 7fab04e00640 1 -- 172.21.15.102:0/3164165982 >> v1:172.21.15.102:6789/0 conn(0x7fab00153e80 legacy=0x7fab000c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:03:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.032+0000 7fab04e00640 1 -- 172.21.15.102:0/3164165982 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000ca600 con 0x7fab00154260 2024-03-25T06:03:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.033+0000 7fab04e00640 1 --2- 172.21.15.102:0/3164165982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab00154260 0x7fab000cb0e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faaec009870 tx=0x7faaec02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65e92988c5a88bbc server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.033+0000 7faaffe00640 1 -- 172.21.15.102:0/3164165982 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec030840 con 0x7fab00154260 2024-03-25T06:03:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.033+0000 7faaffe00640 1 -- 172.21.15.102:0/3164165982 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec0309a0 con 0x7fab00154260 2024-03-25T06:03:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.033+0000 7faaffe00640 1 -- 172.21.15.102:0/3164165982 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec030d30 con 0x7fab00154260 2024-03-25T06:03:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 -- 172.21.15.102:0/3164165982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab00154260 msgr2=0x7fab000cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 --2- 172.21.15.102:0/3164165982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab00154260 0x7fab000cb0e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faaec009870 tx=0x7faaec02b980 comp rx=0 tx=0).stop 2024-03-25T06:03:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 -- 172.21.15.102:0/3164165982 shutdown_connections 2024-03-25T06:03:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 --2- 172.21.15.102:0/3164165982 >> v2:172.21.15.102:3300/0 conn(0x7fab000cb620 0x7fab000c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 --2- 172.21.15.102:0/3164165982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab00154260 0x7fab000cb0e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 -- 172.21.15.102:0/3164165982 >> 172.21.15.102:0/3164165982 conn(0x7fab000cf370 msgr2=0x7fab000cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 -- 172.21.15.102:0/3164165982 shutdown_connections 2024-03-25T06:03:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.034+0000 7fab06c00640 1 -- 172.21.15.102:0/3164165982 wait complete. 2024-03-25T06:03:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.037+0000 7fab06c00640 1 Processor -- start 2024-03-25T06:03:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.037+0000 7fab06c00640 1 -- start start 2024-03-25T06:03:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.038+0000 7fab06c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab000cb620 0x7fab0014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.038+0000 7fab06c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab00153e80 0x7fab000c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.038+0000 7fab06c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab000c5e70 0x7fab001f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.038+0000 7fab06c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab001f0c30 con 0x7fab00153e80 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.038+0000 7fab06c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab001ef7c0 con 0x7fab000c5e70 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.038+0000 7fab06c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab001ef9b0 con 0x7fab000cb620 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab000cb620 0x7fab0014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab06200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab000c5e70 0x7fab001f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab000cb620 0x7fab0014a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38090/0 (socket says 172.21.15.102:38090) 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 -- 172.21.15.102:0/4192306852 learned_addr learned my addr 172.21.15.102:0/4192306852 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab04e00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab00153e80 0x7fab000c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 -- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab000c5e70 msgr2=0x7fab001f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab000c5e70 0x7fab001f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 -- 172.21.15.102:0/4192306852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab00153e80 msgr2=0x7fab000c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab00153e80 0x7fab000c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 -- 172.21.15.102:0/4192306852 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0094d0 con 0x7fab000cb620 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab06200640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab000c5e70 0x7fab001f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.039+0000 7fab05800640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab000cb620 0x7fab0014a280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c430 tx=0x7faaf400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.040+0000 7faafd600640 1 -- 172.21.15.102:0/4192306852 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4011790 con 0x7fab000cb620 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.040+0000 7faafd600640 1 -- 172.21.15.102:0/4192306852 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf40118f0 con 0x7fab000cb620 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.040+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab001efc90 con 0x7fab000cb620 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.040+0000 7faafd600640 1 -- 172.21.15.102:0/4192306852 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4011cc0 con 0x7fab000cb620 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.040+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab001f0250 con 0x7fab000cb620 2024-03-25T06:03:57.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.041+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab001f0d70 con 0x7fab000cb620 2024-03-25T06:03:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.043+0000 7faafd600640 1 -- 172.21.15.102:0/4192306852 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faaf4007020 con 0x7fab000cb620 2024-03-25T06:03:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.045+0000 7faafd600640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7faae006b810 0x7faae006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.045+0000 7faafd600640 1 -- 172.21.15.102:0/4192306852 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7faaf408ae60 con 0x7fab000cb620 2024-03-25T06:03:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.045+0000 7fab04e00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7faae006b810 0x7faae006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.045+0000 7fab04e00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7faae006b810 0x7faae006dcd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faaec036000 tx=0x7faaec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.050+0000 7faafd600640 1 -- 172.21.15.102:0/4192306852 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faaf4055440 con 0x7fab000cb620 2024-03-25T06:03:57.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.269+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab0004f2f0 con 0x7fab000cb620 2024-03-25T06:03:57.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.270+0000 7faafd600640 1 -- 172.21.15.102:0/4192306852 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7faaf4058b00 con 0x7fab000cb620 2024-03-25T06:03:57.263 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7faae006b810 msgr2=0x7faae006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7faae006b810 0x7faae006dcd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faaec036000 tx=0x7faaec008030 comp rx=0 tx=0).stop 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab000cb620 msgr2=0x7fab0014a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab000cb620 0x7fab0014a280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c430 tx=0x7faaf400c8f0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 shutdown_connections 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7faae006b810 0x7faae006dcd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab000c5e70 0x7fab001f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab00153e80 0x7fab000c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 --2- 172.21.15.102:0/4192306852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab000cb620 0x7fab0014a280 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 >> 172.21.15.102:0/4192306852 conn(0x7fab000cf370 msgr2=0x7fab00153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:57.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 shutdown_connections 2024-03-25T06:03:57.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.273+0000 7fab06c00640 1 -- 172.21.15.102:0/4192306852 wait complete. 2024-03-25T06:03:57.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-25T06:03:57.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.476+0000 7f7e2be00640 1 Processor -- start 2024-03-25T06:03:57.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.476+0000 7f7e2be00640 1 -- start start 2024-03-25T06:03:57.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.477+0000 7f7e2be00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7e2c154260 0x7f7e2c0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.477+0000 7f7e2be00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e2c0cb620 0x7f7e2c0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.477+0000 7f7e2be00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0c8220 con 0x7f7e2c153e80 2024-03-25T06:03:57.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.477+0000 7f7e2be00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c8500 con 0x7f7e2c154260 2024-03-25T06:03:57.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.477+0000 7f7e2be00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0ca320 con 0x7f7e2c0cb620 2024-03-25T06:03:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2aa00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7e2c153e80 0x7f7e2c0c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47406/0 (socket says 172.21.15.102:47406) 2024-03-25T06:03:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2aa00640 1 -- 172.21.15.102:0/125379072 learned_addr learned my addr 172.21.15.102:0/125379072 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:03:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2a000640 1 --2- 172.21.15.102:0/125379072 >> v2:172.21.15.102:3300/0 conn(0x7f7e2c154260 0x7f7e2c0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2b400640 1 --2- 172.21.15.102:0/125379072 >> v2:172.21.15.187:3300/0 conn(0x7f7e2c0cb620 0x7f7e2c0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2a000640 1 -- 172.21.15.102:0/125379072 >> v2:172.21.15.187:3300/0 conn(0x7f7e2c0cb620 msgr2=0x7f7e2c0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:03:57.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2a000640 1 --2- 172.21.15.102:0/125379072 >> v2:172.21.15.187:3300/0 conn(0x7f7e2c0cb620 0x7f7e2c0c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2a000640 1 -- 172.21.15.102:0/125379072 >> v1:172.21.15.102:6789/0 conn(0x7f7e2c153e80 legacy=0x7f7e2c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.478+0000 7f7e2a000640 1 -- 172.21.15.102:0/125379072 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0ca600 con 0x7f7e2c154260 2024-03-25T06:03:57.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.480+0000 7f7e2a000640 1 --2- 172.21.15.102:0/125379072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c154260 0x7f7e2c0cb0e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0cbda0 tx=0x7f7e1802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380745bbeacba31 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.480+0000 7f7e29600640 1 -- 172.21.15.102:0/125379072 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18030610 con 0x7f7e2c154260 2024-03-25T06:03:57.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e29600640 1 -- 172.21.15.102:0/125379072 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18030770 con 0x7f7e2c154260 2024-03-25T06:03:57.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e29600640 1 -- 172.21.15.102:0/125379072 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18030b00 con 0x7f7e2c154260 2024-03-25T06:03:57.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e2be00640 1 -- 172.21.15.102:0/125379072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c154260 msgr2=0x7f7e2c0cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e2be00640 1 --2- 172.21.15.102:0/125379072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c154260 0x7f7e2c0cb0e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0cbda0 tx=0x7f7e1802b960 comp rx=0 tx=0).stop 2024-03-25T06:03:57.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e2be00640 1 -- 172.21.15.102:0/125379072 shutdown_connections 2024-03-25T06:03:57.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e2be00640 1 --2- 172.21.15.102:0/125379072 >> v2:172.21.15.187:3300/0 conn(0x7f7e2c0cb620 0x7f7e2c0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e2be00640 1 --2- 172.21.15.102:0/125379072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c154260 0x7f7e2c0cb0e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e2be00640 1 -- 172.21.15.102:0/125379072 >> 172.21.15.102:0/125379072 conn(0x7f7e2c0cf370 msgr2=0x7f7e2c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:57.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.481+0000 7f7e2be00640 1 -- 172.21.15.102:0/125379072 shutdown_connections 2024-03-25T06:03:57.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.482+0000 7f7e2be00640 1 -- 172.21.15.102:0/125379072 wait complete. 2024-03-25T06:03:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.483+0000 7f7e2be00640 1 Processor -- start 2024-03-25T06:03:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.483+0000 7f7e2be00640 1 -- start start 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c0cb620 0x7f7e2c1e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c153e80 0x7f7e2c1f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c154650 0x7f7e2c1f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2be00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c1f3130 con 0x7f7e2c153e80 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2be00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c156440 con 0x7f7e2c0cb620 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c1f2b20 con 0x7f7e2c154650 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c0cb620 0x7f7e2c1e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c0cb620 0x7f7e2c1e5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37060/0 (socket says 172.21.15.102:37060) 2024-03-25T06:03:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2aa00640 1 -- 172.21.15.102:0/3401321239 learned_addr learned my addr 172.21.15.102:0/3401321239 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.484+0000 7f7e2b400640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c154650 0x7f7e2c1f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2a000640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c153e80 0x7f7e2c1f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2b400640 1 -- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c0cb620 msgr2=0x7f7e2c1e5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2b400640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c0cb620 0x7f7e2c1e5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2b400640 1 -- 172.21.15.102:0/3401321239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c153e80 msgr2=0x7f7e2c1f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2b400640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c153e80 0x7f7e2c1f0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2b400640 1 -- 172.21.15.102:0/3401321239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009400 con 0x7f7e2c154650 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2aa00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c0cb620 0x7f7e2c1e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e2b400640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c154650 0x7f7e2c1f35c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400ccb0 tx=0x7f7e2400a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.485+0000 7f7e22a00640 1 -- 172.21.15.102:0/3401321239 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24003b90 con 0x7f7e2c154650 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.486+0000 7f7e22a00640 1 -- 172.21.15.102:0/3401321239 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e24003cf0 con 0x7f7e2c154650 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.486+0000 7f7e22a00640 1 -- 172.21.15.102:0/3401321239 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24004240 con 0x7f7e2c154650 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.486+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c154b20 con 0x7f7e2c154650 2024-03-25T06:03:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.486+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c1f2dc0 con 0x7f7e2c154650 2024-03-25T06:03:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.487+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c1f32a0 con 0x7f7e2c154650 2024-03-25T06:03:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.489+0000 7f7e22a00640 1 -- 172.21.15.102:0/3401321239 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e240043a0 con 0x7f7e2c154650 2024-03-25T06:03:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.489+0000 7f7e22a00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7e0c06b810 0x7f7e0c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.489+0000 7f7e22a00640 1 -- 172.21.15.102:0/3401321239 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f7e24012070 con 0x7f7e2c154650 2024-03-25T06:03:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.490+0000 7f7e2aa00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7e0c06b810 0x7f7e0c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.490+0000 7f7e2aa00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7e0c06b810 0x7f7e0c06dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c004e60 tx=0x7f7e1c007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.496+0000 7f7e22a00640 1 -- 172.21.15.102:0/3401321239 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7e24055990 con 0x7f7e2c154650 2024-03-25T06:03:57.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.758+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e2c04f2f0 con 0x7f7e2c154650 2024-03-25T06:03:57.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.758+0000 7f7e22a00640 1 -- 172.21.15.102:0/3401321239 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e24059050 con 0x7f7e2c154650 2024-03-25T06:03:57.751 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7e0c06b810 msgr2=0x7f7e0c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7e0c06b810 0x7f7e0c06dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c004e60 tx=0x7f7e1c007f10 comp rx=0 tx=0).stop 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c154650 msgr2=0x7f7e2c1f35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c154650 0x7f7e2c1f35c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400ccb0 tx=0x7f7e2400a660 comp rx=0 tx=0).stop 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 shutdown_connections 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7e0c06b810 0x7f7e0c06dcd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c154650 0x7f7e2c1f35c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e2c153e80 0x7f7e2c1f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 --2- 172.21.15.102:0/3401321239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c0cb620 0x7f7e2c1e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 >> 172.21.15.102:0/3401321239 conn(0x7f7e2c0cf370 msgr2=0x7f7e2c14d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 shutdown_connections 2024-03-25T06:03:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.761+0000 7f7e2be00640 1 -- 172.21.15.102:0/3401321239 wait complete. 2024-03-25T06:03:57.769 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-25T06:03:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.948+0000 7fd337200640 1 Processor -- start 2024-03-25T06:03:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.948+0000 7fd337200640 1 -- start start 2024-03-25T06:03:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.949+0000 7fd337200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd338153e80 0x7fd3380c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd337200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd338154260 0x7fd3380c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd337200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380c8220 con 0x7fd3380cb0e0 2024-03-25T06:03:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd337200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380c8500 con 0x7fd338153e80 2024-03-25T06:03:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd337200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380ca320 con 0x7fd338154260 2024-03-25T06:03:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd335400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd338154260 0x7fd3380c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd335400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd338154260 0x7fd3380c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37076/0 (socket says 172.21.15.102:37076) 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd335400640 1 -- 172.21.15.102:0/2693013963 learned_addr learned my addr 172.21.15.102:0/2693013963 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.950+0000 7fd335e00640 1 --2- 172.21.15.102:0/2693013963 >> v2:172.21.15.102:3300/0 conn(0x7fd338153e80 0x7fd3380c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.951+0000 7fd335400640 1 -- 172.21.15.102:0/2693013963 >> v2:172.21.15.102:3300/0 conn(0x7fd338153e80 msgr2=0x7fd3380c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.951+0000 7fd335400640 1 --2- 172.21.15.102:0/2693013963 >> v2:172.21.15.102:3300/0 conn(0x7fd338153e80 0x7fd3380c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.951+0000 7fd335400640 1 -- 172.21.15.102:0/2693013963 >> v1:172.21.15.102:6789/0 conn(0x7fd3380cb0e0 legacy=0x7fd3380cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.951+0000 7fd334a00640 1 -- 172.21.15.102:0/2693013963 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620754585 0 0) 0x7fd3380c8220 con 0x7fd3380cb0e0 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.951+0000 7fd335400640 1 -- 172.21.15.102:0/2693013963 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380ca600 con 0x7fd338154260 2024-03-25T06:03:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.951+0000 7fd335e00640 1 --2- 172.21.15.102:0/2693013963 >> v2:172.21.15.102:3300/0 conn(0x7fd338153e80 0x7fd3380c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:03:57.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.952+0000 7fd335400640 1 --2- 172.21.15.102:0/2693013963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338154260 0x7fd3380c6cb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd33815adf0 tx=0x7fd32402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b300af7318198a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd334a00640 1 -- 172.21.15.102:0/2693013963 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32402f850 con 0x7fd338154260 2024-03-25T06:03:57.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd334a00640 1 -- 172.21.15.102:0/2693013963 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32402f9b0 con 0x7fd338154260 2024-03-25T06:03:57.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd334a00640 1 -- 172.21.15.102:0/2693013963 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32402fd40 con 0x7fd338154260 2024-03-25T06:03:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd337200640 1 -- 172.21.15.102:0/2693013963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338154260 msgr2=0x7fd3380c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd337200640 1 --2- 172.21.15.102:0/2693013963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338154260 0x7fd3380c6cb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd33815adf0 tx=0x7fd32402ba30 comp rx=0 tx=0).stop 2024-03-25T06:03:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd337200640 1 -- 172.21.15.102:0/2693013963 shutdown_connections 2024-03-25T06:03:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd337200640 1 --2- 172.21.15.102:0/2693013963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338154260 0x7fd3380c6cb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd337200640 1 --2- 172.21.15.102:0/2693013963 >> v2:172.21.15.102:3300/0 conn(0x7fd338153e80 0x7fd3380c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.953+0000 7fd337200640 1 -- 172.21.15.102:0/2693013963 >> 172.21.15.102:0/2693013963 conn(0x7fd3380cf370 msgr2=0x7fd3380cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.954+0000 7fd337200640 1 -- 172.21.15.102:0/2693013963 shutdown_connections 2024-03-25T06:03:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.954+0000 7fd337200640 1 -- 172.21.15.102:0/2693013963 wait complete. 2024-03-25T06:03:57.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.956+0000 7fd337200640 1 Processor -- start 2024-03-25T06:03:57.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.956+0000 7fd337200640 1 -- start start 2024-03-25T06:03:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd337200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3380cb0e0 0x7fd3380c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd337200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338153e80 0x7fd3380c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd337200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3380c3640 0x7fd33814b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd337200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380c5700 con 0x7fd3380c3640 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd337200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380c4e40 con 0x7fd338153e80 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd337200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3381e2800 con 0x7fd3380cb0e0 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338153e80 0x7fd3380c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338153e80 0x7fd3380c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37078/0 (socket says 172.21.15.102:37078) 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 -- 172.21.15.102:0/1930804779 learned_addr learned my addr 172.21.15.102:0/1930804779 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335e00640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3380cb0e0 0x7fd3380c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd336800640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3380c3640 0x7fd33814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 -- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3380cb0e0 msgr2=0x7fd3380c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3380cb0e0 0x7fd3380c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 -- 172.21.15.102:0/1930804779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3380c3640 msgr2=0x7fd33814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3380c3640 0x7fd33814b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335400640 1 -- 172.21.15.102:0/1930804779 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328009400 con 0x7fd338153e80 2024-03-25T06:03:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.958+0000 7fd335e00640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3380cb0e0 0x7fd3380c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:03:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.959+0000 7fd336800640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3380c3640 0x7fd33814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T06:03:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.959+0000 7fd335400640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338153e80 0x7fd3380c3100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd32402ba70 tx=0x7fd324004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.959+0000 7fd32e000640 1 -- 172.21.15.102:0/1930804779 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324037c40 con 0x7fd338153e80 2024-03-25T06:03:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.959+0000 7fd32e000640 1 -- 172.21.15.102:0/1930804779 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324037da0 con 0x7fd338153e80 2024-03-25T06:03:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.959+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3240094d0 con 0x7fd338153e80 2024-03-25T06:03:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.959+0000 7fd32e000640 1 -- 172.21.15.102:0/1930804779 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324041600 con 0x7fd338153e80 2024-03-25T06:03:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.959+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3380c50b0 con 0x7fd338153e80 2024-03-25T06:03:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.961+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3380c8810 con 0x7fd338153e80 2024-03-25T06:03:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.962+0000 7fd32e000640 1 -- 172.21.15.102:0/1930804779 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd324041760 con 0x7fd338153e80 2024-03-25T06:03:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.964+0000 7fd32e000640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd31806b810 0x7fd31806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.965+0000 7fd32e000640 1 -- 172.21.15.102:0/1930804779 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fd32403c070 con 0x7fd338153e80 2024-03-25T06:03:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.965+0000 7fd335e00640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd31806b810 0x7fd31806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:57.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.965+0000 7fd335e00640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd31806b810 0x7fd31806dcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd328009d20 tx=0x7fd328008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:57.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:57.968+0000 7fd32e000640 1 -- 172.21.15.102:0/1930804779 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd3240778d0 con 0x7fd338153e80 2024-03-25T06:03:58.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.186+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd33804f2f0 con 0x7fd338153e80 2024-03-25T06:03:58.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.187+0000 7fd32e000640 1 -- 172.21.15.102:0/1930804779 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd32407af90 con 0x7fd338153e80 2024-03-25T06:03:58.180 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd31806b810 msgr2=0x7fd31806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd31806b810 0x7fd31806dcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd328009d20 tx=0x7fd328008040 comp rx=0 tx=0).stop 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338153e80 msgr2=0x7fd3380c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338153e80 0x7fd3380c3100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd32402ba70 tx=0x7fd324004730 comp rx=0 tx=0).stop 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 shutdown_connections 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd31806b810 0x7fd31806dcd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3380c3640 0x7fd33814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd338153e80 0x7fd3380c3100 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 --2- 172.21.15.102:0/1930804779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3380cb0e0 0x7fd3380c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 >> 172.21.15.102:0/1930804779 conn(0x7fd3380cf370 msgr2=0x7fd3380cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 shutdown_connections 2024-03-25T06:03:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.190+0000 7fd337200640 1 -- 172.21.15.102:0/1930804779 wait complete. 2024-03-25T06:03:58.201 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-25T06:03:58.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.374+0000 7fcbffe00640 1 Processor -- start 2024-03-25T06:03:58.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.374+0000 7fcbffe00640 1 -- start start 2024-03-25T06:03:58.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbffe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcc000c67e0 0x7fcc000c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:58.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbffe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000c6c10 0x7fcc000c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:58.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbffe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000cbbe0 con 0x7fcc00154120 2024-03-25T06:03:58.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbffe00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc00154500 con 0x7fcc000c67e0 2024-03-25T06:03:58.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbffe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0006b250 con 0x7fcc000c6c10 2024-03-25T06:03:58.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbfea00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fcc00154120 0x7fcc000cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:34392/0 (socket says 172.21.15.102:34392) 2024-03-25T06:03:58.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbfea00640 1 -- 172.21.15.102:0/3657986808 learned_addr learned my addr 172.21.15.102:0/3657986808 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:03:58.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbff400640 1 --2- 172.21.15.102:0/3657986808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000c6c10 0x7fcc000c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:58.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.375+0000 7fcbfe000640 1 --2- 172.21.15.102:0/3657986808 >> v2:172.21.15.102:3300/0 conn(0x7fcc000c67e0 0x7fcc000c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:58.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.376+0000 7fcbfd600640 1 -- 172.21.15.102:0/3657986808 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163697041 0 0) 0x7fcc000cbbe0 con 0x7fcc00154120 2024-03-25T06:03:58.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.376+0000 7fcbfd600640 1 -- 172.21.15.102:0/3657986808 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe4003520 con 0x7fcc00154120 2024-03-25T06:03:58.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.376+0000 7fcbff400640 1 -- 172.21.15.102:0/3657986808 >> v2:172.21.15.102:3300/0 conn(0x7fcc000c67e0 msgr2=0x7fcc000c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:03:58.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.376+0000 7fcbff400640 1 --2- 172.21.15.102:0/3657986808 >> v2:172.21.15.102:3300/0 conn(0x7fcc000c67e0 0x7fcc000c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.376+0000 7fcbff400640 1 -- 172.21.15.102:0/3657986808 >> v1:172.21.15.187:6789/0 conn(0x7fcc00154120 legacy=0x7fcc000cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.376+0000 7fcbff400640 1 -- 172.21.15.102:0/3657986808 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000ca280 con 0x7fcc000c6c10 2024-03-25T06:03:58.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.376+0000 7fcbfe000640 1 --2- 172.21.15.102:0/3657986808 >> v2:172.21.15.102:3300/0 conn(0x7fcc000c67e0 0x7fcc000c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:03:58.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.377+0000 7fcbff400640 1 --2- 172.21.15.102:0/3657986808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000c6c10 0x7fcc000c8240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009d90 tx=0x7fcbf802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b11696e13fbfc486 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:58.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.378+0000 7fcbfd600640 1 -- 172.21.15.102:0/3657986808 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf802cc60 con 0x7fcc000c6c10 2024-03-25T06:03:58.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.378+0000 7fcbfd600640 1 -- 172.21.15.102:0/3657986808 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf802cdc0 con 0x7fcc000c6c10 2024-03-25T06:03:58.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.378+0000 7fcbfd600640 1 -- 172.21.15.102:0/3657986808 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8034660 con 0x7fcc000c6c10 2024-03-25T06:03:58.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.378+0000 7fcbffe00640 1 -- 172.21.15.102:0/3657986808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000c6c10 msgr2=0x7fcc000c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.378+0000 7fcbffe00640 1 --2- 172.21.15.102:0/3657986808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000c6c10 0x7fcc000c8240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009d90 tx=0x7fcbf802beb0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.379+0000 7fcbffe00640 1 -- 172.21.15.102:0/3657986808 shutdown_connections 2024-03-25T06:03:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.379+0000 7fcbffe00640 1 --2- 172.21.15.102:0/3657986808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000c6c10 0x7fcc000c8240 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.379+0000 7fcbffe00640 1 --2- 172.21.15.102:0/3657986808 >> v2:172.21.15.102:3300/0 conn(0x7fcc000c67e0 0x7fcc000c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.379+0000 7fcbffe00640 1 -- 172.21.15.102:0/3657986808 >> 172.21.15.102:0/3657986808 conn(0x7fcc000cf3e0 msgr2=0x7fcc000cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.379+0000 7fcbffe00640 1 -- 172.21.15.102:0/3657986808 shutdown_connections 2024-03-25T06:03:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.379+0000 7fcbffe00640 1 -- 172.21.15.102:0/3657986808 wait complete. 2024-03-25T06:03:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.381+0000 7fcbffe00640 1 Processor -- start 2024-03-25T06:03:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.381+0000 7fcbffe00640 1 -- start start 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbffe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc000c67e0 0x7fcc00159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbffe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc000c6c10 0x7fcc00147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbffe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc00154120 0x7fcc00147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbffe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c5490 con 0x7fcc000c6c10 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbffe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc001f06d0 con 0x7fcc000c67e0 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbffe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0014a8e0 con 0x7fcc00154120 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbfea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc000c67e0 0x7fcc00159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbfe000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc000c6c10 0x7fcc00147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbfea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc000c67e0 0x7fcc00159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37092/0 (socket says 172.21.15.102:37092) 2024-03-25T06:03:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbfea00640 1 -- 172.21.15.102:0/2909376257 learned_addr learned my addr 172.21.15.102:0/2909376257 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:03:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.383+0000 7fcbff400640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc00154120 0x7fcc00147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbfea00640 1 -- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc00154120 msgr2=0x7fcc00147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbfea00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc00154120 0x7fcc00147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbfea00640 1 -- 172.21.15.102:0/2909376257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc000c6c10 msgr2=0x7fcc00147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbfea00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc000c6c10 0x7fcc00147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbfea00640 1 -- 172.21.15.102:0/2909376257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009a70 con 0x7fcc000c67e0 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbfea00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc000c67e0 0x7fcc00159280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c3c0 tx=0x7fcbf000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbf6a00640 1 -- 172.21.15.102:0/2909376257 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0005ce0 con 0x7fcc000c67e0 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbf6a00640 1 -- 172.21.15.102:0/2909376257 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0005e40 con 0x7fcc000c67e0 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc00149ec0 con 0x7fcc000c67e0 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbf6a00640 1 -- 172.21.15.102:0/2909376257 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00072f0 con 0x7fcc000c67e0 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.384+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0014a160 con 0x7fcc000c67e0 2024-03-25T06:03:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.386+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0015a810 con 0x7fcc000c67e0 2024-03-25T06:03:58.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.388+0000 7fcbf6a00640 1 -- 172.21.15.102:0/2909376257 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcbf0007450 con 0x7fcc000c67e0 2024-03-25T06:03:58.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.389+0000 7fcbf6a00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcbe006b810 0x7fcbe006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:58.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.389+0000 7fcbf6a00640 1 -- 172.21.15.102:0/2909376257 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fcbf0089b50 con 0x7fcc000c67e0 2024-03-25T06:03:58.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.389+0000 7fcbfe000640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcbe006b810 0x7fcbe006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:58.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.390+0000 7fcbfe000640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcbe006b810 0x7fcbe006dcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc00156fc0 tx=0x7fcbec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:03:58.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.393+0000 7fcbf6a00640 1 -- 172.21.15.102:0/2909376257 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcbf00541d0 con 0x7fcc000c67e0 2024-03-25T06:03:58.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.594+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcc00068a80 con 0x7fcc000c67e0 2024-03-25T06:03:58.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.594+0000 7fcbf6a00640 1 -- 172.21.15.102:0/2909376257 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcbf0017080 con 0x7fcc000c67e0 2024-03-25T06:03:58.587 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcbe006b810 msgr2=0x7fcbe006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcbe006b810 0x7fcbe006dcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc00156fc0 tx=0x7fcbec008040 comp rx=0 tx=0).stop 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc000c67e0 msgr2=0x7fcc00159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc000c67e0 0x7fcc00159280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c3c0 tx=0x7fcbf000c880 comp rx=0 tx=0).stop 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 shutdown_connections 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcbe006b810 0x7fcbe006dcd0 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc00156fc0 tx=0x7fcbec008040 comp rx=0 tx=0).stop 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc00154120 0x7fcc00147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc000c6c10 0x7fcc00147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 --2- 172.21.15.102:0/2909376257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc000c67e0 0x7fcc00159280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:58.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 >> 172.21.15.102:0/2909376257 conn(0x7fcc000cf3e0 msgr2=0x7fcc000cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:03:58.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 shutdown_connections 2024-03-25T06:03:58.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:03:58.597+0000 7fcbffe00640 1 -- 172.21.15.102:0/2909376257 wait complete. 2024-03-25T06:03:58.613 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-25T06:03:58.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T06:03:58.614 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-25T06:03:59.147 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T06:03:59.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T06:03:59.148 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-25T06:03:59.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T06:03:59.257 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-03-25T06:03:59.354 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-25T06:03:59.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T06:03:59.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-25T06:03:59.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-25T06:03:59.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-03-25T06:03:59.747 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-25T06:03:59.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-25T06:03:59.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T06:03:59.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.003+0000 7f0027e00640 1 Processor -- start 2024-03-25T06:03:59.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.003+0000 7f0027e00640 1 -- start start 2024-03-25T06:03:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0027e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00280c5d40 0x7f0028070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0027e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:03:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0027e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00280724e0 con 0x7f002814e3d0 2024-03-25T06:03:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0027e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0028072970 con 0x7f00280c5d40 2024-03-25T06:03:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0027e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00280c6250 con 0x7f00280c4a50 2024-03-25T06:03:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0027400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:59.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0026a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f002814e3d0 0x7f002815afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47416/0 (socket says 172.21.15.102:47416) 2024-03-25T06:03:59.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.004+0000 7f0026a00640 1 -- 172.21.15.102:0/633297685 learned_addr learned my addr 172.21.15.102:0/633297685 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:03:59.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.005+0000 7f0026000640 1 --2- 172.21.15.102:0/633297685 >> v2:172.21.15.102:3300/0 conn(0x7f00280c5d40 0x7f0028070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:03:59.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.005+0000 7f0027400640 1 -- 172.21.15.102:0/633297685 >> v2:172.21.15.102:3300/0 conn(0x7f00280c5d40 msgr2=0x7f0028070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:03:59.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.005+0000 7f0027400640 1 --2- 172.21.15.102:0/633297685 >> v2:172.21.15.102:3300/0 conn(0x7f00280c5d40 0x7f0028070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:03:59.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.005+0000 7f0027400640 1 -- 172.21.15.102:0/633297685 >> v1:172.21.15.102:6789/0 conn(0x7f002814e3d0 legacy=0x7f002815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:03:59.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.005+0000 7f0027400640 1 -- 172.21.15.102:0/633297685 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002806f170 con 0x7f00280c4a50 2024-03-25T06:03:59.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.006+0000 7f0027400640 1 --2- 172.21.15.102:0/633297685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0020009d90 tx=0x7f002002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a391a332ceafe79 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.006+0000 7f0025600640 1 -- 172.21.15.102:0/633297685 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002002cce0 con 0x7f00280c4a50 2024-03-25T06:04:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.006+0000 7f0025600640 1 -- 172.21.15.102:0/633297685 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002002ce40 con 0x7f00280c4a50 2024-03-25T06:04:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.006+0000 7f0025600640 1 -- 172.21.15.102:0/633297685 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020034660 con 0x7f00280c4a50 2024-03-25T06:04:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 -- 172.21.15.102:0/633297685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 msgr2=0x7f00280c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 --2- 172.21.15.102:0/633297685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0020009d90 tx=0x7f002002bf30 comp rx=0 tx=0).stop 2024-03-25T06:04:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 -- 172.21.15.102:0/633297685 shutdown_connections 2024-03-25T06:04:00.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 --2- 172.21.15.102:0/633297685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4ec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 --2- 172.21.15.102:0/633297685 >> v2:172.21.15.102:3300/0 conn(0x7f00280c5d40 0x7f0028070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 -- 172.21.15.102:0/633297685 >> 172.21.15.102:0/633297685 conn(0x7f00280cb340 msgr2=0x7f00280cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:00.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 -- 172.21.15.102:0/633297685 shutdown_connections 2024-03-25T06:04:00.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.007+0000 7f0027e00640 1 -- 172.21.15.102:0/633297685 wait complete. 2024-03-25T06:04:00.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.009+0000 7f0027e00640 1 Processor -- start 2024-03-25T06:04:00.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.009+0000 7f0027e00640 1 -- start start 2024-03-25T06:04:00.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00280c5d40 0x7f0028146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f002814e3d0 0x7f00280c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00280caa30 con 0x7f00280c5d40 2024-03-25T06:04:00.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0028159440 con 0x7f002814e3d0 2024-03-25T06:04:00.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00280ca090 con 0x7f00280c4a50 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f002814e3d0 0x7f00280c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f002814e3d0 0x7f00280c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37094/0 (socket says 172.21.15.102:37094) 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0027400640 1 -- 172.21.15.102:0/1211585234 learned_addr learned my addr 172.21.15.102:0/1211585234 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0026000640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00280c5d40 0x7f0028146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.010+0000 7f0026a00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f0027400640 1 -- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 msgr2=0x7f00280c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f0027400640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f0027400640 1 -- 172.21.15.102:0/1211585234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00280c5d40 msgr2=0x7f0028146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f0027400640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00280c5d40 0x7f0028146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f0027400640 1 -- 172.21.15.102:0/1211585234 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0020009a70 con 0x7f002814e3d0 2024-03-25T06:04:00.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f0027400640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f002814e3d0 0x7f00280c31e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0020009d90 tx=0x7f0020004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:00.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f001f400640 1 -- 172.21.15.102:0/1211585234 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002003d600 con 0x7f002814e3d0 2024-03-25T06:04:00.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f001f400640 1 -- 172.21.15.102:0/1211585234 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002003d780 con 0x7f002814e3d0 2024-03-25T06:04:00.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f001f400640 1 -- 172.21.15.102:0/1211585234 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002003db30 con 0x7f002814e3d0 2024-03-25T06:04:00.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.011+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00280c9240 con 0x7f002814e3d0 2024-03-25T06:04:00.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.012+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00280c9760 con 0x7f002814e3d0 2024-03-25T06:04:00.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.013+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002804f2f0 con 0x7f002814e3d0 2024-03-25T06:04:00.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.013+0000 7f001f400640 1 -- 172.21.15.102:0/1211585234 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f002003b040 con 0x7f002814e3d0 2024-03-25T06:04:00.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.014+0000 7f001f400640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f000806b810 0x7f000806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.014+0000 7f001f400640 1 -- 172.21.15.102:0/1211585234 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f00200ac9b0 con 0x7f002814e3d0 2024-03-25T06:04:00.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.015+0000 7f0026a00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f000806b810 0x7f000806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.015+0000 7f0026a00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f000806b810 0x7f000806dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0018000f60 tx=0x7f0018009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:00.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.023+0000 7f001f400640 1 -- 172.21.15.102:0/1211585234 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0020077150 con 0x7f002814e3d0 2024-03-25T06:04:00.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.226+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0028071e90 con 0x7f000806b810 2024-03-25T06:04:00.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.235+0000 7f001f400640 1 -- 172.21.15.102:0/1211585234 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336148 (secure 0 0 0) 0x7f0018001330 con 0x7f000806b810 2024-03-25T06:04:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:00.236 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T06:04:00.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f000806b810 msgr2=0x7f000806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f000806b810 0x7f000806dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0018000f60 tx=0x7f0018009040 comp rx=0 tx=0).stop 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f002814e3d0 msgr2=0x7f00280c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f002814e3d0 0x7f00280c31e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0020009d90 tx=0x7f0020004a40 comp rx=0 tx=0).stop 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 shutdown_connections 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f000806b810 0x7f000806dcd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f002814e3d0 0x7f00280c31e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00280c5d40 0x7f0028146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 --2- 172.21.15.102:0/1211585234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280c4a50 0x7f00280c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 >> 172.21.15.102:0/1211585234 conn(0x7f00280cb340 msgr2=0x7f00280c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:00.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.241+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 shutdown_connections 2024-03-25T06:04:00.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.242+0000 7f0027e00640 1 -- 172.21.15.102:0/1211585234 wait complete. 2024-03-25T06:04:00.250 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":818,"stamp":"2024-03-25T06:03:59.348385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":250778084,"num_objects":245,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":8377,"num_read_kb":1510063,"num_write":298461,"num_write_kb":4970321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":459891,"ondisk_log_size":459891,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5876216,"kb_used_data":310648,"kb_used_omap":12,"kb_used_meta":5565491,"kb_avail":749098504,"statfs":{"total":773094113280,"available":767076868096,"internally_reserved":0,"allocated":318103552,"data_stored":509580466,"data_compressed":51430862,"data_compressed_allocated":76034048,"data_compressed_original":269111296,"omap_allocated":12752,"internal_metadata":5699063344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,2,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212575876,"num_objects":-1650,"num_object_clones":0,"num_object_copies":-5378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1650,"num_whiteouts":0,"num_read":8,"num_read_kb":139,"num_write":2335,"num_write_kb":24532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"2.1f","version":"27'1871","reported_seq":1910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.671840+0000","last_change":"2024-03-25T05:37:30.423912+0000","last_active":"2024-03-25T06:03:54.671840+0000","last_peered":"2024-03-25T06:03:54.671840+0000","last_clean":"2024-03-25T06:03:54.671840+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T06:03:54.671840+0000","last_undegraded":"2024-03-25T06:03:54.671840+0000","last_fullsized":"2024-03-25T06:03:54.671840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1876,"num_write_kb":13587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1705","reported_seq":1743,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.233956+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T06:03:53.233956+0000","last_peered":"2024-03-25T06:03:53.233956+0000","last_clean":"2024-03-25T06:03:53.233956+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T06:03:53.233956+0000","last_undegraded":"2024-03-25T06:03:53.233956+0000","last_fullsized":"2024-03-25T06:03:53.233956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'6032","reported_seq":6143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.467422+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T06:03:54.467422+0000","last_peered":"2024-03-25T06:03:54.467422+0000","last_clean":"2024-03-25T06:03:54.467422+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T06:03:54.467422+0000","last_undegraded":"2024-03-25T06:03:54.467422+0000","last_fullsized":"2024-03-25T06:03:54.467422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6032,"log_dups_size":0,"ondisk_log_size":6032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:43:49.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421387,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":4292,"num_write_kb":115305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'5159","reported_seq":5199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.715919+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T06:03:54.715919+0000","last_peered":"2024-03-25T06:03:54.715919+0000","last_clean":"2024-03-25T06:03:54.715919+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T06:03:54.715919+0000","last_undegraded":"2024-03-25T06:03:54.715919+0000","last_fullsized":"2024-03-25T06:03:54.715919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5171,"num_write_kb":32292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1710","reported_seq":1747,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.232486+0000","last_change":"2024-03-25T05:37:31.155929+0000","last_active":"2024-03-25T06:03:59.232486+0000","last_peered":"2024-03-25T06:03:59.232486+0000","last_clean":"2024-03-25T06:03:59.232486+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T06:03:59.232486+0000","last_undegraded":"2024-03-25T06:03:59.232486+0000","last_fullsized":"2024-03-25T06:03:59.232486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5965","reported_seq":6066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.539973+0000","last_change":"2024-03-25T05:38:20.806371+0000","last_active":"2024-03-25T06:03:54.539973+0000","last_peered":"2024-03-25T06:03:54.539973+0000","last_clean":"2024-03-25T06:03:54.539973+0000","last_became_active":"2024-03-25T05:38:20.805843+0000","last_became_peered":"2024-03-25T05:38:20.805843+0000","last_unstale":"2024-03-25T06:03:54.539973+0000","last_undegraded":"2024-03-25T06:03:54.539973+0000","last_fullsized":"2024-03-25T06:03:54.539973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5965,"log_dups_size":0,"ondisk_log_size":5965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:02:43.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052672,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":16002,"num_write":4126,"num_write_kb":114621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7852","reported_seq":7890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.642765+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T06:03:54.642765+0000","last_peered":"2024-03-25T06:03:54.642765+0000","last_clean":"2024-03-25T06:03:54.642765+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T06:03:54.642765+0000","last_undegraded":"2024-03-25T06:03:54.642765+0000","last_fullsized":"2024-03-25T06:03:54.642765+0000","mapping_epoch":17,"log_start":"27'800","ondisk_log_start":"27'800","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7052,"log_dups_size":0,"ondisk_log_size":7052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7854,"num_write_kb":54498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1762","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.355195+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T06:03:54.355195+0000","last_peered":"2024-03-25T06:03:54.355195+0000","last_clean":"2024-03-25T06:03:54.355195+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T06:03:54.355195+0000","last_undegraded":"2024-03-25T06:03:54.355195+0000","last_fullsized":"2024-03-25T06:03:54.355195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5977","reported_seq":6132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.451854+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T06:03:54.451854+0000","last_peered":"2024-03-25T06:03:54.451854+0000","last_clean":"2024-03-25T06:03:54.451854+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T06:03:54.451854+0000","last_undegraded":"2024-03-25T06:03:54.451854+0000","last_fullsized":"2024-03-25T06:03:54.451854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5977,"log_dups_size":0,"ondisk_log_size":5977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":31496,"num_write":4147,"num_write_kb":107246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4412","reported_seq":4450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:02:30.058411+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T06:02:30.058411+0000","last_peered":"2024-03-25T06:02:30.058411+0000","last_clean":"2024-03-25T06:02:30.058411+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T06:02:30.058411+0000","last_undegraded":"2024-03-25T06:02:30.058411+0000","last_fullsized":"2024-03-25T06:02:30.058411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4409,"num_write_kb":35629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1687","reported_seq":1723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.405629+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T06:03:54.405629+0000","last_peered":"2024-03-25T06:03:54.405629+0000","last_clean":"2024-03-25T06:03:54.405629+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T06:03:54.405629+0000","last_undegraded":"2024-03-25T06:03:54.405629+0000","last_fullsized":"2024-03-25T06:03:54.405629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1687,"log_dups_size":0,"ondisk_log_size":1687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5903","reported_seq":6001,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.298649+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T06:03:54.298649+0000","last_peered":"2024-03-25T06:03:54.298649+0000","last_clean":"2024-03-25T06:03:54.298649+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T06:03:54.298649+0000","last_undegraded":"2024-03-25T06:03:54.298649+0000","last_fullsized":"2024-03-25T06:03:54.298649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5903,"log_dups_size":0,"ondisk_log_size":5903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":4123,"num_write_kb":118597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1733","reported_seq":1770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.278722+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T06:03:54.278722+0000","last_peered":"2024-03-25T06:03:54.278722+0000","last_clean":"2024-03-25T06:03:54.278722+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T06:03:54.278722+0000","last_undegraded":"2024-03-25T06:03:54.278722+0000","last_fullsized":"2024-03-25T06:03:54.278722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'5826","reported_seq":5865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.701813+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T06:03:54.701813+0000","last_peered":"2024-03-25T06:03:54.701813+0000","last_clean":"2024-03-25T06:03:54.701813+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T06:03:54.701813+0000","last_undegraded":"2024-03-25T06:03:54.701813+0000","last_fullsized":"2024-03-25T06:03:54.701813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5838,"num_write_kb":40868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'6410","reported_seq":6548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.414898+0000","last_change":"2024-03-25T05:38:20.653005+0000","last_active":"2024-03-25T06:03:54.414898+0000","last_peered":"2024-03-25T06:03:54.414898+0000","last_clean":"2024-03-25T06:03:54.414898+0000","last_became_active":"2024-03-25T05:38:20.652530+0000","last_became_peered":"2024-03-25T05:38:20.652530+0000","last_unstale":"2024-03-25T06:03:54.414898+0000","last_undegraded":"2024-03-25T06:03:54.414898+0000","last_fullsized":"2024-03-25T06:03:54.414898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6410,"log_dups_size":0,"ondisk_log_size":6410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:23.447608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1391862,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":25146,"num_write":4561,"num_write_kb":128586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1751","reported_seq":1787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.889253+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T06:03:53.889253+0000","last_peered":"2024-03-25T06:03:53.889253+0000","last_clean":"2024-03-25T06:03:53.889253+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T06:03:53.889253+0000","last_undegraded":"2024-03-25T06:03:53.889253+0000","last_fullsized":"2024-03-25T06:03:53.889253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'5251","reported_seq":5291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.654958+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T06:03:54.654958+0000","last_peered":"2024-03-25T06:03:54.654958+0000","last_clean":"2024-03-25T06:03:54.654958+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T06:03:54.654958+0000","last_undegraded":"2024-03-25T06:03:54.654958+0000","last_fullsized":"2024-03-25T06:03:54.654958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5247,"num_write_kb":40419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'6237","reported_seq":6382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.156774+0000","last_change":"2024-03-25T05:38:20.809959+0000","last_active":"2024-03-25T06:03:52.156774+0000","last_peered":"2024-03-25T06:03:52.156774+0000","last_clean":"2024-03-25T06:03:52.156774+0000","last_became_active":"2024-03-25T05:38:20.809544+0000","last_became_peered":"2024-03-25T05:38:20.809544+0000","last_unstale":"2024-03-25T06:03:52.156774+0000","last_undegraded":"2024-03-25T06:03:52.156774+0000","last_fullsized":"2024-03-25T06:03:52.156774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6237,"log_dups_size":0,"ondisk_log_size":6237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:17:17.764182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":26924,"num_write":4469,"num_write_kb":121611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1763","reported_seq":1800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.183098+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T06:03:54.183098+0000","last_peered":"2024-03-25T06:03:54.183098+0000","last_clean":"2024-03-25T06:03:54.183098+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T06:03:54.183098+0000","last_undegraded":"2024-03-25T06:03:54.183098+0000","last_fullsized":"2024-03-25T06:03:54.183098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2773","reported_seq":2813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.683761+0000","last_change":"2024-03-25T05:37:30.422594+0000","last_active":"2024-03-25T06:03:54.683761+0000","last_peered":"2024-03-25T06:03:54.683761+0000","last_clean":"2024-03-25T06:03:54.683761+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T06:03:54.683761+0000","last_undegraded":"2024-03-25T06:03:54.683761+0000","last_fullsized":"2024-03-25T06:03:54.683761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2773,"log_dups_size":0,"ondisk_log_size":2773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2784,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5897","reported_seq":6115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.164582+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T06:03:54.164582+0000","last_peered":"2024-03-25T06:03:54.164582+0000","last_clean":"2024-03-25T06:03:54.164582+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T06:03:54.164582+0000","last_undegraded":"2024-03-25T06:03:54.164582+0000","last_fullsized":"2024-03-25T06:03:54.164582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5897,"log_dups_size":0,"ondisk_log_size":5897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":47244,"num_write":4143,"num_write_kb":109091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1771","reported_seq":1809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.088254+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T06:03:52.088254+0000","last_peered":"2024-03-25T06:03:52.088254+0000","last_clean":"2024-03-25T06:03:52.088254+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T06:03:52.088254+0000","last_undegraded":"2024-03-25T06:03:52.088254+0000","last_fullsized":"2024-03-25T06:03:52.088254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1612","reported_seq":1652,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.715052+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T06:03:54.715052+0000","last_peered":"2024-03-25T06:03:54.715052+0000","last_clean":"2024-03-25T06:03:54.715052+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T06:03:54.715052+0000","last_undegraded":"2024-03-25T06:03:54.715052+0000","last_fullsized":"2024-03-25T06:03:54.715052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5907","reported_seq":5991,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.198942+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T06:03:54.198942+0000","last_peered":"2024-03-25T06:03:54.198942+0000","last_clean":"2024-03-25T06:03:54.198942+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T06:03:54.198942+0000","last_undegraded":"2024-03-25T06:03:54.198942+0000","last_fullsized":"2024-03-25T06:03:54.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315648,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4053,"num_write_kb":104860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1711","reported_seq":1748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.225436+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T06:03:59.225436+0000","last_peered":"2024-03-25T06:03:59.225436+0000","last_clean":"2024-03-25T06:03:59.225436+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T06:03:59.225436+0000","last_undegraded":"2024-03-25T06:03:59.225436+0000","last_fullsized":"2024-03-25T06:03:59.225436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'2886","reported_seq":2925,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.726047+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T06:03:54.726047+0000","last_peered":"2024-03-25T06:03:54.726047+0000","last_clean":"2024-03-25T06:03:54.726047+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T06:03:54.726047+0000","last_undegraded":"2024-03-25T06:03:54.726047+0000","last_fullsized":"2024-03-25T06:03:54.726047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2906,"num_write_kb":22398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'6069","reported_seq":6154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.575479+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T06:03:54.575479+0000","last_peered":"2024-03-25T06:03:54.575479+0000","last_clean":"2024-03-25T06:03:54.575479+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T06:03:54.575479+0000","last_undegraded":"2024-03-25T06:03:54.575479+0000","last_fullsized":"2024-03-25T06:03:54.575479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4301,"num_write_kb":129624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1685","reported_seq":1722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.988242+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T06:03:53.988242+0000","last_peered":"2024-03-25T06:03:53.988242+0000","last_clean":"2024-03-25T06:03:53.988242+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T06:03:53.988242+0000","last_undegraded":"2024-03-25T06:03:53.988242+0000","last_fullsized":"2024-03-25T06:03:53.988242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1685,"log_dups_size":0,"ondisk_log_size":1685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4481","reported_seq":4521,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.707955+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T06:03:54.707955+0000","last_peered":"2024-03-25T06:03:54.707955+0000","last_clean":"2024-03-25T06:03:54.707955+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T06:03:54.707955+0000","last_undegraded":"2024-03-25T06:03:54.707955+0000","last_fullsized":"2024-03-25T06:03:54.707955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4481,"log_dups_size":0,"ondisk_log_size":4481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7147,"num_write_kb":35866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'6335","reported_seq":6502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.271690+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T06:03:54.271690+0000","last_peered":"2024-03-25T06:03:54.271690+0000","last_clean":"2024-03-25T06:03:54.271690+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T06:03:54.271690+0000","last_undegraded":"2024-03-25T06:03:54.271690+0000","last_fullsized":"2024-03-25T06:03:54.271690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6335,"log_dups_size":0,"ondisk_log_size":6335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:43:13.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":33782,"num_write":4565,"num_write_kb":115382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1750","reported_seq":1788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.914901+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T06:03:53.914901+0000","last_peered":"2024-03-25T06:03:53.914901+0000","last_clean":"2024-03-25T06:03:53.914901+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T06:03:53.914901+0000","last_undegraded":"2024-03-25T06:03:53.914901+0000","last_fullsized":"2024-03-25T06:03:53.914901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'5273","reported_seq":5313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.690625+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T06:03:54.690625+0000","last_peered":"2024-03-25T06:03:54.690625+0000","last_clean":"2024-03-25T06:03:54.690625+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T06:03:54.690625+0000","last_undegraded":"2024-03-25T06:03:54.690625+0000","last_fullsized":"2024-03-25T06:03:54.690625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5274,"num_write_kb":36361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'6077","reported_seq":6315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.990727+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T06:03:58.990727+0000","last_peered":"2024-03-25T06:03:58.990727+0000","last_clean":"2024-03-25T06:03:58.990727+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T06:03:58.990727+0000","last_undegraded":"2024-03-25T06:03:58.990727+0000","last_fullsized":"2024-03-25T06:03:58.990727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6077,"log_dups_size":0,"ondisk_log_size":6077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629177,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":52070,"num_write":4226,"num_write_kb":109752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1707","reported_seq":1729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.766841+0000","last_change":"2024-03-25T05:38:20.806229+0000","last_active":"2024-03-25T06:03:51.766841+0000","last_peered":"2024-03-25T06:03:51.766841+0000","last_clean":"2024-03-25T06:03:51.766841+0000","last_became_active":"2024-03-25T05:38:20.805934+0000","last_became_peered":"2024-03-25T05:38:20.805934+0000","last_unstale":"2024-03-25T06:03:51.766841+0000","last_undegraded":"2024-03-25T06:03:51.766841+0000","last_fullsized":"2024-03-25T06:03:51.766841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1707,"log_dups_size":0,"ondisk_log_size":1707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'5138","reported_seq":5178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.723442+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T06:03:54.723442+0000","last_peered":"2024-03-25T06:03:54.723442+0000","last_clean":"2024-03-25T06:03:54.723442+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T06:03:54.723442+0000","last_undegraded":"2024-03-25T06:03:54.723442+0000","last_fullsized":"2024-03-25T06:03:54.723442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5138,"log_dups_size":0,"ondisk_log_size":5138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5143,"num_write_kb":40167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'6967","reported_seq":7059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.761754+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T06:03:53.761754+0000","last_peered":"2024-03-25T06:03:53.761754+0000","last_clean":"2024-03-25T06:03:53.761754+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T06:03:53.761754+0000","last_undegraded":"2024-03-25T06:03:53.761754+0000","last_fullsized":"2024-03-25T06:03:53.761754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6967,"log_dups_size":0,"ondisk_log_size":6967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5199,"num_write_kb":132356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1717","reported_seq":1755,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.061043+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T06:03:53.061043+0000","last_peered":"2024-03-25T06:03:53.061043+0000","last_clean":"2024-03-25T06:03:53.061043+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T06:03:53.061043+0000","last_undegraded":"2024-03-25T06:03:53.061043+0000","last_fullsized":"2024-03-25T06:03:53.061043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7932","reported_seq":7972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731617+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T06:03:54.731617+0000","last_peered":"2024-03-25T06:03:54.731617+0000","last_clean":"2024-03-25T06:03:54.731617+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T06:03:54.731617+0000","last_undegraded":"2024-03-25T06:03:54.731617+0000","last_fullsized":"2024-03-25T06:03:54.731617+0000","mapping_epoch":17,"log_start":"27'400","ondisk_log_start":"27'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7532,"log_dups_size":0,"ondisk_log_size":7532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":7940,"num_write_kb":54570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'6089","reported_seq":6194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.524271+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T06:03:54.524271+0000","last_peered":"2024-03-25T06:03:54.524271+0000","last_clean":"2024-03-25T06:03:54.524271+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T06:03:54.524271+0000","last_undegraded":"2024-03-25T06:03:54.524271+0000","last_fullsized":"2024-03-25T06:03:54.524271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6089,"log_dups_size":0,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4263,"num_write_kb":125557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1735","reported_seq":1774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.267603+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T06:03:54.267603+0000","last_peered":"2024-03-25T06:03:54.267603+0000","last_clean":"2024-03-25T06:03:54.267603+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T06:03:54.267603+0000","last_undegraded":"2024-03-25T06:03:54.267603+0000","last_fullsized":"2024-03-25T06:03:54.267603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6067","reported_seq":7057,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.676694+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T06:03:54.676694+0000","last_peered":"2024-03-25T06:03:54.676694+0000","last_clean":"2024-03-25T06:03:54.676694+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T06:03:54.676694+0000","last_undegraded":"2024-03-25T06:03:54.676694+0000","last_fullsized":"2024-03-25T06:03:54.676694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6067,"log_dups_size":0,"ondisk_log_size":6067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":950,"num_read_kb":4728,"num_write":6066,"num_write_kb":44950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'6018","reported_seq":6490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.519967+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T06:03:54.519967+0000","last_peered":"2024-03-25T06:03:54.519967+0000","last_clean":"2024-03-25T06:03:54.519967+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T06:03:54.519967+0000","last_undegraded":"2024-03-25T06:03:54.519967+0000","last_fullsized":"2024-03-25T06:03:54.519967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6018,"log_dups_size":0,"ondisk_log_size":6018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":111506,"num_write":4239,"num_write_kb":120920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1663","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.185756+0000","last_change":"2024-03-25T05:37:31.148439+0000","last_active":"2024-03-25T06:03:59.185756+0000","last_peered":"2024-03-25T06:03:59.185756+0000","last_clean":"2024-03-25T06:03:59.185756+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T06:03:59.185756+0000","last_undegraded":"2024-03-25T06:03:59.185756+0000","last_fullsized":"2024-03-25T06:03:59.185756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:53:17.257529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'6671","reported_seq":6712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.671195+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T06:03:54.671195+0000","last_peered":"2024-03-25T06:03:54.671195+0000","last_clean":"2024-03-25T06:03:54.671195+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T06:03:54.671195+0000","last_undegraded":"2024-03-25T06:03:54.671195+0000","last_fullsized":"2024-03-25T06:03:54.671195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6671,"log_dups_size":0,"ondisk_log_size":6671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":45450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'6159","reported_seq":6352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.043817+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T06:03:59.043817+0000","last_peered":"2024-03-25T06:03:59.043817+0000","last_clean":"2024-03-25T06:03:59.043817+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T06:03:59.043817+0000","last_undegraded":"2024-03-25T06:03:59.043817+0000","last_fullsized":"2024-03-25T06:03:59.043817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6159,"log_dups_size":0,"ondisk_log_size":6159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260306,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":160,"num_read_kb":40640,"num_write":4330,"num_write_kb":133390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1731","reported_seq":1768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.678278+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T06:03:52.678278+0000","last_peered":"2024-03-25T06:03:52.678278+0000","last_clean":"2024-03-25T06:03:52.678278+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T06:03:52.678278+0000","last_undegraded":"2024-03-25T06:03:52.678278+0000","last_fullsized":"2024-03-25T06:03:52.678278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4314","reported_seq":4354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:08.404605+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T06:03:08.404605+0000","last_peered":"2024-03-25T06:03:08.404605+0000","last_clean":"2024-03-25T06:03:08.404605+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T06:03:08.404605+0000","last_undegraded":"2024-03-25T06:03:08.404605+0000","last_fullsized":"2024-03-25T06:03:08.404605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4314,"log_dups_size":0,"ondisk_log_size":4314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4311,"num_write_kb":35590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:01:30.046447+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T06:01:30.046447+0000","last_peered":"2024-03-25T06:01:30.046447+0000","last_clean":"2024-03-25T06:01:30.046447+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T06:01:30.046447+0000","last_undegraded":"2024-03-25T06:01:30.046447+0000","last_fullsized":"2024-03-25T06:01:30.046447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'6161","reported_seq":6322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.736152+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T06:03:53.736152+0000","last_peered":"2024-03-25T06:03:53.736152+0000","last_clean":"2024-03-25T06:03:53.736152+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T06:03:53.736152+0000","last_undegraded":"2024-03-25T06:03:53.736152+0000","last_fullsized":"2024-03-25T06:03:53.736152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6161,"log_dups_size":0,"ondisk_log_size":6161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":32512,"num_write":4374,"num_write_kb":123745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1723","reported_seq":1760,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.296900+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T06:03:54.296900+0000","last_peered":"2024-03-25T06:03:54.296900+0000","last_clean":"2024-03-25T06:03:54.296900+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T06:03:54.296900+0000","last_undegraded":"2024-03-25T06:03:54.296900+0000","last_fullsized":"2024-03-25T06:03:54.296900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5041","reported_seq":5080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:30.115854+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T06:03:30.115854+0000","last_peered":"2024-03-25T06:03:30.115854+0000","last_clean":"2024-03-25T06:03:30.115854+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T06:03:30.115854+0000","last_undegraded":"2024-03-25T06:03:30.115854+0000","last_fullsized":"2024-03-25T06:03:30.115854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5041,"log_dups_size":0,"ondisk_log_size":5041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390032,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5032,"num_write_kb":40184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'6515","reported_seq":6836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.481682+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T06:03:54.481682+0000","last_peered":"2024-03-25T06:03:54.481682+0000","last_clean":"2024-03-25T06:03:54.481682+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T06:03:54.481682+0000","last_undegraded":"2024-03-25T06:03:54.481682+0000","last_fullsized":"2024-03-25T06:03:54.481682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6515,"log_dups_size":0,"ondisk_log_size":6515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":73152,"num_write":4685,"num_write_kb":118227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1742","reported_seq":1784,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.201016+0000","last_change":"2024-03-25T05:38:20.652252+0000","last_active":"2024-03-25T06:03:51.201016+0000","last_peered":"2024-03-25T06:03:51.201016+0000","last_clean":"2024-03-25T06:03:51.201016+0000","last_became_active":"2024-03-25T05:38:20.652010+0000","last_became_peered":"2024-03-25T05:38:20.652010+0000","last_unstale":"2024-03-25T06:03:51.201016+0000","last_undegraded":"2024-03-25T06:03:51.201016+0000","last_fullsized":"2024-03-25T06:03:51.201016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:19.423056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5678","reported_seq":5717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.730560+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T06:03:54.730560+0000","last_peered":"2024-03-25T06:03:54.730560+0000","last_clean":"2024-03-25T06:03:54.730560+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T06:03:54.730560+0000","last_undegraded":"2024-03-25T06:03:54.730560+0000","last_fullsized":"2024-03-25T06:03:54.730560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5678,"log_dups_size":0,"ondisk_log_size":5678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5688,"num_write_kb":44802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'6237","reported_seq":6602,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.992859+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T06:03:58.992859+0000","last_peered":"2024-03-25T06:03:58.992859+0000","last_clean":"2024-03-25T06:03:58.992859+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T06:03:58.992859+0000","last_undegraded":"2024-03-25T06:03:58.992859+0000","last_fullsized":"2024-03-25T06:03:58.992859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6237,"log_dups_size":0,"ondisk_log_size":6237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335872,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":84582,"num_write":4339,"num_write_kb":115405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1658","reported_seq":1695,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.693539+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T06:03:53.693539+0000","last_peered":"2024-03-25T06:03:53.693539+0000","last_clean":"2024-03-25T06:03:53.693539+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T06:03:53.693539+0000","last_undegraded":"2024-03-25T06:03:53.693539+0000","last_fullsized":"2024-03-25T06:03:53.693539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1658,"log_dups_size":0,"ondisk_log_size":1658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5642","reported_seq":5681,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:02:28.428077+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T06:02:28.428077+0000","last_peered":"2024-03-25T06:02:28.428077+0000","last_clean":"2024-03-25T06:02:28.428077+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T06:02:28.428077+0000","last_undegraded":"2024-03-25T06:02:28.428077+0000","last_fullsized":"2024-03-25T06:02:28.428077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5640,"num_write_kb":40587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'6749","reported_seq":7090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.396662+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T06:03:54.396662+0000","last_peered":"2024-03-25T06:03:54.396662+0000","last_clean":"2024-03-25T06:03:54.396662+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T06:03:54.396662+0000","last_undegraded":"2024-03-25T06:03:54.396662+0000","last_fullsized":"2024-03-25T06:03:54.396662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6749,"log_dups_size":0,"ondisk_log_size":6749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":78232,"num_write":4935,"num_write_kb":116647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1743","reported_seq":1780,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.188773+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T06:03:54.188773+0000","last_peered":"2024-03-25T06:03:54.188773+0000","last_clean":"2024-03-25T06:03:54.188773+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T06:03:54.188773+0000","last_undegraded":"2024-03-25T06:03:54.188773+0000","last_fullsized":"2024-03-25T06:03:54.188773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3454","reported_seq":3493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.684095+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T06:03:54.684095+0000","last_peered":"2024-03-25T06:03:54.684095+0000","last_clean":"2024-03-25T06:03:54.684095+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T06:03:54.684095+0000","last_undegraded":"2024-03-25T06:03:54.684095+0000","last_fullsized":"2024-03-25T06:03:54.684095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3453,"num_write_kb":26898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'6082","reported_seq":6150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.105456+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T06:03:52.105456+0000","last_peered":"2024-03-25T06:03:52.105456+0000","last_clean":"2024-03-25T06:03:52.105456+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T06:03:52.105456+0000","last_undegraded":"2024-03-25T06:03:52.105456+0000","last_fullsized":"2024-03-25T06:03:52.105456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6082,"log_dups_size":0,"ondisk_log_size":6082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431670,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":8890,"num_write":4232,"num_write_kb":109973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1744","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.390093+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T06:03:54.390093+0000","last_peered":"2024-03-25T06:03:54.390093+0000","last_clean":"2024-03-25T06:03:54.390093+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T06:03:54.390093+0000","last_undegraded":"2024-03-25T06:03:54.390093+0000","last_fullsized":"2024-03-25T06:03:54.390093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1744,"log_dups_size":0,"ondisk_log_size":1744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'2585","reported_seq":2624,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.730595+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T06:03:54.730595+0000","last_peered":"2024-03-25T06:03:54.730595+0000","last_clean":"2024-03-25T06:03:54.730595+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T06:03:54.730595+0000","last_undegraded":"2024-03-25T06:03:54.730595+0000","last_fullsized":"2024-03-25T06:03:54.730595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2585,"log_dups_size":0,"ondisk_log_size":2585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2603,"num_write_kb":18105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'6133","reported_seq":6456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.032625+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T06:03:59.032625+0000","last_peered":"2024-03-25T06:03:59.032625+0000","last_clean":"2024-03-25T06:03:59.032625+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T06:03:59.032625+0000","last_undegraded":"2024-03-25T06:03:59.032625+0000","last_fullsized":"2024-03-25T06:03:59.032625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6133,"log_dups_size":0,"ondisk_log_size":6133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052933,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":74168,"num_write":4306,"num_write_kb":103632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1667","reported_seq":1703,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.511800+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T06:03:54.511800+0000","last_peered":"2024-03-25T06:03:54.511800+0000","last_clean":"2024-03-25T06:03:54.511800+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T06:03:54.511800+0000","last_undegraded":"2024-03-25T06:03:54.511800+0000","last_fullsized":"2024-03-25T06:03:54.511800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1667,"log_dups_size":0,"ondisk_log_size":1667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3092","reported_seq":3130,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.698578+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T06:03:54.698578+0000","last_peered":"2024-03-25T06:03:54.698578+0000","last_clean":"2024-03-25T06:03:54.698578+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T06:03:54.698578+0000","last_undegraded":"2024-03-25T06:03:54.698578+0000","last_fullsized":"2024-03-25T06:03:54.698578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3092,"log_dups_size":0,"ondisk_log_size":3092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195146,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3109,"num_write_kb":22544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'6001","reported_seq":6449,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.218345+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T06:03:54.218345+0000","last_peered":"2024-03-25T06:03:54.218345+0000","last_clean":"2024-03-25T06:03:54.218345+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T06:03:54.218345+0000","last_undegraded":"2024-03-25T06:03:54.218345+0000","last_fullsized":"2024-03-25T06:03:54.218345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6001,"log_dups_size":0,"ondisk_log_size":6001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:50.989171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":105918,"num_write":4133,"num_write_kb":116215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1729","reported_seq":1766,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.675825+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T06:03:53.675825+0000","last_peered":"2024-03-25T06:03:53.675825+0000","last_clean":"2024-03-25T06:03:53.675825+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T06:03:53.675825+0000","last_undegraded":"2024-03-25T06:03:53.675825+0000","last_fullsized":"2024-03-25T06:03:53.675825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'848","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.742196+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T06:03:54.742196+0000","last_peered":"2024-03-25T06:03:54.742196+0000","last_clean":"2024-03-25T06:03:54.742196+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T06:03:54.742196+0000","last_undegraded":"2024-03-25T06:03:54.742196+0000","last_fullsized":"2024-03-25T06:03:54.742196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":860,"num_write_kb":8739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5767","reported_seq":5997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.226440+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T06:03:54.226440+0000","last_peered":"2024-03-25T06:03:54.226440+0000","last_clean":"2024-03-25T06:03:54.226440+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T06:03:54.226440+0000","last_undegraded":"2024-03-25T06:03:54.226440+0000","last_fullsized":"2024-03-25T06:03:54.226440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5767,"log_dups_size":0,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:14:50.068275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":50292,"num_write":4003,"num_write_kb":127231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1739","reported_seq":1775,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.185107+0000","last_change":"2024-03-25T05:37:31.149941+0000","last_active":"2024-03-25T06:03:59.185107+0000","last_peered":"2024-03-25T06:03:59.185107+0000","last_clean":"2024-03-25T06:03:59.185107+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T06:03:59.185107+0000","last_undegraded":"2024-03-25T06:03:59.185107+0000","last_fullsized":"2024-03-25T06:03:59.185107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:24:40.019842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'3793","reported_seq":3831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.678912+0000","last_change":"2024-03-25T05:37:30.419153+0000","last_active":"2024-03-25T06:03:54.678912+0000","last_peered":"2024-03-25T06:03:54.678912+0000","last_clean":"2024-03-25T06:03:54.678912+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T06:03:54.678912+0000","last_undegraded":"2024-03-25T06:03:54.678912+0000","last_fullsized":"2024-03-25T06:03:54.678912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:16:01.889443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3799,"num_write_kb":31202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5792","reported_seq":5877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.268744+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T06:03:54.268744+0000","last_peered":"2024-03-25T06:03:54.268744+0000","last_clean":"2024-03-25T06:03:54.268744+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T06:03:54.268744+0000","last_undegraded":"2024-03-25T06:03:54.268744+0000","last_fullsized":"2024-03-25T06:03:54.268744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5792,"log_dups_size":0,"ondisk_log_size":5792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":13716,"num_write":3985,"num_write_kb":98790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1656","reported_seq":1692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.934764+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T06:03:50.934764+0000","last_peered":"2024-03-25T06:03:50.934764+0000","last_clean":"2024-03-25T06:03:50.934764+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T06:03:50.934764+0000","last_undegraded":"2024-03-25T06:03:50.934764+0000","last_fullsized":"2024-03-25T06:03:50.934764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1656,"log_dups_size":0,"ondisk_log_size":1656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'6610","reported_seq":7248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.736476+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T06:03:54.736476+0000","last_peered":"2024-03-25T06:03:54.736476+0000","last_clean":"2024-03-25T06:03:54.736476+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T06:03:54.736476+0000","last_undegraded":"2024-03-25T06:03:54.736476+0000","last_fullsized":"2024-03-25T06:03:54.736476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15601385,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":600,"num_read_kb":3799,"num_write":6621,"num_write_kb":48470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5988","reported_seq":6230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.179221+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T06:03:54.179221+0000","last_peered":"2024-03-25T06:03:54.179221+0000","last_clean":"2024-03-25T06:03:54.179221+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T06:03:54.179221+0000","last_undegraded":"2024-03-25T06:03:54.179221+0000","last_fullsized":"2024-03-25T06:03:54.179221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5988,"log_dups_size":0,"ondisk_log_size":5988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260736,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":4183,"num_write_kb":127483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1705","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.028113+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T06:03:54.028113+0000","last_peered":"2024-03-25T06:03:54.028113+0000","last_clean":"2024-03-25T06:03:54.028113+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T06:03:54.028113+0000","last_undegraded":"2024-03-25T06:03:54.028113+0000","last_fullsized":"2024-03-25T06:03:54.028113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5364","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731252+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T06:03:54.731252+0000","last_peered":"2024-03-25T06:03:54.731252+0000","last_clean":"2024-03-25T06:03:54.731252+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T06:03:54.731252+0000","last_undegraded":"2024-03-25T06:03:54.731252+0000","last_fullsized":"2024-03-25T06:03:54.731252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5364,"log_dups_size":0,"ondisk_log_size":5364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5367,"num_write_kb":32641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5993","reported_seq":6080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.718186+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T06:03:53.718186+0000","last_peered":"2024-03-25T06:03:53.718186+0000","last_clean":"2024-03-25T06:03:53.718186+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T06:03:53.718186+0000","last_undegraded":"2024-03-25T06:03:53.718186+0000","last_fullsized":"2024-03-25T06:03:53.718186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5993,"log_dups_size":0,"ondisk_log_size":5993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365760,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":13970,"num_write":4176,"num_write_kb":117168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1733","reported_seq":1773,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.227863+0000","last_change":"2024-03-25T05:38:20.652289+0000","last_active":"2024-03-25T06:03:59.227863+0000","last_peered":"2024-03-25T06:03:59.227863+0000","last_clean":"2024-03-25T06:03:59.227863+0000","last_became_active":"2024-03-25T05:38:20.652007+0000","last_became_peered":"2024-03-25T05:38:20.652007+0000","last_unstale":"2024-03-25T06:03:59.227863+0000","last_undegraded":"2024-03-25T06:03:59.227863+0000","last_fullsized":"2024-03-25T06:03:59.227863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:15:33.110431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5604","reported_seq":5642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.695714+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T06:03:54.695714+0000","last_peered":"2024-03-25T06:03:54.695714+0000","last_clean":"2024-03-25T06:03:54.695714+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T06:03:54.695714+0000","last_undegraded":"2024-03-25T06:03:54.695714+0000","last_fullsized":"2024-03-25T06:03:54.695714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5607,"num_write_kb":40642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5709","reported_seq":6160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.520071+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T06:03:54.520071+0000","last_peered":"2024-03-25T06:03:54.520071+0000","last_clean":"2024-03-25T06:03:54.520071+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T06:03:54.520071+0000","last_undegraded":"2024-03-25T06:03:54.520071+0000","last_fullsized":"2024-03-25T06:03:54.520071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5709,"log_dups_size":0,"ondisk_log_size":5709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:27:40.435483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":106426,"num_write":4010,"num_write_kb":116755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1692","reported_seq":1728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.711024+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T06:03:53.711024+0000","last_peered":"2024-03-25T06:03:53.711024+0000","last_clean":"2024-03-25T06:03:53.711024+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T06:03:53.711024+0000","last_undegraded":"2024-03-25T06:03:53.711024+0000","last_fullsized":"2024-03-25T06:03:53.711024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4517","reported_seq":5355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.705336+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T06:03:54.705336+0000","last_peered":"2024-03-25T06:03:54.705336+0000","last_clean":"2024-03-25T06:03:54.705336+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T06:03:54.705336+0000","last_undegraded":"2024-03-25T06:03:54.705336+0000","last_fullsized":"2024-03-25T06:03:54.705336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4517,"log_dups_size":0,"ondisk_log_size":4517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":802,"num_read_kb":4614,"num_write":4524,"num_write_kb":35758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6263","reported_seq":6658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.401210+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T06:03:54.401210+0000","last_peered":"2024-03-25T06:03:54.401210+0000","last_clean":"2024-03-25T06:03:54.401210+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T06:03:54.401210+0000","last_undegraded":"2024-03-25T06:03:54.401210+0000","last_fullsized":"2024-03-25T06:03:54.401210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6263,"log_dups_size":0,"ondisk_log_size":6263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:25:03.802329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74402,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":363,"num_read_kb":92202,"num_write":4366,"num_write_kb":119516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5991","reported_seq":6089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.030228+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T06:03:59.030228+0000","last_peered":"2024-03-25T06:03:59.030228+0000","last_clean":"2024-03-25T06:03:59.030228+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T06:03:59.030228+0000","last_undegraded":"2024-03-25T06:03:59.030228+0000","last_fullsized":"2024-03-25T06:03:59.030228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5991,"log_dups_size":0,"ondisk_log_size":5991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268288,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":4230,"num_write_kb":107763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1670","reported_seq":1706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.067757+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T06:03:54.067757+0000","last_peered":"2024-03-25T06:03:54.067757+0000","last_clean":"2024-03-25T06:03:54.067757+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T06:03:54.067757+0000","last_undegraded":"2024-03-25T06:03:54.067757+0000","last_fullsized":"2024-03-25T06:03:54.067757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'8146","reported_seq":8184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.709010+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T06:03:54.709010+0000","last_peered":"2024-03-25T06:03:54.709010+0000","last_clean":"2024-03-25T06:03:54.709010+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T06:03:54.709010+0000","last_undegraded":"2024-03-25T06:03:54.709010+0000","last_fullsized":"2024-03-25T06:03:54.709010+0000","mapping_epoch":17,"log_start":"27'600","ondisk_log_start":"27'600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7546,"log_dups_size":0,"ondisk_log_size":7546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8142,"num_write_kb":58721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'6004","reported_seq":6326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.091602+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T06:03:54.091602+0000","last_peered":"2024-03-25T06:03:54.091602+0000","last_clean":"2024-03-25T06:03:54.091602+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T06:03:54.091602+0000","last_undegraded":"2024-03-25T06:03:54.091602+0000","last_fullsized":"2024-03-25T06:03:54.091602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6004,"log_dups_size":0,"ondisk_log_size":6004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74402,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":73406,"num_write":4229,"num_write_kb":113314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1743","reported_seq":1778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.090733+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T06:03:52.090733+0000","last_peered":"2024-03-25T06:03:52.090733+0000","last_clean":"2024-03-25T06:03:52.090733+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T06:03:52.090733+0000","last_undegraded":"2024-03-25T06:03:52.090733+0000","last_fullsized":"2024-03-25T06:03:52.090733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4099","reported_seq":4136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:08.398796+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T06:03:08.398796+0000","last_peered":"2024-03-25T06:03:08.398796+0000","last_clean":"2024-03-25T06:03:08.398796+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T06:03:08.398796+0000","last_undegraded":"2024-03-25T06:03:08.398796+0000","last_fullsized":"2024-03-25T06:03:08.398796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4099,"log_dups_size":0,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4095,"num_write_kb":35371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7947","reported_seq":7984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.659082+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T06:03:54.659082+0000","last_peered":"2024-03-25T06:03:54.659082+0000","last_clean":"2024-03-25T06:03:54.659082+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T06:03:54.659082+0000","last_undegraded":"2024-03-25T06:03:54.659082+0000","last_fullsized":"2024-03-25T06:03:54.659082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7947,"log_dups_size":0,"ondisk_log_size":7947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7943,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1689","reported_seq":1724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219387+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T06:03:59.219387+0000","last_peered":"2024-03-25T06:03:59.219387+0000","last_clean":"2024-03-25T06:03:59.219387+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T06:03:59.219387+0000","last_undegraded":"2024-03-25T06:03:59.219387+0000","last_fullsized":"2024-03-25T06:03:59.219387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1689,"log_dups_size":0,"ondisk_log_size":1689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'6116","reported_seq":6228,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.542464+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T06:03:54.542464+0000","last_peered":"2024-03-25T06:03:54.542464+0000","last_clean":"2024-03-25T06:03:54.542464+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T06:03:54.542464+0000","last_undegraded":"2024-03-25T06:03:54.542464+0000","last_fullsized":"2024-03-25T06:03:54.542464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6116,"log_dups_size":0,"ondisk_log_size":6116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:24.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":4275,"num_write_kb":113262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6308","reported_seq":6345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.654487+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T06:03:54.654487+0000","last_peered":"2024-03-25T06:03:54.654487+0000","last_clean":"2024-03-25T06:03:54.654487+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T06:03:54.654487+0000","last_undegraded":"2024-03-25T06:03:54.654487+0000","last_fullsized":"2024-03-25T06:03:54.654487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6308,"log_dups_size":0,"ondisk_log_size":6308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166700,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6300,"num_write_kb":53213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1715","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.084504+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T06:03:54.084504+0000","last_peered":"2024-03-25T06:03:54.084504+0000","last_clean":"2024-03-25T06:03:54.084504+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T06:03:54.084504+0000","last_undegraded":"2024-03-25T06:03:54.084504+0000","last_fullsized":"2024-03-25T06:03:54.084504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'6475","reported_seq":6968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.475889+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T06:03:54.475889+0000","last_peered":"2024-03-25T06:03:54.475889+0000","last_clean":"2024-03-25T06:03:54.475889+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T06:03:54.475889+0000","last_undegraded":"2024-03-25T06:03:54.475889+0000","last_fullsized":"2024-03-25T06:03:54.475889+0000","mapping_epoch":22,"log_start":"27'200","ondisk_log_start":"27'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6275,"log_dups_size":0,"ondisk_log_size":6275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:08:02.386273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2195264,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":117348,"num_write":4678,"num_write_kb":179166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1668","reported_seq":1705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.141247+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T06:03:54.141247+0000","last_peered":"2024-03-25T06:03:54.141247+0000","last_clean":"2024-03-25T06:03:54.141247+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T06:03:54.141247+0000","last_undegraded":"2024-03-25T06:03:54.141247+0000","last_fullsized":"2024-03-25T06:03:54.141247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1751","reported_seq":1794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:49.804346+0000","last_change":"2024-03-25T05:38:20.652638+0000","last_active":"2024-03-25T06:03:49.804346+0000","last_peered":"2024-03-25T06:03:49.804346+0000","last_clean":"2024-03-25T06:03:49.804346+0000","last_became_active":"2024-03-25T05:38:20.652189+0000","last_became_peered":"2024-03-25T05:38:20.652189+0000","last_unstale":"2024-03-25T06:03:49.804346+0000","last_undegraded":"2024-03-25T06:03:49.804346+0000","last_fullsized":"2024-03-25T06:03:49.804346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1670","reported_seq":1708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.645425+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T06:03:52.645425+0000","last_peered":"2024-03-25T06:03:52.645425+0000","last_clean":"2024-03-25T06:03:52.645425+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T06:03:52.645425+0000","last_undegraded":"2024-03-25T06:03:52.645425+0000","last_fullsized":"2024-03-25T06:03:52.645425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1790","reported_seq":1827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.255566+0000","last_change":"2024-03-25T05:37:31.164026+0000","last_active":"2024-03-25T06:03:59.255566+0000","last_peered":"2024-03-25T06:03:59.255566+0000","last_clean":"2024-03-25T06:03:59.255566+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T06:03:59.255566+0000","last_undegraded":"2024-03-25T06:03:59.255566+0000","last_fullsized":"2024-03-25T06:03:59.255566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1715","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.520282+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T06:03:54.520282+0000","last_peered":"2024-03-25T06:03:54.520282+0000","last_clean":"2024-03-25T06:03:54.520282+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T06:03:54.520282+0000","last_undegraded":"2024-03-25T06:03:54.520282+0000","last_fullsized":"2024-03-25T06:03:54.520282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1671","reported_seq":1709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.734156+0000","last_change":"2024-03-25T05:37:31.166178+0000","last_active":"2024-03-25T06:03:53.734156+0000","last_peered":"2024-03-25T06:03:53.734156+0000","last_clean":"2024-03-25T06:03:53.734156+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T06:03:53.734156+0000","last_undegraded":"2024-03-25T06:03:53.734156+0000","last_fullsized":"2024-03-25T06:03:53.734156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1749","reported_seq":1786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.779900+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T06:03:53.779900+0000","last_peered":"2024-03-25T06:03:53.779900+0000","last_clean":"2024-03-25T06:03:53.779900+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T06:03:53.779900+0000","last_undegraded":"2024-03-25T06:03:53.779900+0000","last_fullsized":"2024-03-25T06:03:53.779900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1712","reported_seq":1749,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.108884+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T06:03:54.108884+0000","last_peered":"2024-03-25T06:03:54.108884+0000","last_clean":"2024-03-25T06:03:54.108884+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T06:03:54.108884+0000","last_undegraded":"2024-03-25T06:03:54.108884+0000","last_fullsized":"2024-03-25T06:03:54.108884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1687","reported_seq":1725,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.991957+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T06:03:53.991957+0000","last_peered":"2024-03-25T06:03:53.991957+0000","last_clean":"2024-03-25T06:03:53.991957+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T06:03:53.991957+0000","last_undegraded":"2024-03-25T06:03:53.991957+0000","last_fullsized":"2024-03-25T06:03:53.991957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1687,"log_dups_size":0,"ondisk_log_size":1687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1721","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.522746+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T06:03:51.522746+0000","last_peered":"2024-03-25T06:03:51.522746+0000","last_clean":"2024-03-25T06:03:51.522746+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T06:03:51.522746+0000","last_undegraded":"2024-03-25T06:03:51.522746+0000","last_fullsized":"2024-03-25T06:03:51.522746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1721","reported_seq":1758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.454892+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T06:03:54.454892+0000","last_peered":"2024-03-25T06:03:54.454892+0000","last_clean":"2024-03-25T06:03:54.454892+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T06:03:54.454892+0000","last_undegraded":"2024-03-25T06:03:54.454892+0000","last_fullsized":"2024-03-25T06:03:54.454892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1756","reported_seq":1792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219689+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T06:03:59.219689+0000","last_peered":"2024-03-25T06:03:59.219689+0000","last_clean":"2024-03-25T06:03:59.219689+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T06:03:59.219689+0000","last_undegraded":"2024-03-25T06:03:59.219689+0000","last_fullsized":"2024-03-25T06:03:59.219689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1721","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.143173+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T06:03:52.143173+0000","last_peered":"2024-03-25T06:03:52.143173+0000","last_clean":"2024-03-25T06:03:52.143173+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T06:03:52.143173+0000","last_undegraded":"2024-03-25T06:03:52.143173+0000","last_fullsized":"2024-03-25T06:03:52.143173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1764","reported_seq":1801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.241081+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T06:03:54.241081+0000","last_peered":"2024-03-25T06:03:54.241081+0000","last_clean":"2024-03-25T06:03:54.241081+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T06:03:54.241081+0000","last_undegraded":"2024-03-25T06:03:54.241081+0000","last_fullsized":"2024-03-25T06:03:54.241081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1670","reported_seq":1707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.080061+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T06:03:50.080061+0000","last_peered":"2024-03-25T06:03:50.080061+0000","last_clean":"2024-03-25T06:03:50.080061+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T06:03:50.080061+0000","last_undegraded":"2024-03-25T06:03:50.080061+0000","last_fullsized":"2024-03-25T06:03:50.080061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1712","reported_seq":1749,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.135484+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T06:03:54.135484+0000","last_peered":"2024-03-25T06:03:54.135484+0000","last_clean":"2024-03-25T06:03:54.135484+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T06:03:54.135484+0000","last_undegraded":"2024-03-25T06:03:54.135484+0000","last_fullsized":"2024-03-25T06:03:54.135484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'1631","reported_seq":1668,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.535878+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T06:03:53.535878+0000","last_peered":"2024-03-25T06:03:53.535878+0000","last_clean":"2024-03-25T06:03:53.535878+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T06:03:53.535878+0000","last_undegraded":"2024-03-25T06:03:53.535878+0000","last_fullsized":"2024-03-25T06:03:53.535878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'1756","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.905819+0000","last_change":"2024-03-25T05:38:20.652965+0000","last_active":"2024-03-25T06:03:53.905819+0000","last_peered":"2024-03-25T06:03:53.905819+0000","last_clean":"2024-03-25T06:03:53.905819+0000","last_became_active":"2024-03-25T05:38:20.652582+0000","last_became_peered":"2024-03-25T05:38:20.652582+0000","last_unstale":"2024-03-25T06:03:53.905819+0000","last_undegraded":"2024-03-25T06:03:53.905819+0000","last_fullsized":"2024-03-25T06:03:53.905819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:25.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1702","reported_seq":1738,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.226036+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T06:03:59.226036+0000","last_peered":"2024-03-25T06:03:59.226036+0000","last_clean":"2024-03-25T06:03:59.226036+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T06:03:59.226036+0000","last_undegraded":"2024-03-25T06:03:59.226036+0000","last_fullsized":"2024-03-25T06:03:59.226036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1702,"log_dups_size":0,"ondisk_log_size":1702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:20.495852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1680","reported_seq":1715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.078984+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T06:03:52.078984+0000","last_peered":"2024-03-25T06:03:52.078984+0000","last_clean":"2024-03-25T06:03:52.078984+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T06:03:52.078984+0000","last_undegraded":"2024-03-25T06:03:52.078984+0000","last_fullsized":"2024-03-25T06:03:52.078984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1615","reported_seq":1651,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.791866+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T06:03:53.791866+0000","last_peered":"2024-03-25T06:03:53.791866+0000","last_clean":"2024-03-25T06:03:53.791866+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T06:03:53.791866+0000","last_undegraded":"2024-03-25T06:03:53.791866+0000","last_fullsized":"2024-03-25T06:03:53.791866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1671","reported_seq":1706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.257610+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T06:03:54.257610+0000","last_peered":"2024-03-25T06:03:54.257610+0000","last_clean":"2024-03-25T06:03:54.257610+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T06:03:54.257610+0000","last_undegraded":"2024-03-25T06:03:54.257610+0000","last_fullsized":"2024-03-25T06:03:54.257610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1729","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.551808+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T06:03:53.551808+0000","last_peered":"2024-03-25T06:03:53.551808+0000","last_clean":"2024-03-25T06:03:53.551808+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T06:03:53.551808+0000","last_undegraded":"2024-03-25T06:03:53.551808+0000","last_fullsized":"2024-03-25T06:03:53.551808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1754","reported_seq":1790,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.143674+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T06:03:54.143674+0000","last_peered":"2024-03-25T06:03:54.143674+0000","last_clean":"2024-03-25T06:03:54.143674+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T06:03:54.143674+0000","last_undegraded":"2024-03-25T06:03:54.143674+0000","last_fullsized":"2024-03-25T06:03:54.143674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1692","reported_seq":1727,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.366948+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T06:03:54.366948+0000","last_peered":"2024-03-25T06:03:54.366948+0000","last_clean":"2024-03-25T06:03:54.366948+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T06:03:54.366948+0000","last_undegraded":"2024-03-25T06:03:54.366948+0000","last_fullsized":"2024-03-25T06:03:54.366948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1671","reported_seq":1691,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.980717+0000","last_change":"2024-03-25T05:38:20.655980+0000","last_active":"2024-03-25T06:03:53.980717+0000","last_peered":"2024-03-25T06:03:53.980717+0000","last_clean":"2024-03-25T06:03:53.980717+0000","last_became_active":"2024-03-25T05:38:20.655743+0000","last_became_peered":"2024-03-25T05:38:20.655743+0000","last_unstale":"2024-03-25T06:03:53.980717+0000","last_undegraded":"2024-03-25T06:03:53.980717+0000","last_fullsized":"2024-03-25T06:03:53.980717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1649","reported_seq":1685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.294852+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T06:03:54.294852+0000","last_peered":"2024-03-25T06:03:54.294852+0000","last_clean":"2024-03-25T06:03:54.294852+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T06:03:54.294852+0000","last_undegraded":"2024-03-25T06:03:54.294852+0000","last_fullsized":"2024-03-25T06:03:54.294852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1743","reported_seq":1779,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.444157+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T06:03:54.444157+0000","last_peered":"2024-03-25T06:03:54.444157+0000","last_clean":"2024-03-25T06:03:54.444157+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T06:03:54.444157+0000","last_undegraded":"2024-03-25T06:03:54.444157+0000","last_fullsized":"2024-03-25T06:03:54.444157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1735","reported_seq":1774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.377939+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T06:03:54.377939+0000","last_peered":"2024-03-25T06:03:54.377939+0000","last_clean":"2024-03-25T06:03:54.377939+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T06:03:54.377939+0000","last_undegraded":"2024-03-25T06:03:54.377939+0000","last_fullsized":"2024-03-25T06:03:54.377939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1790","reported_seq":1827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219156+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T06:03:59.219156+0000","last_peered":"2024-03-25T06:03:59.219156+0000","last_clean":"2024-03-25T06:03:59.219156+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T06:03:59.219156+0000","last_undegraded":"2024-03-25T06:03:59.219156+0000","last_fullsized":"2024-03-25T06:03:59.219156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1653","reported_seq":1691,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.048440+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T06:03:54.048440+0000","last_peered":"2024-03-25T06:03:54.048440+0000","last_clean":"2024-03-25T06:03:54.048440+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T06:03:54.048440+0000","last_undegraded":"2024-03-25T06:03:54.048440+0000","last_fullsized":"2024-03-25T06:03:54.048440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1653,"log_dups_size":0,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1632","reported_seq":1670,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.165893+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T06:03:50.165893+0000","last_peered":"2024-03-25T06:03:50.165893+0000","last_clean":"2024-03-25T06:03:50.165893+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T06:03:50.165893+0000","last_undegraded":"2024-03-25T06:03:50.165893+0000","last_fullsized":"2024-03-25T06:03:50.165893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":16475339,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":5893,"num_read_kb":1496822,"num_write":138176,"num_write_kb":3811190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2846720,"data_stored":32432128,"data_compressed":1517935,"data_compressed_allocated":2170880,"data_compressed_original":31756288,"omap_allocated":0,"internal_metadata":0},"log_size":195818,"ondisk_log_size":195818,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109510,"ondisk_log_size":109510,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":233712377,"num_objects":156,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":156,"num_whiteouts":0,"num_read":2368,"num_read_kb":13141,"num_write":159035,"num_write_kb":1156715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":312238080,"data_stored":467424754,"data_compressed":49492176,"data_compressed_allocated":73285632,"data_compressed_original":228712448,"omap_allocated":0,"internal_metadata":0},"log_size":154446,"ondisk_log_size":154446,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575168,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":762856,"kb_used_data":37600,"kb_used_omap":1,"kb_used_meta":725246,"kb_avail":93608984,"statfs":{"total":96636764160,"available":95855599616,"internally_reserved":0,"allocated":38502400,"data_stored":61630114,"data_compressed":6637588,"data_compressed_allocated":9715712,"data_compressed_original":33050624,"omap_allocated":1590,"internal_metadata":742652362},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575169,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":832708,"kb_used_data":47868,"kb_used_omap":1,"kb_used_meta":784830,"kb_avail":93539132,"statfs":{"total":96636764160,"available":95784071168,"internally_reserved":0,"allocated":49016832,"data_stored":81890893,"data_compressed":8454916,"data_compressed_allocated":12382208,"data_compressed_original":45449216,"omap_allocated":1594,"internal_metadata":803666374},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575168,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":798280,"kb_used_data":41088,"kb_used_omap":1,"kb_used_meta":757182,"kb_avail":93573560,"statfs":{"total":96636764160,"available":95819325440,"internally_reserved":0,"allocated":42074112,"data_stored":64998314,"data_compressed":6265657,"data_compressed_allocated":9469952,"data_compressed_original":32608256,"omap_allocated":1595,"internal_metadata":775354821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575168,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":722028,"kb_used_data":37028,"kb_used_omap":1,"kb_used_meta":684990,"kb_avail":93649812,"statfs":{"total":96636764160,"available":95897407488,"internally_reserved":0,"allocated":37916672,"data_stored":59007360,"data_compressed":5831432,"data_compressed_allocated":8654848,"data_compressed_original":29937664,"omap_allocated":1595,"internal_metadata":701430213},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575166,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":850692,"kb_used_data":57596,"kb_used_omap":1,"kb_used_meta":793086,"kb_avail":93521148,"statfs":{"total":96636764160,"available":95765655552,"internally_reserved":0,"allocated":58978304,"data_stored":94809711,"data_compressed":10106287,"data_compressed_allocated":14716928,"data_compressed_original":50745344,"omap_allocated":1593,"internal_metadata":812120519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457484,"kb_used_data":29380,"kb_used_omap":1,"kb_used_meta":428094,"kb_avail":93914356,"statfs":{"total":96636764160,"available":96168300544,"internally_reserved":0,"allocated":30085120,"data_stored":47804932,"data_compressed":4488376,"data_compressed_allocated":6733824,"data_compressed_original":24653824,"omap_allocated":1595,"internal_metadata":438368709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575167,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":882604,"kb_used_data":31140,"kb_used_omap":1,"kb_used_meta":851454,"kb_avail":93489236,"statfs":{"total":96636764160,"available":95732977664,"internally_reserved":0,"allocated":31887360,"data_stored":51585356,"data_compressed":5040023,"data_compressed_allocated":7471104,"data_compressed_original":27365376,"omap_allocated":1595,"internal_metadata":871889349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575168,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569564,"kb_used_data":28948,"kb_used_omap":1,"kb_used_meta":540606,"kb_avail":93802276,"statfs":{"total":96636764160,"available":96053530624,"internally_reserved":0,"allocated":29642752,"data_stored":47853786,"data_compressed":4606583,"data_compressed_allocated":6889472,"data_compressed_original":25300992,"omap_allocated":1595,"internal_metadata":553580997},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28741632,"data_stored":41943914,"data_compressed":4333814,"data_compressed_allocated":6488064,"data_compressed_original":19718144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31145984,"data_stored":46138876,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29335552,"data_stored":41944756,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58363904,"data_stored":91099935,"data_compressed":9938069,"data_compressed_allocated":14479360,"data_compressed_original":47243264,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37269504,"data_stored":54527536,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41308160,"data_stored":58724442,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":74322685,"data_compressed":8104798,"data_compressed_allocated":11894784,"data_compressed_original":38100992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37933056,"data_stored":58722610,"data_compressed":6502788,"data_compressed_allocated":9523200,"data_compressed_original":30347264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":4800512,"data_compressed":222366,"data_compressed_allocated":331776,"data_compressed_original":4653056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":5324800,"data_compressed":249368,"data_compressed_allocated":360448,"data_compressed_original":5234688,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":5738496,"data_compressed":269421,"data_compressed_allocated":380928,"data_compressed_original":5660672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":3588096,"data_compressed":168218,"data_compressed_allocated":237568,"data_compressed_original":3502080,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":4358144,"data_compressed":204710,"data_compressed_allocated":286720,"data_compressed_original":4288512,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":2035712,"data_compressed":95409,"data_compressed_allocated":135168,"data_compressed_original":1990656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":4390912,"data_compressed":206071,"data_compressed_allocated":290816,"data_compressed_original":4296704,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":2195456,"data_compressed":102372,"data_compressed_allocated":147456,"data_compressed_original":2129920,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T06:04:00.257 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T06:04:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.529+0000 7fefbda00640 1 Processor -- start 2024-03-25T06:04:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.529+0000 7fefbda00640 1 -- start start 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.530+0000 7fefbda00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb80c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.530+0000 7fefbda00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fefb80c6c10 0x7fefb80c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.530+0000 7fefbda00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80cbbe0 con 0x7fefb8154120 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.530+0000 7fefbda00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb8154500 con 0x7fefb80c6c10 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.530+0000 7fefbda00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb806b250 con 0x7fefb80c67e0 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefb7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb80c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefb7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb80c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38160/0 (socket says 172.21.15.102:38160) 2024-03-25T06:04:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefb7400640 1 -- 172.21.15.102:0/3177162629 learned_addr learned my addr 172.21.15.102:0/3177162629 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefbd000640 1 --2- 172.21.15.102:0/3177162629 >> v2:172.21.15.102:3300/0 conn(0x7fefb80c6c10 0x7fefb80c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefb7400640 1 -- 172.21.15.102:0/3177162629 >> v2:172.21.15.102:3300/0 conn(0x7fefb80c6c10 msgr2=0x7fefb80c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefb7400640 1 --2- 172.21.15.102:0/3177162629 >> v2:172.21.15.102:3300/0 conn(0x7fefb80c6c10 0x7fefb80c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefb7400640 1 -- 172.21.15.102:0/3177162629 >> v1:172.21.15.102:6789/0 conn(0x7fefb8154120 legacy=0x7fefb80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.531+0000 7fefb7400640 1 -- 172.21.15.102:0/3177162629 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80ca280 con 0x7fefb80c67e0 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.532+0000 7fefb7400640 1 --2- 172.21.15.102:0/3177162629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb80c7d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009870 tx=0x7fefa402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a5369684b10e58 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.532+0000 7fefb6a00640 1 -- 172.21.15.102:0/3177162629 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4031640 con 0x7fefb80c67e0 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.532+0000 7fefb6a00640 1 -- 172.21.15.102:0/3177162629 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40317a0 con 0x7fefb80c67e0 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.532+0000 7fefb6a00640 1 -- 172.21.15.102:0/3177162629 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4031b30 con 0x7fefb80c67e0 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 -- 172.21.15.102:0/3177162629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 msgr2=0x7fefb80c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 --2- 172.21.15.102:0/3177162629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb80c7d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009870 tx=0x7fefa402b8f0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 -- 172.21.15.102:0/3177162629 shutdown_connections 2024-03-25T06:04:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 --2- 172.21.15.102:0/3177162629 >> v2:172.21.15.102:3300/0 conn(0x7fefb80c6c10 0x7fefb80c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 --2- 172.21.15.102:0/3177162629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb80c7d00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 -- 172.21.15.102:0/3177162629 >> 172.21.15.102:0/3177162629 conn(0x7fefb80cf3e0 msgr2=0x7fefb80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:00.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 -- 172.21.15.102:0/3177162629 shutdown_connections 2024-03-25T06:04:00.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.533+0000 7fefbda00640 1 -- 172.21.15.102:0/3177162629 wait complete. 2024-03-25T06:04:00.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.535+0000 7fefbda00640 1 Processor -- start 2024-03-25T06:04:00.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.535+0000 7fefbda00640 1 -- start start 2024-03-25T06:04:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.536+0000 7fefbda00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb81e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.536+0000 7fefbda00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb80c6c10 0x7fefb814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.536+0000 7fefbda00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb8154120 0x7fefb814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.536+0000 7fefbda00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81f0580 con 0x7fefb80c6c10 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.536+0000 7fefbda00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81ef740 con 0x7fefb8154120 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.536+0000 7fefbda00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81efa00 con 0x7fefb80c67e0 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.536+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb81e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb81e61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38176/0 (socket says 172.21.15.102:38176) 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 -- 172.21.15.102:0/3093134891 learned_addr learned my addr 172.21.15.102:0/3093134891 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefbd000640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb8154120 0x7fefb814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7400640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb80c6c10 0x7fefb814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 -- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb8154120 msgr2=0x7fefb814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb8154120 0x7fefb814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 -- 172.21.15.102:0/3093134891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb80c6c10 msgr2=0x7fefb814a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb80c6c10 0x7fefb814a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 -- 172.21.15.102:0/3093134891 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa40094d0 con 0x7fefb80c67e0 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefbd000640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb8154120 0x7fefb814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7400640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb80c6c10 0x7fefb814a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefb7e00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb81e61a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fefa800c410 tx=0x7fefa800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.537+0000 7fefafe00640 1 -- 172.21.15.102:0/3093134891 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80035f0 con 0x7fefb80c67e0 2024-03-25T06:04:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.538+0000 7fefafe00640 1 -- 172.21.15.102:0/3093134891 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa8003750 con 0x7fefb80c67e0 2024-03-25T06:04:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.538+0000 7fefafe00640 1 -- 172.21.15.102:0/3093134891 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8003b40 con 0x7fefb80c67e0 2024-03-25T06:04:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.538+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb81efce0 con 0x7fefb80c67e0 2024-03-25T06:04:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.538+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb81f02a0 con 0x7fefb80c67e0 2024-03-25T06:04:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.539+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb8157bb0 con 0x7fefb80c67e0 2024-03-25T06:04:00.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.541+0000 7fefafe00640 1 -- 172.21.15.102:0/3093134891 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefa8003ca0 con 0x7fefb80c67e0 2024-03-25T06:04:00.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.542+0000 7fefafe00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fef9806b810 0x7fef9806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:00.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.542+0000 7fefafe00640 1 -- 172.21.15.102:0/3093134891 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fefa8089870 con 0x7fefb80c67e0 2024-03-25T06:04:00.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.542+0000 7fefb7400640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fef9806b810 0x7fef9806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:00.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.543+0000 7fefb7400640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fef9806b810 0x7fef9806dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefa4036000 tx=0x7fefa403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:00.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.550+0000 7fefafe00640 1 -- 172.21.15.102:0/3093134891 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fefb8157bb0 con 0x7fefb80c67e0 2024-03-25T06:04:00.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.844+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefb80ca4d0 con 0x7fef9806b810 2024-03-25T06:04:00.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.853+0000 7fefafe00640 1 -- 172.21.15.102:0/3093134891 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336148 (secure 0 0 0) 0x7fefa4031a10 con 0x7fef9806b810 2024-03-25T06:04:00.850 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:00.851 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T06:04:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fef9806b810 msgr2=0x7fef9806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fef9806b810 0x7fef9806dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefa4036000 tx=0x7fefa403c040 comp rx=0 tx=0).stop 2024-03-25T06:04:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 msgr2=0x7fefb81e61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb81e61a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fefa800c410 tx=0x7fefa800c8d0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 shutdown_connections 2024-03-25T06:04:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fef9806b810 0x7fef9806dcd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb8154120 0x7fefb814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb80c6c10 0x7fefb814a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 --2- 172.21.15.102:0/3093134891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb80c67e0 0x7fefb81e61a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 >> 172.21.15.102:0/3093134891 conn(0x7fefb80cf3e0 msgr2=0x7fefb806b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 shutdown_connections 2024-03-25T06:04:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:00.858+0000 7fefbda00640 1 -- 172.21.15.102:0/3093134891 wait complete. 2024-03-25T06:04:00.869 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":818,"stamp":"2024-03-25T06:03:59.348385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":250778084,"num_objects":245,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":8377,"num_read_kb":1510063,"num_write":298461,"num_write_kb":4970321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":459891,"ondisk_log_size":459891,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5876216,"kb_used_data":310648,"kb_used_omap":12,"kb_used_meta":5565491,"kb_avail":749098504,"statfs":{"total":773094113280,"available":767076868096,"internally_reserved":0,"allocated":318103552,"data_stored":509580466,"data_compressed":51430862,"data_compressed_allocated":76034048,"data_compressed_original":269111296,"omap_allocated":12752,"internal_metadata":5699063344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,2,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212575876,"num_objects":-1650,"num_object_clones":0,"num_object_copies":-5378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1650,"num_whiteouts":0,"num_read":8,"num_read_kb":139,"num_write":2335,"num_write_kb":24532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"2.1f","version":"27'1871","reported_seq":1910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.671840+0000","last_change":"2024-03-25T05:37:30.423912+0000","last_active":"2024-03-25T06:03:54.671840+0000","last_peered":"2024-03-25T06:03:54.671840+0000","last_clean":"2024-03-25T06:03:54.671840+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T06:03:54.671840+0000","last_undegraded":"2024-03-25T06:03:54.671840+0000","last_fullsized":"2024-03-25T06:03:54.671840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1876,"num_write_kb":13587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1705","reported_seq":1743,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.233956+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T06:03:53.233956+0000","last_peered":"2024-03-25T06:03:53.233956+0000","last_clean":"2024-03-25T06:03:53.233956+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T06:03:53.233956+0000","last_undegraded":"2024-03-25T06:03:53.233956+0000","last_fullsized":"2024-03-25T06:03:53.233956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'6032","reported_seq":6143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.467422+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T06:03:54.467422+0000","last_peered":"2024-03-25T06:03:54.467422+0000","last_clean":"2024-03-25T06:03:54.467422+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T06:03:54.467422+0000","last_undegraded":"2024-03-25T06:03:54.467422+0000","last_fullsized":"2024-03-25T06:03:54.467422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6032,"log_dups_size":0,"ondisk_log_size":6032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:43:49.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421387,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":4292,"num_write_kb":115305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'5159","reported_seq":5199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.715919+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T06:03:54.715919+0000","last_peered":"2024-03-25T06:03:54.715919+0000","last_clean":"2024-03-25T06:03:54.715919+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T06:03:54.715919+0000","last_undegraded":"2024-03-25T06:03:54.715919+0000","last_fullsized":"2024-03-25T06:03:54.715919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5171,"num_write_kb":32292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1710","reported_seq":1747,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.232486+0000","last_change":"2024-03-25T05:37:31.155929+0000","last_active":"2024-03-25T06:03:59.232486+0000","last_peered":"2024-03-25T06:03:59.232486+0000","last_clean":"2024-03-25T06:03:59.232486+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T06:03:59.232486+0000","last_undegraded":"2024-03-25T06:03:59.232486+0000","last_fullsized":"2024-03-25T06:03:59.232486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5965","reported_seq":6066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.539973+0000","last_change":"2024-03-25T05:38:20.806371+0000","last_active":"2024-03-25T06:03:54.539973+0000","last_peered":"2024-03-25T06:03:54.539973+0000","last_clean":"2024-03-25T06:03:54.539973+0000","last_became_active":"2024-03-25T05:38:20.805843+0000","last_became_peered":"2024-03-25T05:38:20.805843+0000","last_unstale":"2024-03-25T06:03:54.539973+0000","last_undegraded":"2024-03-25T06:03:54.539973+0000","last_fullsized":"2024-03-25T06:03:54.539973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5965,"log_dups_size":0,"ondisk_log_size":5965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:02:43.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052672,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":16002,"num_write":4126,"num_write_kb":114621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7852","reported_seq":7890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.642765+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T06:03:54.642765+0000","last_peered":"2024-03-25T06:03:54.642765+0000","last_clean":"2024-03-25T06:03:54.642765+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T06:03:54.642765+0000","last_undegraded":"2024-03-25T06:03:54.642765+0000","last_fullsized":"2024-03-25T06:03:54.642765+0000","mapping_epoch":17,"log_start":"27'800","ondisk_log_start":"27'800","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7052,"log_dups_size":0,"ondisk_log_size":7052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7854,"num_write_kb":54498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1762","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.355195+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T06:03:54.355195+0000","last_peered":"2024-03-25T06:03:54.355195+0000","last_clean":"2024-03-25T06:03:54.355195+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T06:03:54.355195+0000","last_undegraded":"2024-03-25T06:03:54.355195+0000","last_fullsized":"2024-03-25T06:03:54.355195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5977","reported_seq":6132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.451854+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T06:03:54.451854+0000","last_peered":"2024-03-25T06:03:54.451854+0000","last_clean":"2024-03-25T06:03:54.451854+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T06:03:54.451854+0000","last_undegraded":"2024-03-25T06:03:54.451854+0000","last_fullsized":"2024-03-25T06:03:54.451854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5977,"log_dups_size":0,"ondisk_log_size":5977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":31496,"num_write":4147,"num_write_kb":107246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4412","reported_seq":4450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:02:30.058411+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T06:02:30.058411+0000","last_peered":"2024-03-25T06:02:30.058411+0000","last_clean":"2024-03-25T06:02:30.058411+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T06:02:30.058411+0000","last_undegraded":"2024-03-25T06:02:30.058411+0000","last_fullsized":"2024-03-25T06:02:30.058411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4409,"num_write_kb":35629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1687","reported_seq":1723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.405629+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T06:03:54.405629+0000","last_peered":"2024-03-25T06:03:54.405629+0000","last_clean":"2024-03-25T06:03:54.405629+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T06:03:54.405629+0000","last_undegraded":"2024-03-25T06:03:54.405629+0000","last_fullsized":"2024-03-25T06:03:54.405629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1687,"log_dups_size":0,"ondisk_log_size":1687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5903","reported_seq":6001,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.298649+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T06:03:54.298649+0000","last_peered":"2024-03-25T06:03:54.298649+0000","last_clean":"2024-03-25T06:03:54.298649+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T06:03:54.298649+0000","last_undegraded":"2024-03-25T06:03:54.298649+0000","last_fullsized":"2024-03-25T06:03:54.298649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5903,"log_dups_size":0,"ondisk_log_size":5903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":4123,"num_write_kb":118597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1733","reported_seq":1770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.278722+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T06:03:54.278722+0000","last_peered":"2024-03-25T06:03:54.278722+0000","last_clean":"2024-03-25T06:03:54.278722+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T06:03:54.278722+0000","last_undegraded":"2024-03-25T06:03:54.278722+0000","last_fullsized":"2024-03-25T06:03:54.278722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'5826","reported_seq":5865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.701813+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T06:03:54.701813+0000","last_peered":"2024-03-25T06:03:54.701813+0000","last_clean":"2024-03-25T06:03:54.701813+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T06:03:54.701813+0000","last_undegraded":"2024-03-25T06:03:54.701813+0000","last_fullsized":"2024-03-25T06:03:54.701813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5838,"num_write_kb":40868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'6410","reported_seq":6548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.414898+0000","last_change":"2024-03-25T05:38:20.653005+0000","last_active":"2024-03-25T06:03:54.414898+0000","last_peered":"2024-03-25T06:03:54.414898+0000","last_clean":"2024-03-25T06:03:54.414898+0000","last_became_active":"2024-03-25T05:38:20.652530+0000","last_became_peered":"2024-03-25T05:38:20.652530+0000","last_unstale":"2024-03-25T06:03:54.414898+0000","last_undegraded":"2024-03-25T06:03:54.414898+0000","last_fullsized":"2024-03-25T06:03:54.414898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6410,"log_dups_size":0,"ondisk_log_size":6410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:23.447608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1391862,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":25146,"num_write":4561,"num_write_kb":128586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1751","reported_seq":1787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.889253+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T06:03:53.889253+0000","last_peered":"2024-03-25T06:03:53.889253+0000","last_clean":"2024-03-25T06:03:53.889253+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T06:03:53.889253+0000","last_undegraded":"2024-03-25T06:03:53.889253+0000","last_fullsized":"2024-03-25T06:03:53.889253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'5251","reported_seq":5291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.654958+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T06:03:54.654958+0000","last_peered":"2024-03-25T06:03:54.654958+0000","last_clean":"2024-03-25T06:03:54.654958+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T06:03:54.654958+0000","last_undegraded":"2024-03-25T06:03:54.654958+0000","last_fullsized":"2024-03-25T06:03:54.654958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5247,"num_write_kb":40419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'6237","reported_seq":6382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.156774+0000","last_change":"2024-03-25T05:38:20.809959+0000","last_active":"2024-03-25T06:03:52.156774+0000","last_peered":"2024-03-25T06:03:52.156774+0000","last_clean":"2024-03-25T06:03:52.156774+0000","last_became_active":"2024-03-25T05:38:20.809544+0000","last_became_peered":"2024-03-25T05:38:20.809544+0000","last_unstale":"2024-03-25T06:03:52.156774+0000","last_undegraded":"2024-03-25T06:03:52.156774+0000","last_fullsized":"2024-03-25T06:03:52.156774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6237,"log_dups_size":0,"ondisk_log_size":6237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:17:17.764182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":26924,"num_write":4469,"num_write_kb":121611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1763","reported_seq":1800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.183098+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T06:03:54.183098+0000","last_peered":"2024-03-25T06:03:54.183098+0000","last_clean":"2024-03-25T06:03:54.183098+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T06:03:54.183098+0000","last_undegraded":"2024-03-25T06:03:54.183098+0000","last_fullsized":"2024-03-25T06:03:54.183098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2773","reported_seq":2813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.683761+0000","last_change":"2024-03-25T05:37:30.422594+0000","last_active":"2024-03-25T06:03:54.683761+0000","last_peered":"2024-03-25T06:03:54.683761+0000","last_clean":"2024-03-25T06:03:54.683761+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T06:03:54.683761+0000","last_undegraded":"2024-03-25T06:03:54.683761+0000","last_fullsized":"2024-03-25T06:03:54.683761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2773,"log_dups_size":0,"ondisk_log_size":2773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2784,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5897","reported_seq":6115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.164582+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T06:03:54.164582+0000","last_peered":"2024-03-25T06:03:54.164582+0000","last_clean":"2024-03-25T06:03:54.164582+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T06:03:54.164582+0000","last_undegraded":"2024-03-25T06:03:54.164582+0000","last_fullsized":"2024-03-25T06:03:54.164582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5897,"log_dups_size":0,"ondisk_log_size":5897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":47244,"num_write":4143,"num_write_kb":109091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1771","reported_seq":1809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.088254+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T06:03:52.088254+0000","last_peered":"2024-03-25T06:03:52.088254+0000","last_clean":"2024-03-25T06:03:52.088254+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T06:03:52.088254+0000","last_undegraded":"2024-03-25T06:03:52.088254+0000","last_fullsized":"2024-03-25T06:03:52.088254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1612","reported_seq":1652,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.715052+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T06:03:54.715052+0000","last_peered":"2024-03-25T06:03:54.715052+0000","last_clean":"2024-03-25T06:03:54.715052+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T06:03:54.715052+0000","last_undegraded":"2024-03-25T06:03:54.715052+0000","last_fullsized":"2024-03-25T06:03:54.715052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5907","reported_seq":5991,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.198942+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T06:03:54.198942+0000","last_peered":"2024-03-25T06:03:54.198942+0000","last_clean":"2024-03-25T06:03:54.198942+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T06:03:54.198942+0000","last_undegraded":"2024-03-25T06:03:54.198942+0000","last_fullsized":"2024-03-25T06:03:54.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315648,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4053,"num_write_kb":104860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1711","reported_seq":1748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.225436+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T06:03:59.225436+0000","last_peered":"2024-03-25T06:03:59.225436+0000","last_clean":"2024-03-25T06:03:59.225436+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T06:03:59.225436+0000","last_undegraded":"2024-03-25T06:03:59.225436+0000","last_fullsized":"2024-03-25T06:03:59.225436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'2886","reported_seq":2925,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.726047+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T06:03:54.726047+0000","last_peered":"2024-03-25T06:03:54.726047+0000","last_clean":"2024-03-25T06:03:54.726047+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T06:03:54.726047+0000","last_undegraded":"2024-03-25T06:03:54.726047+0000","last_fullsized":"2024-03-25T06:03:54.726047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2906,"num_write_kb":22398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'6069","reported_seq":6154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.575479+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T06:03:54.575479+0000","last_peered":"2024-03-25T06:03:54.575479+0000","last_clean":"2024-03-25T06:03:54.575479+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T06:03:54.575479+0000","last_undegraded":"2024-03-25T06:03:54.575479+0000","last_fullsized":"2024-03-25T06:03:54.575479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4301,"num_write_kb":129624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1685","reported_seq":1722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.988242+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T06:03:53.988242+0000","last_peered":"2024-03-25T06:03:53.988242+0000","last_clean":"2024-03-25T06:03:53.988242+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T06:03:53.988242+0000","last_undegraded":"2024-03-25T06:03:53.988242+0000","last_fullsized":"2024-03-25T06:03:53.988242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1685,"log_dups_size":0,"ondisk_log_size":1685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4481","reported_seq":4521,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.707955+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T06:03:54.707955+0000","last_peered":"2024-03-25T06:03:54.707955+0000","last_clean":"2024-03-25T06:03:54.707955+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T06:03:54.707955+0000","last_undegraded":"2024-03-25T06:03:54.707955+0000","last_fullsized":"2024-03-25T06:03:54.707955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4481,"log_dups_size":0,"ondisk_log_size":4481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7147,"num_write_kb":35866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'6335","reported_seq":6502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.271690+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T06:03:54.271690+0000","last_peered":"2024-03-25T06:03:54.271690+0000","last_clean":"2024-03-25T06:03:54.271690+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T06:03:54.271690+0000","last_undegraded":"2024-03-25T06:03:54.271690+0000","last_fullsized":"2024-03-25T06:03:54.271690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6335,"log_dups_size":0,"ondisk_log_size":6335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:43:13.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":33782,"num_write":4565,"num_write_kb":115382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1750","reported_seq":1788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.914901+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T06:03:53.914901+0000","last_peered":"2024-03-25T06:03:53.914901+0000","last_clean":"2024-03-25T06:03:53.914901+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T06:03:53.914901+0000","last_undegraded":"2024-03-25T06:03:53.914901+0000","last_fullsized":"2024-03-25T06:03:53.914901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'5273","reported_seq":5313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.690625+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T06:03:54.690625+0000","last_peered":"2024-03-25T06:03:54.690625+0000","last_clean":"2024-03-25T06:03:54.690625+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T06:03:54.690625+0000","last_undegraded":"2024-03-25T06:03:54.690625+0000","last_fullsized":"2024-03-25T06:03:54.690625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5274,"num_write_kb":36361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'6077","reported_seq":6315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.990727+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T06:03:58.990727+0000","last_peered":"2024-03-25T06:03:58.990727+0000","last_clean":"2024-03-25T06:03:58.990727+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T06:03:58.990727+0000","last_undegraded":"2024-03-25T06:03:58.990727+0000","last_fullsized":"2024-03-25T06:03:58.990727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6077,"log_dups_size":0,"ondisk_log_size":6077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629177,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":52070,"num_write":4226,"num_write_kb":109752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1707","reported_seq":1729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.766841+0000","last_change":"2024-03-25T05:38:20.806229+0000","last_active":"2024-03-25T06:03:51.766841+0000","last_peered":"2024-03-25T06:03:51.766841+0000","last_clean":"2024-03-25T06:03:51.766841+0000","last_became_active":"2024-03-25T05:38:20.805934+0000","last_became_peered":"2024-03-25T05:38:20.805934+0000","last_unstale":"2024-03-25T06:03:51.766841+0000","last_undegraded":"2024-03-25T06:03:51.766841+0000","last_fullsized":"2024-03-25T06:03:51.766841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1707,"log_dups_size":0,"ondisk_log_size":1707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'5138","reported_seq":5178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.723442+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T06:03:54.723442+0000","last_peered":"2024-03-25T06:03:54.723442+0000","last_clean":"2024-03-25T06:03:54.723442+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T06:03:54.723442+0000","last_undegraded":"2024-03-25T06:03:54.723442+0000","last_fullsized":"2024-03-25T06:03:54.723442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5138,"log_dups_size":0,"ondisk_log_size":5138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5143,"num_write_kb":40167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'6967","reported_seq":7059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.761754+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T06:03:53.761754+0000","last_peered":"2024-03-25T06:03:53.761754+0000","last_clean":"2024-03-25T06:03:53.761754+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T06:03:53.761754+0000","last_undegraded":"2024-03-25T06:03:53.761754+0000","last_fullsized":"2024-03-25T06:03:53.761754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6967,"log_dups_size":0,"ondisk_log_size":6967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5199,"num_write_kb":132356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1717","reported_seq":1755,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.061043+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T06:03:53.061043+0000","last_peered":"2024-03-25T06:03:53.061043+0000","last_clean":"2024-03-25T06:03:53.061043+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T06:03:53.061043+0000","last_undegraded":"2024-03-25T06:03:53.061043+0000","last_fullsized":"2024-03-25T06:03:53.061043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7932","reported_seq":7972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731617+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T06:03:54.731617+0000","last_peered":"2024-03-25T06:03:54.731617+0000","last_clean":"2024-03-25T06:03:54.731617+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T06:03:54.731617+0000","last_undegraded":"2024-03-25T06:03:54.731617+0000","last_fullsized":"2024-03-25T06:03:54.731617+0000","mapping_epoch":17,"log_start":"27'400","ondisk_log_start":"27'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7532,"log_dups_size":0,"ondisk_log_size":7532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":7940,"num_write_kb":54570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'6089","reported_seq":6194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.524271+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T06:03:54.524271+0000","last_peered":"2024-03-25T06:03:54.524271+0000","last_clean":"2024-03-25T06:03:54.524271+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T06:03:54.524271+0000","last_undegraded":"2024-03-25T06:03:54.524271+0000","last_fullsized":"2024-03-25T06:03:54.524271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6089,"log_dups_size":0,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4263,"num_write_kb":125557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1735","reported_seq":1774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.267603+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T06:03:54.267603+0000","last_peered":"2024-03-25T06:03:54.267603+0000","last_clean":"2024-03-25T06:03:54.267603+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T06:03:54.267603+0000","last_undegraded":"2024-03-25T06:03:54.267603+0000","last_fullsized":"2024-03-25T06:03:54.267603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6067","reported_seq":7057,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.676694+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T06:03:54.676694+0000","last_peered":"2024-03-25T06:03:54.676694+0000","last_clean":"2024-03-25T06:03:54.676694+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T06:03:54.676694+0000","last_undegraded":"2024-03-25T06:03:54.676694+0000","last_fullsized":"2024-03-25T06:03:54.676694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6067,"log_dups_size":0,"ondisk_log_size":6067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":950,"num_read_kb":4728,"num_write":6066,"num_write_kb":44950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'6018","reported_seq":6490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.519967+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T06:03:54.519967+0000","last_peered":"2024-03-25T06:03:54.519967+0000","last_clean":"2024-03-25T06:03:54.519967+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T06:03:54.519967+0000","last_undegraded":"2024-03-25T06:03:54.519967+0000","last_fullsized":"2024-03-25T06:03:54.519967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6018,"log_dups_size":0,"ondisk_log_size":6018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":111506,"num_write":4239,"num_write_kb":120920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1663","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.185756+0000","last_change":"2024-03-25T05:37:31.148439+0000","last_active":"2024-03-25T06:03:59.185756+0000","last_peered":"2024-03-25T06:03:59.185756+0000","last_clean":"2024-03-25T06:03:59.185756+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T06:03:59.185756+0000","last_undegraded":"2024-03-25T06:03:59.185756+0000","last_fullsized":"2024-03-25T06:03:59.185756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:53:17.257529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'6671","reported_seq":6712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.671195+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T06:03:54.671195+0000","last_peered":"2024-03-25T06:03:54.671195+0000","last_clean":"2024-03-25T06:03:54.671195+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T06:03:54.671195+0000","last_undegraded":"2024-03-25T06:03:54.671195+0000","last_fullsized":"2024-03-25T06:03:54.671195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6671,"log_dups_size":0,"ondisk_log_size":6671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":45450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'6159","reported_seq":6352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.043817+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T06:03:59.043817+0000","last_peered":"2024-03-25T06:03:59.043817+0000","last_clean":"2024-03-25T06:03:59.043817+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T06:03:59.043817+0000","last_undegraded":"2024-03-25T06:03:59.043817+0000","last_fullsized":"2024-03-25T06:03:59.043817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6159,"log_dups_size":0,"ondisk_log_size":6159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260306,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":160,"num_read_kb":40640,"num_write":4330,"num_write_kb":133390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1731","reported_seq":1768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.678278+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T06:03:52.678278+0000","last_peered":"2024-03-25T06:03:52.678278+0000","last_clean":"2024-03-25T06:03:52.678278+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T06:03:52.678278+0000","last_undegraded":"2024-03-25T06:03:52.678278+0000","last_fullsized":"2024-03-25T06:03:52.678278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4314","reported_seq":4354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:08.404605+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T06:03:08.404605+0000","last_peered":"2024-03-25T06:03:08.404605+0000","last_clean":"2024-03-25T06:03:08.404605+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T06:03:08.404605+0000","last_undegraded":"2024-03-25T06:03:08.404605+0000","last_fullsized":"2024-03-25T06:03:08.404605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4314,"log_dups_size":0,"ondisk_log_size":4314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4311,"num_write_kb":35590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:01:30.046447+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T06:01:30.046447+0000","last_peered":"2024-03-25T06:01:30.046447+0000","last_clean":"2024-03-25T06:01:30.046447+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T06:01:30.046447+0000","last_undegraded":"2024-03-25T06:01:30.046447+0000","last_fullsized":"2024-03-25T06:01:30.046447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'6161","reported_seq":6322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.736152+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T06:03:53.736152+0000","last_peered":"2024-03-25T06:03:53.736152+0000","last_clean":"2024-03-25T06:03:53.736152+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T06:03:53.736152+0000","last_undegraded":"2024-03-25T06:03:53.736152+0000","last_fullsized":"2024-03-25T06:03:53.736152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6161,"log_dups_size":0,"ondisk_log_size":6161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":32512,"num_write":4374,"num_write_kb":123745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1723","reported_seq":1760,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.296900+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T06:03:54.296900+0000","last_peered":"2024-03-25T06:03:54.296900+0000","last_clean":"2024-03-25T06:03:54.296900+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T06:03:54.296900+0000","last_undegraded":"2024-03-25T06:03:54.296900+0000","last_fullsized":"2024-03-25T06:03:54.296900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5041","reported_seq":5080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:30.115854+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T06:03:30.115854+0000","last_peered":"2024-03-25T06:03:30.115854+0000","last_clean":"2024-03-25T06:03:30.115854+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T06:03:30.115854+0000","last_undegraded":"2024-03-25T06:03:30.115854+0000","last_fullsized":"2024-03-25T06:03:30.115854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5041,"log_dups_size":0,"ondisk_log_size":5041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390032,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5032,"num_write_kb":40184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'6515","reported_seq":6836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.481682+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T06:03:54.481682+0000","last_peered":"2024-03-25T06:03:54.481682+0000","last_clean":"2024-03-25T06:03:54.481682+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T06:03:54.481682+0000","last_undegraded":"2024-03-25T06:03:54.481682+0000","last_fullsized":"2024-03-25T06:03:54.481682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6515,"log_dups_size":0,"ondisk_log_size":6515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":73152,"num_write":4685,"num_write_kb":118227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1742","reported_seq":1784,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.201016+0000","last_change":"2024-03-25T05:38:20.652252+0000","last_active":"2024-03-25T06:03:51.201016+0000","last_peered":"2024-03-25T06:03:51.201016+0000","last_clean":"2024-03-25T06:03:51.201016+0000","last_became_active":"2024-03-25T05:38:20.652010+0000","last_became_peered":"2024-03-25T05:38:20.652010+0000","last_unstale":"2024-03-25T06:03:51.201016+0000","last_undegraded":"2024-03-25T06:03:51.201016+0000","last_fullsized":"2024-03-25T06:03:51.201016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:19.423056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5678","reported_seq":5717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.730560+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T06:03:54.730560+0000","last_peered":"2024-03-25T06:03:54.730560+0000","last_clean":"2024-03-25T06:03:54.730560+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T06:03:54.730560+0000","last_undegraded":"2024-03-25T06:03:54.730560+0000","last_fullsized":"2024-03-25T06:03:54.730560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5678,"log_dups_size":0,"ondisk_log_size":5678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5688,"num_write_kb":44802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'6237","reported_seq":6602,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.992859+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T06:03:58.992859+0000","last_peered":"2024-03-25T06:03:58.992859+0000","last_clean":"2024-03-25T06:03:58.992859+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T06:03:58.992859+0000","last_undegraded":"2024-03-25T06:03:58.992859+0000","last_fullsized":"2024-03-25T06:03:58.992859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6237,"log_dups_size":0,"ondisk_log_size":6237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335872,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":84582,"num_write":4339,"num_write_kb":115405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1658","reported_seq":1695,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.693539+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T06:03:53.693539+0000","last_peered":"2024-03-25T06:03:53.693539+0000","last_clean":"2024-03-25T06:03:53.693539+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T06:03:53.693539+0000","last_undegraded":"2024-03-25T06:03:53.693539+0000","last_fullsized":"2024-03-25T06:03:53.693539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1658,"log_dups_size":0,"ondisk_log_size":1658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5642","reported_seq":5681,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:02:28.428077+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T06:02:28.428077+0000","last_peered":"2024-03-25T06:02:28.428077+0000","last_clean":"2024-03-25T06:02:28.428077+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T06:02:28.428077+0000","last_undegraded":"2024-03-25T06:02:28.428077+0000","last_fullsized":"2024-03-25T06:02:28.428077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5640,"num_write_kb":40587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'6749","reported_seq":7090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.396662+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T06:03:54.396662+0000","last_peered":"2024-03-25T06:03:54.396662+0000","last_clean":"2024-03-25T06:03:54.396662+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T06:03:54.396662+0000","last_undegraded":"2024-03-25T06:03:54.396662+0000","last_fullsized":"2024-03-25T06:03:54.396662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6749,"log_dups_size":0,"ondisk_log_size":6749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":78232,"num_write":4935,"num_write_kb":116647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1743","reported_seq":1780,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.188773+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T06:03:54.188773+0000","last_peered":"2024-03-25T06:03:54.188773+0000","last_clean":"2024-03-25T06:03:54.188773+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T06:03:54.188773+0000","last_undegraded":"2024-03-25T06:03:54.188773+0000","last_fullsized":"2024-03-25T06:03:54.188773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3454","reported_seq":3493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.684095+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T06:03:54.684095+0000","last_peered":"2024-03-25T06:03:54.684095+0000","last_clean":"2024-03-25T06:03:54.684095+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T06:03:54.684095+0000","last_undegraded":"2024-03-25T06:03:54.684095+0000","last_fullsized":"2024-03-25T06:03:54.684095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3453,"num_write_kb":26898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'6082","reported_seq":6150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.105456+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T06:03:52.105456+0000","last_peered":"2024-03-25T06:03:52.105456+0000","last_clean":"2024-03-25T06:03:52.105456+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T06:03:52.105456+0000","last_undegraded":"2024-03-25T06:03:52.105456+0000","last_fullsized":"2024-03-25T06:03:52.105456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6082,"log_dups_size":0,"ondisk_log_size":6082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431670,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":8890,"num_write":4232,"num_write_kb":109973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1744","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.390093+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T06:03:54.390093+0000","last_peered":"2024-03-25T06:03:54.390093+0000","last_clean":"2024-03-25T06:03:54.390093+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T06:03:54.390093+0000","last_undegraded":"2024-03-25T06:03:54.390093+0000","last_fullsized":"2024-03-25T06:03:54.390093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1744,"log_dups_size":0,"ondisk_log_size":1744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'2585","reported_seq":2624,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.730595+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T06:03:54.730595+0000","last_peered":"2024-03-25T06:03:54.730595+0000","last_clean":"2024-03-25T06:03:54.730595+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T06:03:54.730595+0000","last_undegraded":"2024-03-25T06:03:54.730595+0000","last_fullsized":"2024-03-25T06:03:54.730595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2585,"log_dups_size":0,"ondisk_log_size":2585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2603,"num_write_kb":18105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'6133","reported_seq":6456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.032625+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T06:03:59.032625+0000","last_peered":"2024-03-25T06:03:59.032625+0000","last_clean":"2024-03-25T06:03:59.032625+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T06:03:59.032625+0000","last_undegraded":"2024-03-25T06:03:59.032625+0000","last_fullsized":"2024-03-25T06:03:59.032625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6133,"log_dups_size":0,"ondisk_log_size":6133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052933,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":74168,"num_write":4306,"num_write_kb":103632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1667","reported_seq":1703,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.511800+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T06:03:54.511800+0000","last_peered":"2024-03-25T06:03:54.511800+0000","last_clean":"2024-03-25T06:03:54.511800+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T06:03:54.511800+0000","last_undegraded":"2024-03-25T06:03:54.511800+0000","last_fullsized":"2024-03-25T06:03:54.511800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1667,"log_dups_size":0,"ondisk_log_size":1667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3092","reported_seq":3130,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.698578+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T06:03:54.698578+0000","last_peered":"2024-03-25T06:03:54.698578+0000","last_clean":"2024-03-25T06:03:54.698578+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T06:03:54.698578+0000","last_undegraded":"2024-03-25T06:03:54.698578+0000","last_fullsized":"2024-03-25T06:03:54.698578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3092,"log_dups_size":0,"ondisk_log_size":3092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195146,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3109,"num_write_kb":22544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'6001","reported_seq":6449,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.218345+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T06:03:54.218345+0000","last_peered":"2024-03-25T06:03:54.218345+0000","last_clean":"2024-03-25T06:03:54.218345+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T06:03:54.218345+0000","last_undegraded":"2024-03-25T06:03:54.218345+0000","last_fullsized":"2024-03-25T06:03:54.218345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6001,"log_dups_size":0,"ondisk_log_size":6001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:50.989171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":105918,"num_write":4133,"num_write_kb":116215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1729","reported_seq":1766,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.675825+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T06:03:53.675825+0000","last_peered":"2024-03-25T06:03:53.675825+0000","last_clean":"2024-03-25T06:03:53.675825+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T06:03:53.675825+0000","last_undegraded":"2024-03-25T06:03:53.675825+0000","last_fullsized":"2024-03-25T06:03:53.675825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'848","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.742196+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T06:03:54.742196+0000","last_peered":"2024-03-25T06:03:54.742196+0000","last_clean":"2024-03-25T06:03:54.742196+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T06:03:54.742196+0000","last_undegraded":"2024-03-25T06:03:54.742196+0000","last_fullsized":"2024-03-25T06:03:54.742196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":860,"num_write_kb":8739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5767","reported_seq":5997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.226440+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T06:03:54.226440+0000","last_peered":"2024-03-25T06:03:54.226440+0000","last_clean":"2024-03-25T06:03:54.226440+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T06:03:54.226440+0000","last_undegraded":"2024-03-25T06:03:54.226440+0000","last_fullsized":"2024-03-25T06:03:54.226440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5767,"log_dups_size":0,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:14:50.068275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":50292,"num_write":4003,"num_write_kb":127231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1739","reported_seq":1775,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.185107+0000","last_change":"2024-03-25T05:37:31.149941+0000","last_active":"2024-03-25T06:03:59.185107+0000","last_peered":"2024-03-25T06:03:59.185107+0000","last_clean":"2024-03-25T06:03:59.185107+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T06:03:59.185107+0000","last_undegraded":"2024-03-25T06:03:59.185107+0000","last_fullsized":"2024-03-25T06:03:59.185107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:24:40.019842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'3793","reported_seq":3831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.678912+0000","last_change":"2024-03-25T05:37:30.419153+0000","last_active":"2024-03-25T06:03:54.678912+0000","last_peered":"2024-03-25T06:03:54.678912+0000","last_clean":"2024-03-25T06:03:54.678912+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T06:03:54.678912+0000","last_undegraded":"2024-03-25T06:03:54.678912+0000","last_fullsized":"2024-03-25T06:03:54.678912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:16:01.889443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3799,"num_write_kb":31202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5792","reported_seq":5877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.268744+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T06:03:54.268744+0000","last_peered":"2024-03-25T06:03:54.268744+0000","last_clean":"2024-03-25T06:03:54.268744+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T06:03:54.268744+0000","last_undegraded":"2024-03-25T06:03:54.268744+0000","last_fullsized":"2024-03-25T06:03:54.268744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5792,"log_dups_size":0,"ondisk_log_size":5792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":13716,"num_write":3985,"num_write_kb":98790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1656","reported_seq":1692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.934764+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T06:03:50.934764+0000","last_peered":"2024-03-25T06:03:50.934764+0000","last_clean":"2024-03-25T06:03:50.934764+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T06:03:50.934764+0000","last_undegraded":"2024-03-25T06:03:50.934764+0000","last_fullsized":"2024-03-25T06:03:50.934764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1656,"log_dups_size":0,"ondisk_log_size":1656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'6610","reported_seq":7248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.736476+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T06:03:54.736476+0000","last_peered":"2024-03-25T06:03:54.736476+0000","last_clean":"2024-03-25T06:03:54.736476+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T06:03:54.736476+0000","last_undegraded":"2024-03-25T06:03:54.736476+0000","last_fullsized":"2024-03-25T06:03:54.736476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15601385,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":600,"num_read_kb":3799,"num_write":6621,"num_write_kb":48470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5988","reported_seq":6230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.179221+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T06:03:54.179221+0000","last_peered":"2024-03-25T06:03:54.179221+0000","last_clean":"2024-03-25T06:03:54.179221+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T06:03:54.179221+0000","last_undegraded":"2024-03-25T06:03:54.179221+0000","last_fullsized":"2024-03-25T06:03:54.179221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5988,"log_dups_size":0,"ondisk_log_size":5988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260736,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":4183,"num_write_kb":127483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1705","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.028113+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T06:03:54.028113+0000","last_peered":"2024-03-25T06:03:54.028113+0000","last_clean":"2024-03-25T06:03:54.028113+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T06:03:54.028113+0000","last_undegraded":"2024-03-25T06:03:54.028113+0000","last_fullsized":"2024-03-25T06:03:54.028113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5364","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731252+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T06:03:54.731252+0000","last_peered":"2024-03-25T06:03:54.731252+0000","last_clean":"2024-03-25T06:03:54.731252+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T06:03:54.731252+0000","last_undegraded":"2024-03-25T06:03:54.731252+0000","last_fullsized":"2024-03-25T06:03:54.731252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5364,"log_dups_size":0,"ondisk_log_size":5364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5367,"num_write_kb":32641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5993","reported_seq":6080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.718186+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T06:03:53.718186+0000","last_peered":"2024-03-25T06:03:53.718186+0000","last_clean":"2024-03-25T06:03:53.718186+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T06:03:53.718186+0000","last_undegraded":"2024-03-25T06:03:53.718186+0000","last_fullsized":"2024-03-25T06:03:53.718186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5993,"log_dups_size":0,"ondisk_log_size":5993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365760,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":13970,"num_write":4176,"num_write_kb":117168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1733","reported_seq":1773,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.227863+0000","last_change":"2024-03-25T05:38:20.652289+0000","last_active":"2024-03-25T06:03:59.227863+0000","last_peered":"2024-03-25T06:03:59.227863+0000","last_clean":"2024-03-25T06:03:59.227863+0000","last_became_active":"2024-03-25T05:38:20.652007+0000","last_became_peered":"2024-03-25T05:38:20.652007+0000","last_unstale":"2024-03-25T06:03:59.227863+0000","last_undegraded":"2024-03-25T06:03:59.227863+0000","last_fullsized":"2024-03-25T06:03:59.227863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:15:33.110431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5604","reported_seq":5642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.695714+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T06:03:54.695714+0000","last_peered":"2024-03-25T06:03:54.695714+0000","last_clean":"2024-03-25T06:03:54.695714+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T06:03:54.695714+0000","last_undegraded":"2024-03-25T06:03:54.695714+0000","last_fullsized":"2024-03-25T06:03:54.695714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5607,"num_write_kb":40642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5709","reported_seq":6160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.520071+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T06:03:54.520071+0000","last_peered":"2024-03-25T06:03:54.520071+0000","last_clean":"2024-03-25T06:03:54.520071+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T06:03:54.520071+0000","last_undegraded":"2024-03-25T06:03:54.520071+0000","last_fullsized":"2024-03-25T06:03:54.520071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5709,"log_dups_size":0,"ondisk_log_size":5709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:27:40.435483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":106426,"num_write":4010,"num_write_kb":116755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1692","reported_seq":1728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.711024+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T06:03:53.711024+0000","last_peered":"2024-03-25T06:03:53.711024+0000","last_clean":"2024-03-25T06:03:53.711024+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T06:03:53.711024+0000","last_undegraded":"2024-03-25T06:03:53.711024+0000","last_fullsized":"2024-03-25T06:03:53.711024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4517","reported_seq":5355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.705336+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T06:03:54.705336+0000","last_peered":"2024-03-25T06:03:54.705336+0000","last_clean":"2024-03-25T06:03:54.705336+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T06:03:54.705336+0000","last_undegraded":"2024-03-25T06:03:54.705336+0000","last_fullsized":"2024-03-25T06:03:54.705336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4517,"log_dups_size":0,"ondisk_log_size":4517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":802,"num_read_kb":4614,"num_write":4524,"num_write_kb":35758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6263","reported_seq":6658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.401210+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T06:03:54.401210+0000","last_peered":"2024-03-25T06:03:54.401210+0000","last_clean":"2024-03-25T06:03:54.401210+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T06:03:54.401210+0000","last_undegraded":"2024-03-25T06:03:54.401210+0000","last_fullsized":"2024-03-25T06:03:54.401210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6263,"log_dups_size":0,"ondisk_log_size":6263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:25:03.802329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74402,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":363,"num_read_kb":92202,"num_write":4366,"num_write_kb":119516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5991","reported_seq":6089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.030228+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T06:03:59.030228+0000","last_peered":"2024-03-25T06:03:59.030228+0000","last_clean":"2024-03-25T06:03:59.030228+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T06:03:59.030228+0000","last_undegraded":"2024-03-25T06:03:59.030228+0000","last_fullsized":"2024-03-25T06:03:59.030228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5991,"log_dups_size":0,"ondisk_log_size":5991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268288,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":4230,"num_write_kb":107763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1670","reported_seq":1706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.067757+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T06:03:54.067757+0000","last_peered":"2024-03-25T06:03:54.067757+0000","last_clean":"2024-03-25T06:03:54.067757+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T06:03:54.067757+0000","last_undegraded":"2024-03-25T06:03:54.067757+0000","last_fullsized":"2024-03-25T06:03:54.067757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'8146","reported_seq":8184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.709010+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T06:03:54.709010+0000","last_peered":"2024-03-25T06:03:54.709010+0000","last_clean":"2024-03-25T06:03:54.709010+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T06:03:54.709010+0000","last_undegraded":"2024-03-25T06:03:54.709010+0000","last_fullsized":"2024-03-25T06:03:54.709010+0000","mapping_epoch":17,"log_start":"27'600","ondisk_log_start":"27'600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7546,"log_dups_size":0,"ondisk_log_size":7546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8142,"num_write_kb":58721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'6004","reported_seq":6326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.091602+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T06:03:54.091602+0000","last_peered":"2024-03-25T06:03:54.091602+0000","last_clean":"2024-03-25T06:03:54.091602+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T06:03:54.091602+0000","last_undegraded":"2024-03-25T06:03:54.091602+0000","last_fullsized":"2024-03-25T06:03:54.091602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6004,"log_dups_size":0,"ondisk_log_size":6004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74402,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":73406,"num_write":4229,"num_write_kb":113314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1743","reported_seq":1778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.090733+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T06:03:52.090733+0000","last_peered":"2024-03-25T06:03:52.090733+0000","last_clean":"2024-03-25T06:03:52.090733+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T06:03:52.090733+0000","last_undegraded":"2024-03-25T06:03:52.090733+0000","last_fullsized":"2024-03-25T06:03:52.090733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4099","reported_seq":4136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:08.398796+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T06:03:08.398796+0000","last_peered":"2024-03-25T06:03:08.398796+0000","last_clean":"2024-03-25T06:03:08.398796+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T06:03:08.398796+0000","last_undegraded":"2024-03-25T06:03:08.398796+0000","last_fullsized":"2024-03-25T06:03:08.398796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4099,"log_dups_size":0,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4095,"num_write_kb":35371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7947","reported_seq":7984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.659082+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T06:03:54.659082+0000","last_peered":"2024-03-25T06:03:54.659082+0000","last_clean":"2024-03-25T06:03:54.659082+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T06:03:54.659082+0000","last_undegraded":"2024-03-25T06:03:54.659082+0000","last_fullsized":"2024-03-25T06:03:54.659082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7947,"log_dups_size":0,"ondisk_log_size":7947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7943,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1689","reported_seq":1724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219387+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T06:03:59.219387+0000","last_peered":"2024-03-25T06:03:59.219387+0000","last_clean":"2024-03-25T06:03:59.219387+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T06:03:59.219387+0000","last_undegraded":"2024-03-25T06:03:59.219387+0000","last_fullsized":"2024-03-25T06:03:59.219387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1689,"log_dups_size":0,"ondisk_log_size":1689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'6116","reported_seq":6228,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.542464+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T06:03:54.542464+0000","last_peered":"2024-03-25T06:03:54.542464+0000","last_clean":"2024-03-25T06:03:54.542464+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T06:03:54.542464+0000","last_undegraded":"2024-03-25T06:03:54.542464+0000","last_fullsized":"2024-03-25T06:03:54.542464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6116,"log_dups_size":0,"ondisk_log_size":6116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:24.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":4275,"num_write_kb":113262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6308","reported_seq":6345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.654487+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T06:03:54.654487+0000","last_peered":"2024-03-25T06:03:54.654487+0000","last_clean":"2024-03-25T06:03:54.654487+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T06:03:54.654487+0000","last_undegraded":"2024-03-25T06:03:54.654487+0000","last_fullsized":"2024-03-25T06:03:54.654487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6308,"log_dups_size":0,"ondisk_log_size":6308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166700,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6300,"num_write_kb":53213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1715","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.084504+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T06:03:54.084504+0000","last_peered":"2024-03-25T06:03:54.084504+0000","last_clean":"2024-03-25T06:03:54.084504+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T06:03:54.084504+0000","last_undegraded":"2024-03-25T06:03:54.084504+0000","last_fullsized":"2024-03-25T06:03:54.084504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'6475","reported_seq":6968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.475889+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T06:03:54.475889+0000","last_peered":"2024-03-25T06:03:54.475889+0000","last_clean":"2024-03-25T06:03:54.475889+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T06:03:54.475889+0000","last_undegraded":"2024-03-25T06:03:54.475889+0000","last_fullsized":"2024-03-25T06:03:54.475889+0000","mapping_epoch":22,"log_start":"27'200","ondisk_log_start":"27'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6275,"log_dups_size":0,"ondisk_log_size":6275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:08:02.386273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2195264,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":117348,"num_write":4678,"num_write_kb":179166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1668","reported_seq":1705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.141247+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T06:03:54.141247+0000","last_peered":"2024-03-25T06:03:54.141247+0000","last_clean":"2024-03-25T06:03:54.141247+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T06:03:54.141247+0000","last_undegraded":"2024-03-25T06:03:54.141247+0000","last_fullsized":"2024-03-25T06:03:54.141247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1751","reported_seq":1794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:49.804346+0000","last_change":"2024-03-25T05:38:20.652638+0000","last_active":"2024-03-25T06:03:49.804346+0000","last_peered":"2024-03-25T06:03:49.804346+0000","last_clean":"2024-03-25T06:03:49.804346+0000","last_became_active":"2024-03-25T05:38:20.652189+0000","last_became_peered":"2024-03-25T05:38:20.652189+0000","last_unstale":"2024-03-25T06:03:49.804346+0000","last_undegraded":"2024-03-25T06:03:49.804346+0000","last_fullsized":"2024-03-25T06:03:49.804346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1670","reported_seq":1708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.645425+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T06:03:52.645425+0000","last_peered":"2024-03-25T06:03:52.645425+0000","last_clean":"2024-03-25T06:03:52.645425+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T06:03:52.645425+0000","last_undegraded":"2024-03-25T06:03:52.645425+0000","last_fullsized":"2024-03-25T06:03:52.645425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1790","reported_seq":1827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.255566+0000","last_change":"2024-03-25T05:37:31.164026+0000","last_active":"2024-03-25T06:03:59.255566+0000","last_peered":"2024-03-25T06:03:59.255566+0000","last_clean":"2024-03-25T06:03:59.255566+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T06:03:59.255566+0000","last_undegraded":"2024-03-25T06:03:59.255566+0000","last_fullsized":"2024-03-25T06:03:59.255566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1715","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.520282+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T06:03:54.520282+0000","last_peered":"2024-03-25T06:03:54.520282+0000","last_clean":"2024-03-25T06:03:54.520282+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T06:03:54.520282+0000","last_undegraded":"2024-03-25T06:03:54.520282+0000","last_fullsized":"2024-03-25T06:03:54.520282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1671","reported_seq":1709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.734156+0000","last_change":"2024-03-25T05:37:31.166178+0000","last_active":"2024-03-25T06:03:53.734156+0000","last_peered":"2024-03-25T06:03:53.734156+0000","last_clean":"2024-03-25T06:03:53.734156+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T06:03:53.734156+0000","last_undegraded":"2024-03-25T06:03:53.734156+0000","last_fullsized":"2024-03-25T06:03:53.734156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1749","reported_seq":1786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.779900+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T06:03:53.779900+0000","last_peered":"2024-03-25T06:03:53.779900+0000","last_clean":"2024-03-25T06:03:53.779900+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T06:03:53.779900+0000","last_undegraded":"2024-03-25T06:03:53.779900+0000","last_fullsized":"2024-03-25T06:03:53.779900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1712","reported_seq":1749,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.108884+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T06:03:54.108884+0000","last_peered":"2024-03-25T06:03:54.108884+0000","last_clean":"2024-03-25T06:03:54.108884+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T06:03:54.108884+0000","last_undegraded":"2024-03-25T06:03:54.108884+0000","last_fullsized":"2024-03-25T06:03:54.108884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1687","reported_seq":1725,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.991957+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T06:03:53.991957+0000","last_peered":"2024-03-25T06:03:53.991957+0000","last_clean":"2024-03-25T06:03:53.991957+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T06:03:53.991957+0000","last_undegraded":"2024-03-25T06:03:53.991957+0000","last_fullsized":"2024-03-25T06:03:53.991957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1687,"log_dups_size":0,"ondisk_log_size":1687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1721","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.522746+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T06:03:51.522746+0000","last_peered":"2024-03-25T06:03:51.522746+0000","last_clean":"2024-03-25T06:03:51.522746+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T06:03:51.522746+0000","last_undegraded":"2024-03-25T06:03:51.522746+0000","last_fullsized":"2024-03-25T06:03:51.522746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1721","reported_seq":1758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.454892+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T06:03:54.454892+0000","last_peered":"2024-03-25T06:03:54.454892+0000","last_clean":"2024-03-25T06:03:54.454892+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T06:03:54.454892+0000","last_undegraded":"2024-03-25T06:03:54.454892+0000","last_fullsized":"2024-03-25T06:03:54.454892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1756","reported_seq":1792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219689+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T06:03:59.219689+0000","last_peered":"2024-03-25T06:03:59.219689+0000","last_clean":"2024-03-25T06:03:59.219689+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T06:03:59.219689+0000","last_undegraded":"2024-03-25T06:03:59.219689+0000","last_fullsized":"2024-03-25T06:03:59.219689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1721","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.143173+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T06:03:52.143173+0000","last_peered":"2024-03-25T06:03:52.143173+0000","last_clean":"2024-03-25T06:03:52.143173+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T06:03:52.143173+0000","last_undegraded":"2024-03-25T06:03:52.143173+0000","last_fullsized":"2024-03-25T06:03:52.143173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1764","reported_seq":1801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.241081+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T06:03:54.241081+0000","last_peered":"2024-03-25T06:03:54.241081+0000","last_clean":"2024-03-25T06:03:54.241081+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T06:03:54.241081+0000","last_undegraded":"2024-03-25T06:03:54.241081+0000","last_fullsized":"2024-03-25T06:03:54.241081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1670","reported_seq":1707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.080061+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T06:03:50.080061+0000","last_peered":"2024-03-25T06:03:50.080061+0000","last_clean":"2024-03-25T06:03:50.080061+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T06:03:50.080061+0000","last_undegraded":"2024-03-25T06:03:50.080061+0000","last_fullsized":"2024-03-25T06:03:50.080061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1712","reported_seq":1749,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.135484+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T06:03:54.135484+0000","last_peered":"2024-03-25T06:03:54.135484+0000","last_clean":"2024-03-25T06:03:54.135484+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T06:03:54.135484+0000","last_undegraded":"2024-03-25T06:03:54.135484+0000","last_fullsized":"2024-03-25T06:03:54.135484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'1631","reported_seq":1668,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.535878+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T06:03:53.535878+0000","last_peered":"2024-03-25T06:03:53.535878+0000","last_clean":"2024-03-25T06:03:53.535878+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T06:03:53.535878+0000","last_undegraded":"2024-03-25T06:03:53.535878+0000","last_fullsized":"2024-03-25T06:03:53.535878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'1756","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.905819+0000","last_change":"2024-03-25T05:38:20.652965+0000","last_active":"2024-03-25T06:03:53.905819+0000","last_peered":"2024-03-25T06:03:53.905819+0000","last_clean":"2024-03-25T06:03:53.905819+0000","last_became_active":"2024-03-25T05:38:20.652582+0000","last_became_peered":"2024-03-25T05:38:20.652582+0000","last_unstale":"2024-03-25T06:03:53.905819+0000","last_undegraded":"2024-03-25T06:03:53.905819+0000","last_fullsized":"2024-03-25T06:03:53.905819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:25.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1702","reported_seq":1738,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.226036+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T06:03:59.226036+0000","last_peered":"2024-03-25T06:03:59.226036+0000","last_clean":"2024-03-25T06:03:59.226036+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T06:03:59.226036+0000","last_undegraded":"2024-03-25T06:03:59.226036+0000","last_fullsized":"2024-03-25T06:03:59.226036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1702,"log_dups_size":0,"ondisk_log_size":1702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:20.495852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1680","reported_seq":1715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.078984+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T06:03:52.078984+0000","last_peered":"2024-03-25T06:03:52.078984+0000","last_clean":"2024-03-25T06:03:52.078984+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T06:03:52.078984+0000","last_undegraded":"2024-03-25T06:03:52.078984+0000","last_fullsized":"2024-03-25T06:03:52.078984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1615","reported_seq":1651,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.791866+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T06:03:53.791866+0000","last_peered":"2024-03-25T06:03:53.791866+0000","last_clean":"2024-03-25T06:03:53.791866+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T06:03:53.791866+0000","last_undegraded":"2024-03-25T06:03:53.791866+0000","last_fullsized":"2024-03-25T06:03:53.791866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1671","reported_seq":1706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.257610+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T06:03:54.257610+0000","last_peered":"2024-03-25T06:03:54.257610+0000","last_clean":"2024-03-25T06:03:54.257610+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T06:03:54.257610+0000","last_undegraded":"2024-03-25T06:03:54.257610+0000","last_fullsized":"2024-03-25T06:03:54.257610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1729","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.551808+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T06:03:53.551808+0000","last_peered":"2024-03-25T06:03:53.551808+0000","last_clean":"2024-03-25T06:03:53.551808+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T06:03:53.551808+0000","last_undegraded":"2024-03-25T06:03:53.551808+0000","last_fullsized":"2024-03-25T06:03:53.551808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1754","reported_seq":1790,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.143674+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T06:03:54.143674+0000","last_peered":"2024-03-25T06:03:54.143674+0000","last_clean":"2024-03-25T06:03:54.143674+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T06:03:54.143674+0000","last_undegraded":"2024-03-25T06:03:54.143674+0000","last_fullsized":"2024-03-25T06:03:54.143674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1692","reported_seq":1727,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.366948+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T06:03:54.366948+0000","last_peered":"2024-03-25T06:03:54.366948+0000","last_clean":"2024-03-25T06:03:54.366948+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T06:03:54.366948+0000","last_undegraded":"2024-03-25T06:03:54.366948+0000","last_fullsized":"2024-03-25T06:03:54.366948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1671","reported_seq":1691,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.980717+0000","last_change":"2024-03-25T05:38:20.655980+0000","last_active":"2024-03-25T06:03:53.980717+0000","last_peered":"2024-03-25T06:03:53.980717+0000","last_clean":"2024-03-25T06:03:53.980717+0000","last_became_active":"2024-03-25T05:38:20.655743+0000","last_became_peered":"2024-03-25T05:38:20.655743+0000","last_unstale":"2024-03-25T06:03:53.980717+0000","last_undegraded":"2024-03-25T06:03:53.980717+0000","last_fullsized":"2024-03-25T06:03:53.980717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1649","reported_seq":1685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.294852+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T06:03:54.294852+0000","last_peered":"2024-03-25T06:03:54.294852+0000","last_clean":"2024-03-25T06:03:54.294852+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T06:03:54.294852+0000","last_undegraded":"2024-03-25T06:03:54.294852+0000","last_fullsized":"2024-03-25T06:03:54.294852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1743","reported_seq":1779,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.444157+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T06:03:54.444157+0000","last_peered":"2024-03-25T06:03:54.444157+0000","last_clean":"2024-03-25T06:03:54.444157+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T06:03:54.444157+0000","last_undegraded":"2024-03-25T06:03:54.444157+0000","last_fullsized":"2024-03-25T06:03:54.444157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1735","reported_seq":1774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.377939+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T06:03:54.377939+0000","last_peered":"2024-03-25T06:03:54.377939+0000","last_clean":"2024-03-25T06:03:54.377939+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T06:03:54.377939+0000","last_undegraded":"2024-03-25T06:03:54.377939+0000","last_fullsized":"2024-03-25T06:03:54.377939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1790","reported_seq":1827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219156+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T06:03:59.219156+0000","last_peered":"2024-03-25T06:03:59.219156+0000","last_clean":"2024-03-25T06:03:59.219156+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T06:03:59.219156+0000","last_undegraded":"2024-03-25T06:03:59.219156+0000","last_fullsized":"2024-03-25T06:03:59.219156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1653","reported_seq":1691,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.048440+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T06:03:54.048440+0000","last_peered":"2024-03-25T06:03:54.048440+0000","last_clean":"2024-03-25T06:03:54.048440+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T06:03:54.048440+0000","last_undegraded":"2024-03-25T06:03:54.048440+0000","last_fullsized":"2024-03-25T06:03:54.048440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1653,"log_dups_size":0,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1632","reported_seq":1670,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.165893+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T06:03:50.165893+0000","last_peered":"2024-03-25T06:03:50.165893+0000","last_clean":"2024-03-25T06:03:50.165893+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T06:03:50.165893+0000","last_undegraded":"2024-03-25T06:03:50.165893+0000","last_fullsized":"2024-03-25T06:03:50.165893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":16475339,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":5893,"num_read_kb":1496822,"num_write":138176,"num_write_kb":3811190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2846720,"data_stored":32432128,"data_compressed":1517935,"data_compressed_allocated":2170880,"data_compressed_original":31756288,"omap_allocated":0,"internal_metadata":0},"log_size":195818,"ondisk_log_size":195818,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109510,"ondisk_log_size":109510,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":233712377,"num_objects":156,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":156,"num_whiteouts":0,"num_read":2368,"num_read_kb":13141,"num_write":159035,"num_write_kb":1156715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":312238080,"data_stored":467424754,"data_compressed":49492176,"data_compressed_allocated":73285632,"data_compressed_original":228712448,"omap_allocated":0,"internal_metadata":0},"log_size":154446,"ondisk_log_size":154446,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575168,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":762856,"kb_used_data":37600,"kb_used_omap":1,"kb_used_meta":725246,"kb_avail":93608984,"statfs":{"total":96636764160,"available":95855599616,"internally_reserved":0,"allocated":38502400,"data_stored":61630114,"data_compressed":6637588,"data_compressed_allocated":9715712,"data_compressed_original":33050624,"omap_allocated":1590,"internal_metadata":742652362},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575169,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":832708,"kb_used_data":47868,"kb_used_omap":1,"kb_used_meta":784830,"kb_avail":93539132,"statfs":{"total":96636764160,"available":95784071168,"internally_reserved":0,"allocated":49016832,"data_stored":81890893,"data_compressed":8454916,"data_compressed_allocated":12382208,"data_compressed_original":45449216,"omap_allocated":1594,"internal_metadata":803666374},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575168,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":798280,"kb_used_data":41088,"kb_used_omap":1,"kb_used_meta":757182,"kb_avail":93573560,"statfs":{"total":96636764160,"available":95819325440,"internally_reserved":0,"allocated":42074112,"data_stored":64998314,"data_compressed":6265657,"data_compressed_allocated":9469952,"data_compressed_original":32608256,"omap_allocated":1595,"internal_metadata":775354821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575168,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":722028,"kb_used_data":37028,"kb_used_omap":1,"kb_used_meta":684990,"kb_avail":93649812,"statfs":{"total":96636764160,"available":95897407488,"internally_reserved":0,"allocated":37916672,"data_stored":59007360,"data_compressed":5831432,"data_compressed_allocated":8654848,"data_compressed_original":29937664,"omap_allocated":1595,"internal_metadata":701430213},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575166,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":850692,"kb_used_data":57596,"kb_used_omap":1,"kb_used_meta":793086,"kb_avail":93521148,"statfs":{"total":96636764160,"available":95765655552,"internally_reserved":0,"allocated":58978304,"data_stored":94809711,"data_compressed":10106287,"data_compressed_allocated":14716928,"data_compressed_original":50745344,"omap_allocated":1593,"internal_metadata":812120519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457484,"kb_used_data":29380,"kb_used_omap":1,"kb_used_meta":428094,"kb_avail":93914356,"statfs":{"total":96636764160,"available":96168300544,"internally_reserved":0,"allocated":30085120,"data_stored":47804932,"data_compressed":4488376,"data_compressed_allocated":6733824,"data_compressed_original":24653824,"omap_allocated":1595,"internal_metadata":438368709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575167,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":882604,"kb_used_data":31140,"kb_used_omap":1,"kb_used_meta":851454,"kb_avail":93489236,"statfs":{"total":96636764160,"available":95732977664,"internally_reserved":0,"allocated":31887360,"data_stored":51585356,"data_compressed":5040023,"data_compressed_allocated":7471104,"data_compressed_original":27365376,"omap_allocated":1595,"internal_metadata":871889349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575168,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569564,"kb_used_data":28948,"kb_used_omap":1,"kb_used_meta":540606,"kb_avail":93802276,"statfs":{"total":96636764160,"available":96053530624,"internally_reserved":0,"allocated":29642752,"data_stored":47853786,"data_compressed":4606583,"data_compressed_allocated":6889472,"data_compressed_original":25300992,"omap_allocated":1595,"internal_metadata":553580997},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28741632,"data_stored":41943914,"data_compressed":4333814,"data_compressed_allocated":6488064,"data_compressed_original":19718144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31145984,"data_stored":46138876,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29335552,"data_stored":41944756,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58363904,"data_stored":91099935,"data_compressed":9938069,"data_compressed_allocated":14479360,"data_compressed_original":47243264,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37269504,"data_stored":54527536,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41308160,"data_stored":58724442,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":74322685,"data_compressed":8104798,"data_compressed_allocated":11894784,"data_compressed_original":38100992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37933056,"data_stored":58722610,"data_compressed":6502788,"data_compressed_allocated":9523200,"data_compressed_original":30347264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":4800512,"data_compressed":222366,"data_compressed_allocated":331776,"data_compressed_original":4653056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":5324800,"data_compressed":249368,"data_compressed_allocated":360448,"data_compressed_original":5234688,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":5738496,"data_compressed":269421,"data_compressed_allocated":380928,"data_compressed_original":5660672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":3588096,"data_compressed":168218,"data_compressed_allocated":237568,"data_compressed_original":3502080,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":4358144,"data_compressed":204710,"data_compressed_allocated":286720,"data_compressed_original":4288512,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":2035712,"data_compressed":95409,"data_compressed_allocated":135168,"data_compressed_original":1990656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":4390912,"data_compressed":206071,"data_compressed_allocated":290816,"data_compressed_original":4296704,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":2195456,"data_compressed":102372,"data_compressed_allocated":147456,"data_compressed_original":2129920,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T06:04:00.874 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-25T06:04:00.875 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T06:04:01.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.096+0000 7fb52e000640 1 Processor -- start 2024-03-25T06:04:01.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.097+0000 7fb52e000640 1 -- start start 2024-03-25T06:04:01.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.098+0000 7fb52e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5280c67e0 0x7fb5280c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.098+0000 7fb52e000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb5280c6c10 0x7fb5280c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.098+0000 7fb52e000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5280cbbe0 con 0x7fb528154120 2024-03-25T06:04:01.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.098+0000 7fb52e000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb528154500 con 0x7fb5280c6c10 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.098+0000 7fb52e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52806b250 con 0x7fb5280c67e0 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.099+0000 7fb52cc00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb528154120 0x7fb5280cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47434/0 (socket says 172.21.15.102:47434) 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.099+0000 7fb52cc00640 1 -- 172.21.15.102:0/2286569186 learned_addr learned my addr 172.21.15.102:0/2286569186 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.099+0000 7fb52d600640 1 --2- 172.21.15.102:0/2286569186 >> v2:172.21.15.187:3300/0 conn(0x7fb5280c6c10 0x7fb5280c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.099+0000 7fb52d600640 1 -- 172.21.15.102:0/2286569186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5280c67e0 msgr2=0x7fb5280c7d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.099+0000 7fb52d600640 1 --2- 172.21.15.102:0/2286569186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5280c67e0 0x7fb5280c7d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.099+0000 7fb52d600640 1 -- 172.21.15.102:0/2286569186 >> v1:172.21.15.102:6789/0 conn(0x7fb528154120 legacy=0x7fb5280cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.099+0000 7fb52d600640 1 -- 172.21.15.102:0/2286569186 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280ca280 con 0x7fb5280c6c10 2024-03-25T06:04:01.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.101+0000 7fb52d600640 1 --2- 172.21.15.102:0/2286569186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 0x7fb5280c8240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb520009d90 tx=0x7fb52002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d03ee5cc61c978b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.101+0000 7fb527400640 1 -- 172.21.15.102:0/2286569186 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52002cc80 con 0x7fb5280c6c10 2024-03-25T06:04:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.101+0000 7fb527400640 1 -- 172.21.15.102:0/2286569186 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52002cde0 con 0x7fb5280c6c10 2024-03-25T06:04:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.101+0000 7fb527400640 1 -- 172.21.15.102:0/2286569186 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520034660 con 0x7fb5280c6c10 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 -- 172.21.15.102:0/2286569186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 msgr2=0x7fb5280c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 --2- 172.21.15.102:0/2286569186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 0x7fb5280c8240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb520009d90 tx=0x7fb52002bed0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 -- 172.21.15.102:0/2286569186 shutdown_connections 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 --2- 172.21.15.102:0/2286569186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 0x7fb5280c8240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 --2- 172.21.15.102:0/2286569186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5280c67e0 0x7fb5280c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 -- 172.21.15.102:0/2286569186 >> 172.21.15.102:0/2286569186 conn(0x7fb5280cf3e0 msgr2=0x7fb5280cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 -- 172.21.15.102:0/2286569186 shutdown_connections 2024-03-25T06:04:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.102+0000 7fb52e000640 1 -- 172.21.15.102:0/2286569186 wait complete. 2024-03-25T06:04:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.105+0000 7fb52e000640 1 Processor -- start 2024-03-25T06:04:01.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.105+0000 7fb52e000640 1 -- start start 2024-03-25T06:04:01.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.106+0000 7fb52e000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280c67e0 0x7fb5280c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.106+0000 7fb52e000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 0x7fb52814d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.106+0000 7fb52e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb528154120 0x7fb52814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.106+0000 7fb52e000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528159480 con 0x7fb5280c67e0 2024-03-25T06:04:01.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.106+0000 7fb52e000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5281eaa20 con 0x7fb5280c6c10 2024-03-25T06:04:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.106+0000 7fb52e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5281eafe0 con 0x7fb528154120 2024-03-25T06:04:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb528154120 0x7fb52814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb528154120 0x7fb52814dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38190/0 (socket says 172.21.15.102:38190) 2024-03-25T06:04:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 -- 172.21.15.102:0/375133247 learned_addr learned my addr 172.21.15.102:0/375133247 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 -- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 msgr2=0x7fb52814d700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-25T06:04:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 0x7fb52814d700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 -- 172.21.15.102:0/375133247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280c67e0 msgr2=0x7fb5280c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280c67e0 0x7fb5280c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.107+0000 7fb52d600640 1 -- 172.21.15.102:0/375133247 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb520009a70 con 0x7fb528154120 2024-03-25T06:04:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.108+0000 7fb52d600640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb528154120 0x7fb52814dc40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb520009d90 tx=0x7fb520004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:01.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.108+0000 7fb524c00640 1 -- 172.21.15.102:0/375133247 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52003e610 con 0x7fb528154120 2024-03-25T06:04:01.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.108+0000 7fb524c00640 1 -- 172.21.15.102:0/375133247 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52003e790 con 0x7fb528154120 2024-03-25T06:04:01.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.108+0000 7fb524c00640 1 -- 172.21.15.102:0/375133247 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52003eb40 con 0x7fb528154120 2024-03-25T06:04:01.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.108+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5281518e0 con 0x7fb528154120 2024-03-25T06:04:01.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.109+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5281599b0 con 0x7fb528154120 2024-03-25T06:04:01.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.110+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb528159b70 con 0x7fb528154120 2024-03-25T06:04:01.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.111+0000 7fb524c00640 1 -- 172.21.15.102:0/375133247 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb52003b050 con 0x7fb528154120 2024-03-25T06:04:01.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.113+0000 7fb524c00640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb50806b810 0x7fb50806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.113+0000 7fb524c00640 1 -- 172.21.15.102:0/375133247 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb5200ad090 con 0x7fb528154120 2024-03-25T06:04:01.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.113+0000 7fb52cc00640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb50806b810 0x7fb50806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.114+0000 7fb52cc00640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb50806b810 0x7fb50806dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb51c000f60 tx=0x7fb51c007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.121+0000 7fb524c00640 1 -- 172.21.15.102:0/375133247 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb520077690 con 0x7fb528154120 2024-03-25T06:04:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.320+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5280ca7b0 con 0x7fb50806b810 2024-03-25T06:04:01.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.329+0000 7fb524c00640 1 -- 172.21.15.102:0/375133247 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336148 (secure 0 0 0) 0x7fb51c0058b0 con 0x7fb50806b810 2024-03-25T06:04:01.329 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T06:04:01.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb50806b810 msgr2=0x7fb50806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb50806b810 0x7fb50806dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb51c000f60 tx=0x7fb51c007a80 comp rx=0 tx=0).stop 2024-03-25T06:04:01.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb528154120 msgr2=0x7fb52814dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb528154120 0x7fb52814dc40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb520009d90 tx=0x7fb520004a40 comp rx=0 tx=0).stop 2024-03-25T06:04:01.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 shutdown_connections 2024-03-25T06:04:01.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb50806b810 0x7fb50806dcd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb528154120 0x7fb52814dc40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5280c6c10 0x7fb52814d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 --2- 172.21.15.102:0/375133247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280c67e0 0x7fb5280c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 >> 172.21.15.102:0/375133247 conn(0x7fb5280cf3e0 msgr2=0x7fb52806b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:01.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 shutdown_connections 2024-03-25T06:04:01.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.335+0000 7fb52e000640 1 -- 172.21.15.102:0/375133247 wait complete. 2024-03-25T06:04:01.347 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":818,"stamp":"2024-03-25T06:03:59.348385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":250778084,"num_objects":245,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":8377,"num_read_kb":1510063,"num_write":298461,"num_write_kb":4970321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":459891,"ondisk_log_size":459891,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5876216,"kb_used_data":310648,"kb_used_omap":12,"kb_used_meta":5565491,"kb_avail":749098504,"statfs":{"total":773094113280,"available":767076868096,"internally_reserved":0,"allocated":318103552,"data_stored":509580466,"data_compressed":51430862,"data_compressed_allocated":76034048,"data_compressed_original":269111296,"omap_allocated":12752,"internal_metadata":5699063344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,2,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212575876,"num_objects":-1650,"num_object_clones":0,"num_object_copies":-5378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1650,"num_whiteouts":0,"num_read":8,"num_read_kb":139,"num_write":2335,"num_write_kb":24532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"2.1f","version":"27'1871","reported_seq":1910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.671840+0000","last_change":"2024-03-25T05:37:30.423912+0000","last_active":"2024-03-25T06:03:54.671840+0000","last_peered":"2024-03-25T06:03:54.671840+0000","last_clean":"2024-03-25T06:03:54.671840+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T06:03:54.671840+0000","last_undegraded":"2024-03-25T06:03:54.671840+0000","last_fullsized":"2024-03-25T06:03:54.671840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1876,"num_write_kb":13587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1705","reported_seq":1743,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.233956+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T06:03:53.233956+0000","last_peered":"2024-03-25T06:03:53.233956+0000","last_clean":"2024-03-25T06:03:53.233956+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T06:03:53.233956+0000","last_undegraded":"2024-03-25T06:03:53.233956+0000","last_fullsized":"2024-03-25T06:03:53.233956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'6032","reported_seq":6143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.467422+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T06:03:54.467422+0000","last_peered":"2024-03-25T06:03:54.467422+0000","last_clean":"2024-03-25T06:03:54.467422+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T06:03:54.467422+0000","last_undegraded":"2024-03-25T06:03:54.467422+0000","last_fullsized":"2024-03-25T06:03:54.467422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6032,"log_dups_size":0,"ondisk_log_size":6032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:43:49.363333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421387,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":4292,"num_write_kb":115305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'5159","reported_seq":5199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.715919+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T06:03:54.715919+0000","last_peered":"2024-03-25T06:03:54.715919+0000","last_clean":"2024-03-25T06:03:54.715919+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T06:03:54.715919+0000","last_undegraded":"2024-03-25T06:03:54.715919+0000","last_fullsized":"2024-03-25T06:03:54.715919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5171,"num_write_kb":32292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1710","reported_seq":1747,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.232486+0000","last_change":"2024-03-25T05:37:31.155929+0000","last_active":"2024-03-25T06:03:59.232486+0000","last_peered":"2024-03-25T06:03:59.232486+0000","last_clean":"2024-03-25T06:03:59.232486+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T06:03:59.232486+0000","last_undegraded":"2024-03-25T06:03:59.232486+0000","last_fullsized":"2024-03-25T06:03:59.232486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5965","reported_seq":6066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.539973+0000","last_change":"2024-03-25T05:38:20.806371+0000","last_active":"2024-03-25T06:03:54.539973+0000","last_peered":"2024-03-25T06:03:54.539973+0000","last_clean":"2024-03-25T06:03:54.539973+0000","last_became_active":"2024-03-25T05:38:20.805843+0000","last_became_peered":"2024-03-25T05:38:20.805843+0000","last_unstale":"2024-03-25T06:03:54.539973+0000","last_undegraded":"2024-03-25T06:03:54.539973+0000","last_fullsized":"2024-03-25T06:03:54.539973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5965,"log_dups_size":0,"ondisk_log_size":5965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:02:43.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052672,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":16002,"num_write":4126,"num_write_kb":114621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7852","reported_seq":7890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.642765+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T06:03:54.642765+0000","last_peered":"2024-03-25T06:03:54.642765+0000","last_clean":"2024-03-25T06:03:54.642765+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T06:03:54.642765+0000","last_undegraded":"2024-03-25T06:03:54.642765+0000","last_fullsized":"2024-03-25T06:03:54.642765+0000","mapping_epoch":17,"log_start":"27'800","ondisk_log_start":"27'800","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7052,"log_dups_size":0,"ondisk_log_size":7052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7854,"num_write_kb":54498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1762","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.355195+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T06:03:54.355195+0000","last_peered":"2024-03-25T06:03:54.355195+0000","last_clean":"2024-03-25T06:03:54.355195+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T06:03:54.355195+0000","last_undegraded":"2024-03-25T06:03:54.355195+0000","last_fullsized":"2024-03-25T06:03:54.355195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1762,"log_dups_size":0,"ondisk_log_size":1762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5977","reported_seq":6132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.451854+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T06:03:54.451854+0000","last_peered":"2024-03-25T06:03:54.451854+0000","last_clean":"2024-03-25T06:03:54.451854+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T06:03:54.451854+0000","last_undegraded":"2024-03-25T06:03:54.451854+0000","last_fullsized":"2024-03-25T06:03:54.451854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5977,"log_dups_size":0,"ondisk_log_size":5977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":31496,"num_write":4147,"num_write_kb":107246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4412","reported_seq":4450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:02:30.058411+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T06:02:30.058411+0000","last_peered":"2024-03-25T06:02:30.058411+0000","last_clean":"2024-03-25T06:02:30.058411+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T06:02:30.058411+0000","last_undegraded":"2024-03-25T06:02:30.058411+0000","last_fullsized":"2024-03-25T06:02:30.058411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4409,"num_write_kb":35629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1687","reported_seq":1723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.405629+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T06:03:54.405629+0000","last_peered":"2024-03-25T06:03:54.405629+0000","last_clean":"2024-03-25T06:03:54.405629+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T06:03:54.405629+0000","last_undegraded":"2024-03-25T06:03:54.405629+0000","last_fullsized":"2024-03-25T06:03:54.405629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1687,"log_dups_size":0,"ondisk_log_size":1687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5903","reported_seq":6001,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.298649+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T06:03:54.298649+0000","last_peered":"2024-03-25T06:03:54.298649+0000","last_clean":"2024-03-25T06:03:54.298649+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T06:03:54.298649+0000","last_undegraded":"2024-03-25T06:03:54.298649+0000","last_fullsized":"2024-03-25T06:03:54.298649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5903,"log_dups_size":0,"ondisk_log_size":5903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":4123,"num_write_kb":118597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1733","reported_seq":1770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.278722+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T06:03:54.278722+0000","last_peered":"2024-03-25T06:03:54.278722+0000","last_clean":"2024-03-25T06:03:54.278722+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T06:03:54.278722+0000","last_undegraded":"2024-03-25T06:03:54.278722+0000","last_fullsized":"2024-03-25T06:03:54.278722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'5826","reported_seq":5865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.701813+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T06:03:54.701813+0000","last_peered":"2024-03-25T06:03:54.701813+0000","last_clean":"2024-03-25T06:03:54.701813+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T06:03:54.701813+0000","last_undegraded":"2024-03-25T06:03:54.701813+0000","last_fullsized":"2024-03-25T06:03:54.701813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5838,"num_write_kb":40868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'6410","reported_seq":6548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.414898+0000","last_change":"2024-03-25T05:38:20.653005+0000","last_active":"2024-03-25T06:03:54.414898+0000","last_peered":"2024-03-25T06:03:54.414898+0000","last_clean":"2024-03-25T06:03:54.414898+0000","last_became_active":"2024-03-25T05:38:20.652530+0000","last_became_peered":"2024-03-25T05:38:20.652530+0000","last_unstale":"2024-03-25T06:03:54.414898+0000","last_undegraded":"2024-03-25T06:03:54.414898+0000","last_fullsized":"2024-03-25T06:03:54.414898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6410,"log_dups_size":0,"ondisk_log_size":6410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:23.447608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1391862,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":25146,"num_write":4561,"num_write_kb":128586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1751","reported_seq":1787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.889253+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T06:03:53.889253+0000","last_peered":"2024-03-25T06:03:53.889253+0000","last_clean":"2024-03-25T06:03:53.889253+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T06:03:53.889253+0000","last_undegraded":"2024-03-25T06:03:53.889253+0000","last_fullsized":"2024-03-25T06:03:53.889253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'5251","reported_seq":5291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.654958+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T06:03:54.654958+0000","last_peered":"2024-03-25T06:03:54.654958+0000","last_clean":"2024-03-25T06:03:54.654958+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T06:03:54.654958+0000","last_undegraded":"2024-03-25T06:03:54.654958+0000","last_fullsized":"2024-03-25T06:03:54.654958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5247,"num_write_kb":40419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'6237","reported_seq":6382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.156774+0000","last_change":"2024-03-25T05:38:20.809959+0000","last_active":"2024-03-25T06:03:52.156774+0000","last_peered":"2024-03-25T06:03:52.156774+0000","last_clean":"2024-03-25T06:03:52.156774+0000","last_became_active":"2024-03-25T05:38:20.809544+0000","last_became_peered":"2024-03-25T05:38:20.809544+0000","last_unstale":"2024-03-25T06:03:52.156774+0000","last_undegraded":"2024-03-25T06:03:52.156774+0000","last_fullsized":"2024-03-25T06:03:52.156774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6237,"log_dups_size":0,"ondisk_log_size":6237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:17:17.764182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":26924,"num_write":4469,"num_write_kb":121611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1763","reported_seq":1800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.183098+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T06:03:54.183098+0000","last_peered":"2024-03-25T06:03:54.183098+0000","last_clean":"2024-03-25T06:03:54.183098+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T06:03:54.183098+0000","last_undegraded":"2024-03-25T06:03:54.183098+0000","last_fullsized":"2024-03-25T06:03:54.183098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2773","reported_seq":2813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.683761+0000","last_change":"2024-03-25T05:37:30.422594+0000","last_active":"2024-03-25T06:03:54.683761+0000","last_peered":"2024-03-25T06:03:54.683761+0000","last_clean":"2024-03-25T06:03:54.683761+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T06:03:54.683761+0000","last_undegraded":"2024-03-25T06:03:54.683761+0000","last_fullsized":"2024-03-25T06:03:54.683761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2773,"log_dups_size":0,"ondisk_log_size":2773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2784,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5897","reported_seq":6115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.164582+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T06:03:54.164582+0000","last_peered":"2024-03-25T06:03:54.164582+0000","last_clean":"2024-03-25T06:03:54.164582+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T06:03:54.164582+0000","last_undegraded":"2024-03-25T06:03:54.164582+0000","last_fullsized":"2024-03-25T06:03:54.164582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5897,"log_dups_size":0,"ondisk_log_size":5897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":47244,"num_write":4143,"num_write_kb":109091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1771","reported_seq":1809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.088254+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T06:03:52.088254+0000","last_peered":"2024-03-25T06:03:52.088254+0000","last_clean":"2024-03-25T06:03:52.088254+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T06:03:52.088254+0000","last_undegraded":"2024-03-25T06:03:52.088254+0000","last_fullsized":"2024-03-25T06:03:52.088254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1612","reported_seq":1652,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.715052+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T06:03:54.715052+0000","last_peered":"2024-03-25T06:03:54.715052+0000","last_clean":"2024-03-25T06:03:54.715052+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T06:03:54.715052+0000","last_undegraded":"2024-03-25T06:03:54.715052+0000","last_fullsized":"2024-03-25T06:03:54.715052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5907","reported_seq":5991,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.198942+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T06:03:54.198942+0000","last_peered":"2024-03-25T06:03:54.198942+0000","last_clean":"2024-03-25T06:03:54.198942+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T06:03:54.198942+0000","last_undegraded":"2024-03-25T06:03:54.198942+0000","last_fullsized":"2024-03-25T06:03:54.198942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315648,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4053,"num_write_kb":104860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1711","reported_seq":1748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.225436+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T06:03:59.225436+0000","last_peered":"2024-03-25T06:03:59.225436+0000","last_clean":"2024-03-25T06:03:59.225436+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T06:03:59.225436+0000","last_undegraded":"2024-03-25T06:03:59.225436+0000","last_fullsized":"2024-03-25T06:03:59.225436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'2886","reported_seq":2925,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.726047+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T06:03:54.726047+0000","last_peered":"2024-03-25T06:03:54.726047+0000","last_clean":"2024-03-25T06:03:54.726047+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T06:03:54.726047+0000","last_undegraded":"2024-03-25T06:03:54.726047+0000","last_fullsized":"2024-03-25T06:03:54.726047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2906,"num_write_kb":22398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'6069","reported_seq":6154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.575479+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T06:03:54.575479+0000","last_peered":"2024-03-25T06:03:54.575479+0000","last_clean":"2024-03-25T06:03:54.575479+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T06:03:54.575479+0000","last_undegraded":"2024-03-25T06:03:54.575479+0000","last_fullsized":"2024-03-25T06:03:54.575479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4301,"num_write_kb":129624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1685","reported_seq":1722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.988242+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T06:03:53.988242+0000","last_peered":"2024-03-25T06:03:53.988242+0000","last_clean":"2024-03-25T06:03:53.988242+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T06:03:53.988242+0000","last_undegraded":"2024-03-25T06:03:53.988242+0000","last_fullsized":"2024-03-25T06:03:53.988242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1685,"log_dups_size":0,"ondisk_log_size":1685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4481","reported_seq":4521,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.707955+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T06:03:54.707955+0000","last_peered":"2024-03-25T06:03:54.707955+0000","last_clean":"2024-03-25T06:03:54.707955+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T06:03:54.707955+0000","last_undegraded":"2024-03-25T06:03:54.707955+0000","last_fullsized":"2024-03-25T06:03:54.707955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4481,"log_dups_size":0,"ondisk_log_size":4481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7147,"num_write_kb":35866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'6335","reported_seq":6502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.271690+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T06:03:54.271690+0000","last_peered":"2024-03-25T06:03:54.271690+0000","last_clean":"2024-03-25T06:03:54.271690+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T06:03:54.271690+0000","last_undegraded":"2024-03-25T06:03:54.271690+0000","last_fullsized":"2024-03-25T06:03:54.271690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6335,"log_dups_size":0,"ondisk_log_size":6335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:43:13.693546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":33782,"num_write":4565,"num_write_kb":115382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1750","reported_seq":1788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.914901+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T06:03:53.914901+0000","last_peered":"2024-03-25T06:03:53.914901+0000","last_clean":"2024-03-25T06:03:53.914901+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T06:03:53.914901+0000","last_undegraded":"2024-03-25T06:03:53.914901+0000","last_fullsized":"2024-03-25T06:03:53.914901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'5273","reported_seq":5313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.690625+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T06:03:54.690625+0000","last_peered":"2024-03-25T06:03:54.690625+0000","last_clean":"2024-03-25T06:03:54.690625+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T06:03:54.690625+0000","last_undegraded":"2024-03-25T06:03:54.690625+0000","last_fullsized":"2024-03-25T06:03:54.690625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5274,"num_write_kb":36361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'6077","reported_seq":6315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.990727+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T06:03:58.990727+0000","last_peered":"2024-03-25T06:03:58.990727+0000","last_clean":"2024-03-25T06:03:58.990727+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T06:03:58.990727+0000","last_undegraded":"2024-03-25T06:03:58.990727+0000","last_fullsized":"2024-03-25T06:03:58.990727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6077,"log_dups_size":0,"ondisk_log_size":6077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629177,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":205,"num_read_kb":52070,"num_write":4226,"num_write_kb":109752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1707","reported_seq":1729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.766841+0000","last_change":"2024-03-25T05:38:20.806229+0000","last_active":"2024-03-25T06:03:51.766841+0000","last_peered":"2024-03-25T06:03:51.766841+0000","last_clean":"2024-03-25T06:03:51.766841+0000","last_became_active":"2024-03-25T05:38:20.805934+0000","last_became_peered":"2024-03-25T05:38:20.805934+0000","last_unstale":"2024-03-25T06:03:51.766841+0000","last_undegraded":"2024-03-25T06:03:51.766841+0000","last_fullsized":"2024-03-25T06:03:51.766841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1707,"log_dups_size":0,"ondisk_log_size":1707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'5138","reported_seq":5178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.723442+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T06:03:54.723442+0000","last_peered":"2024-03-25T06:03:54.723442+0000","last_clean":"2024-03-25T06:03:54.723442+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T06:03:54.723442+0000","last_undegraded":"2024-03-25T06:03:54.723442+0000","last_fullsized":"2024-03-25T06:03:54.723442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5138,"log_dups_size":0,"ondisk_log_size":5138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5143,"num_write_kb":40167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'6967","reported_seq":7059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.761754+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T06:03:53.761754+0000","last_peered":"2024-03-25T06:03:53.761754+0000","last_clean":"2024-03-25T06:03:53.761754+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T06:03:53.761754+0000","last_undegraded":"2024-03-25T06:03:53.761754+0000","last_fullsized":"2024-03-25T06:03:53.761754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6967,"log_dups_size":0,"ondisk_log_size":6967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5199,"num_write_kb":132356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1717","reported_seq":1755,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.061043+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T06:03:53.061043+0000","last_peered":"2024-03-25T06:03:53.061043+0000","last_clean":"2024-03-25T06:03:53.061043+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T06:03:53.061043+0000","last_undegraded":"2024-03-25T06:03:53.061043+0000","last_fullsized":"2024-03-25T06:03:53.061043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7932","reported_seq":7972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731617+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T06:03:54.731617+0000","last_peered":"2024-03-25T06:03:54.731617+0000","last_clean":"2024-03-25T06:03:54.731617+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T06:03:54.731617+0000","last_undegraded":"2024-03-25T06:03:54.731617+0000","last_fullsized":"2024-03-25T06:03:54.731617+0000","mapping_epoch":17,"log_start":"27'400","ondisk_log_start":"27'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7532,"log_dups_size":0,"ondisk_log_size":7532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":7940,"num_write_kb":54570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'6089","reported_seq":6194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.524271+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T06:03:54.524271+0000","last_peered":"2024-03-25T06:03:54.524271+0000","last_clean":"2024-03-25T06:03:54.524271+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T06:03:54.524271+0000","last_undegraded":"2024-03-25T06:03:54.524271+0000","last_fullsized":"2024-03-25T06:03:54.524271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6089,"log_dups_size":0,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4263,"num_write_kb":125557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1735","reported_seq":1774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.267603+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T06:03:54.267603+0000","last_peered":"2024-03-25T06:03:54.267603+0000","last_clean":"2024-03-25T06:03:54.267603+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T06:03:54.267603+0000","last_undegraded":"2024-03-25T06:03:54.267603+0000","last_fullsized":"2024-03-25T06:03:54.267603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6067","reported_seq":7057,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.676694+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T06:03:54.676694+0000","last_peered":"2024-03-25T06:03:54.676694+0000","last_clean":"2024-03-25T06:03:54.676694+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T06:03:54.676694+0000","last_undegraded":"2024-03-25T06:03:54.676694+0000","last_fullsized":"2024-03-25T06:03:54.676694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6067,"log_dups_size":0,"ondisk_log_size":6067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":950,"num_read_kb":4728,"num_write":6066,"num_write_kb":44950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'6018","reported_seq":6490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.519967+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T06:03:54.519967+0000","last_peered":"2024-03-25T06:03:54.519967+0000","last_clean":"2024-03-25T06:03:54.519967+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T06:03:54.519967+0000","last_undegraded":"2024-03-25T06:03:54.519967+0000","last_fullsized":"2024-03-25T06:03:54.519967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6018,"log_dups_size":0,"ondisk_log_size":6018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":111506,"num_write":4239,"num_write_kb":120920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1663","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.185756+0000","last_change":"2024-03-25T05:37:31.148439+0000","last_active":"2024-03-25T06:03:59.185756+0000","last_peered":"2024-03-25T06:03:59.185756+0000","last_clean":"2024-03-25T06:03:59.185756+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T06:03:59.185756+0000","last_undegraded":"2024-03-25T06:03:59.185756+0000","last_fullsized":"2024-03-25T06:03:59.185756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:53:17.257529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'6671","reported_seq":6712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.671195+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T06:03:54.671195+0000","last_peered":"2024-03-25T06:03:54.671195+0000","last_clean":"2024-03-25T06:03:54.671195+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T06:03:54.671195+0000","last_undegraded":"2024-03-25T06:03:54.671195+0000","last_fullsized":"2024-03-25T06:03:54.671195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6671,"log_dups_size":0,"ondisk_log_size":6671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":45450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'6159","reported_seq":6352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.043817+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T06:03:59.043817+0000","last_peered":"2024-03-25T06:03:59.043817+0000","last_clean":"2024-03-25T06:03:59.043817+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T06:03:59.043817+0000","last_undegraded":"2024-03-25T06:03:59.043817+0000","last_fullsized":"2024-03-25T06:03:59.043817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6159,"log_dups_size":0,"ondisk_log_size":6159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:00.034509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260306,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":160,"num_read_kb":40640,"num_write":4330,"num_write_kb":133390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1731","reported_seq":1768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.678278+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T06:03:52.678278+0000","last_peered":"2024-03-25T06:03:52.678278+0000","last_clean":"2024-03-25T06:03:52.678278+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T06:03:52.678278+0000","last_undegraded":"2024-03-25T06:03:52.678278+0000","last_fullsized":"2024-03-25T06:03:52.678278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4314","reported_seq":4354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:08.404605+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T06:03:08.404605+0000","last_peered":"2024-03-25T06:03:08.404605+0000","last_clean":"2024-03-25T06:03:08.404605+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T06:03:08.404605+0000","last_undegraded":"2024-03-25T06:03:08.404605+0000","last_fullsized":"2024-03-25T06:03:08.404605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4314,"log_dups_size":0,"ondisk_log_size":4314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4311,"num_write_kb":35590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:01:30.046447+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T06:01:30.046447+0000","last_peered":"2024-03-25T06:01:30.046447+0000","last_clean":"2024-03-25T06:01:30.046447+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T06:01:30.046447+0000","last_undegraded":"2024-03-25T06:01:30.046447+0000","last_fullsized":"2024-03-25T06:01:30.046447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'6161","reported_seq":6322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.736152+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T06:03:53.736152+0000","last_peered":"2024-03-25T06:03:53.736152+0000","last_clean":"2024-03-25T06:03:53.736152+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T06:03:53.736152+0000","last_undegraded":"2024-03-25T06:03:53.736152+0000","last_fullsized":"2024-03-25T06:03:53.736152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6161,"log_dups_size":0,"ondisk_log_size":6161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":32512,"num_write":4374,"num_write_kb":123745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1723","reported_seq":1760,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.296900+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T06:03:54.296900+0000","last_peered":"2024-03-25T06:03:54.296900+0000","last_clean":"2024-03-25T06:03:54.296900+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T06:03:54.296900+0000","last_undegraded":"2024-03-25T06:03:54.296900+0000","last_fullsized":"2024-03-25T06:03:54.296900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5041","reported_seq":5080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:30.115854+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T06:03:30.115854+0000","last_peered":"2024-03-25T06:03:30.115854+0000","last_clean":"2024-03-25T06:03:30.115854+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T06:03:30.115854+0000","last_undegraded":"2024-03-25T06:03:30.115854+0000","last_fullsized":"2024-03-25T06:03:30.115854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5041,"log_dups_size":0,"ondisk_log_size":5041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390032,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5032,"num_write_kb":40184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'6515","reported_seq":6836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.481682+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T06:03:54.481682+0000","last_peered":"2024-03-25T06:03:54.481682+0000","last_clean":"2024-03-25T06:03:54.481682+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T06:03:54.481682+0000","last_undegraded":"2024-03-25T06:03:54.481682+0000","last_fullsized":"2024-03-25T06:03:54.481682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6515,"log_dups_size":0,"ondisk_log_size":6515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":73152,"num_write":4685,"num_write_kb":118227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1742","reported_seq":1784,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.201016+0000","last_change":"2024-03-25T05:38:20.652252+0000","last_active":"2024-03-25T06:03:51.201016+0000","last_peered":"2024-03-25T06:03:51.201016+0000","last_clean":"2024-03-25T06:03:51.201016+0000","last_became_active":"2024-03-25T05:38:20.652010+0000","last_became_peered":"2024-03-25T05:38:20.652010+0000","last_unstale":"2024-03-25T06:03:51.201016+0000","last_undegraded":"2024-03-25T06:03:51.201016+0000","last_fullsized":"2024-03-25T06:03:51.201016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:19.423056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5678","reported_seq":5717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.730560+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T06:03:54.730560+0000","last_peered":"2024-03-25T06:03:54.730560+0000","last_clean":"2024-03-25T06:03:54.730560+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T06:03:54.730560+0000","last_undegraded":"2024-03-25T06:03:54.730560+0000","last_fullsized":"2024-03-25T06:03:54.730560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5678,"log_dups_size":0,"ondisk_log_size":5678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5688,"num_write_kb":44802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'6237","reported_seq":6602,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.992859+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T06:03:58.992859+0000","last_peered":"2024-03-25T06:03:58.992859+0000","last_clean":"2024-03-25T06:03:58.992859+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T06:03:58.992859+0000","last_undegraded":"2024-03-25T06:03:58.992859+0000","last_fullsized":"2024-03-25T06:03:58.992859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6237,"log_dups_size":0,"ondisk_log_size":6237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335872,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":84582,"num_write":4339,"num_write_kb":115405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1658","reported_seq":1695,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.693539+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T06:03:53.693539+0000","last_peered":"2024-03-25T06:03:53.693539+0000","last_clean":"2024-03-25T06:03:53.693539+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T06:03:53.693539+0000","last_undegraded":"2024-03-25T06:03:53.693539+0000","last_fullsized":"2024-03-25T06:03:53.693539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1658,"log_dups_size":0,"ondisk_log_size":1658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5642","reported_seq":5681,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:02:28.428077+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T06:02:28.428077+0000","last_peered":"2024-03-25T06:02:28.428077+0000","last_clean":"2024-03-25T06:02:28.428077+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T06:02:28.428077+0000","last_undegraded":"2024-03-25T06:02:28.428077+0000","last_fullsized":"2024-03-25T06:02:28.428077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5640,"num_write_kb":40587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'6749","reported_seq":7090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.396662+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T06:03:54.396662+0000","last_peered":"2024-03-25T06:03:54.396662+0000","last_clean":"2024-03-25T06:03:54.396662+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T06:03:54.396662+0000","last_undegraded":"2024-03-25T06:03:54.396662+0000","last_fullsized":"2024-03-25T06:03:54.396662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6749,"log_dups_size":0,"ondisk_log_size":6749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":78232,"num_write":4935,"num_write_kb":116647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1743","reported_seq":1780,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.188773+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T06:03:54.188773+0000","last_peered":"2024-03-25T06:03:54.188773+0000","last_clean":"2024-03-25T06:03:54.188773+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T06:03:54.188773+0000","last_undegraded":"2024-03-25T06:03:54.188773+0000","last_fullsized":"2024-03-25T06:03:54.188773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3454","reported_seq":3493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.684095+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T06:03:54.684095+0000","last_peered":"2024-03-25T06:03:54.684095+0000","last_clean":"2024-03-25T06:03:54.684095+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T06:03:54.684095+0000","last_undegraded":"2024-03-25T06:03:54.684095+0000","last_fullsized":"2024-03-25T06:03:54.684095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3453,"num_write_kb":26898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'6082","reported_seq":6150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.105456+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T06:03:52.105456+0000","last_peered":"2024-03-25T06:03:52.105456+0000","last_clean":"2024-03-25T06:03:52.105456+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T06:03:52.105456+0000","last_undegraded":"2024-03-25T06:03:52.105456+0000","last_fullsized":"2024-03-25T06:03:52.105456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6082,"log_dups_size":0,"ondisk_log_size":6082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431670,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":8890,"num_write":4232,"num_write_kb":109973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1744","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.390093+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T06:03:54.390093+0000","last_peered":"2024-03-25T06:03:54.390093+0000","last_clean":"2024-03-25T06:03:54.390093+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T06:03:54.390093+0000","last_undegraded":"2024-03-25T06:03:54.390093+0000","last_fullsized":"2024-03-25T06:03:54.390093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1744,"log_dups_size":0,"ondisk_log_size":1744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'2585","reported_seq":2624,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.730595+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T06:03:54.730595+0000","last_peered":"2024-03-25T06:03:54.730595+0000","last_clean":"2024-03-25T06:03:54.730595+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T06:03:54.730595+0000","last_undegraded":"2024-03-25T06:03:54.730595+0000","last_fullsized":"2024-03-25T06:03:54.730595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2585,"log_dups_size":0,"ondisk_log_size":2585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2603,"num_write_kb":18105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'6133","reported_seq":6456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.032625+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T06:03:59.032625+0000","last_peered":"2024-03-25T06:03:59.032625+0000","last_clean":"2024-03-25T06:03:59.032625+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T06:03:59.032625+0000","last_undegraded":"2024-03-25T06:03:59.032625+0000","last_fullsized":"2024-03-25T06:03:59.032625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6133,"log_dups_size":0,"ondisk_log_size":6133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:01:06.227070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052933,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":74168,"num_write":4306,"num_write_kb":103632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1667","reported_seq":1703,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.511800+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T06:03:54.511800+0000","last_peered":"2024-03-25T06:03:54.511800+0000","last_clean":"2024-03-25T06:03:54.511800+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T06:03:54.511800+0000","last_undegraded":"2024-03-25T06:03:54.511800+0000","last_fullsized":"2024-03-25T06:03:54.511800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1667,"log_dups_size":0,"ondisk_log_size":1667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3092","reported_seq":3130,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.698578+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T06:03:54.698578+0000","last_peered":"2024-03-25T06:03:54.698578+0000","last_clean":"2024-03-25T06:03:54.698578+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T06:03:54.698578+0000","last_undegraded":"2024-03-25T06:03:54.698578+0000","last_fullsized":"2024-03-25T06:03:54.698578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3092,"log_dups_size":0,"ondisk_log_size":3092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195146,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3109,"num_write_kb":22544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'6001","reported_seq":6449,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.218345+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T06:03:54.218345+0000","last_peered":"2024-03-25T06:03:54.218345+0000","last_clean":"2024-03-25T06:03:54.218345+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T06:03:54.218345+0000","last_undegraded":"2024-03-25T06:03:54.218345+0000","last_fullsized":"2024-03-25T06:03:54.218345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6001,"log_dups_size":0,"ondisk_log_size":6001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:33:50.989171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":105918,"num_write":4133,"num_write_kb":116215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1729","reported_seq":1766,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.675825+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T06:03:53.675825+0000","last_peered":"2024-03-25T06:03:53.675825+0000","last_clean":"2024-03-25T06:03:53.675825+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T06:03:53.675825+0000","last_undegraded":"2024-03-25T06:03:53.675825+0000","last_fullsized":"2024-03-25T06:03:53.675825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'848","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.742196+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T06:03:54.742196+0000","last_peered":"2024-03-25T06:03:54.742196+0000","last_clean":"2024-03-25T06:03:54.742196+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T06:03:54.742196+0000","last_undegraded":"2024-03-25T06:03:54.742196+0000","last_fullsized":"2024-03-25T06:03:54.742196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":860,"num_write_kb":8739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5767","reported_seq":5997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.226440+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T06:03:54.226440+0000","last_peered":"2024-03-25T06:03:54.226440+0000","last_clean":"2024-03-25T06:03:54.226440+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T06:03:54.226440+0000","last_undegraded":"2024-03-25T06:03:54.226440+0000","last_fullsized":"2024-03-25T06:03:54.226440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5767,"log_dups_size":0,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:14:50.068275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":50292,"num_write":4003,"num_write_kb":127231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1739","reported_seq":1775,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.185107+0000","last_change":"2024-03-25T05:37:31.149941+0000","last_active":"2024-03-25T06:03:59.185107+0000","last_peered":"2024-03-25T06:03:59.185107+0000","last_clean":"2024-03-25T06:03:59.185107+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T06:03:59.185107+0000","last_undegraded":"2024-03-25T06:03:59.185107+0000","last_fullsized":"2024-03-25T06:03:59.185107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:24:40.019842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'3793","reported_seq":3831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.678912+0000","last_change":"2024-03-25T05:37:30.419153+0000","last_active":"2024-03-25T06:03:54.678912+0000","last_peered":"2024-03-25T06:03:54.678912+0000","last_clean":"2024-03-25T06:03:54.678912+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T06:03:54.678912+0000","last_undegraded":"2024-03-25T06:03:54.678912+0000","last_fullsized":"2024-03-25T06:03:54.678912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:16:01.889443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3799,"num_write_kb":31202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5792","reported_seq":5877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.268744+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T06:03:54.268744+0000","last_peered":"2024-03-25T06:03:54.268744+0000","last_clean":"2024-03-25T06:03:54.268744+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T06:03:54.268744+0000","last_undegraded":"2024-03-25T06:03:54.268744+0000","last_fullsized":"2024-03-25T06:03:54.268744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5792,"log_dups_size":0,"ondisk_log_size":5792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":13716,"num_write":3985,"num_write_kb":98790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1656","reported_seq":1692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.934764+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T06:03:50.934764+0000","last_peered":"2024-03-25T06:03:50.934764+0000","last_clean":"2024-03-25T06:03:50.934764+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T06:03:50.934764+0000","last_undegraded":"2024-03-25T06:03:50.934764+0000","last_fullsized":"2024-03-25T06:03:50.934764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1656,"log_dups_size":0,"ondisk_log_size":1656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'6610","reported_seq":7248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.736476+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T06:03:54.736476+0000","last_peered":"2024-03-25T06:03:54.736476+0000","last_clean":"2024-03-25T06:03:54.736476+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T06:03:54.736476+0000","last_undegraded":"2024-03-25T06:03:54.736476+0000","last_fullsized":"2024-03-25T06:03:54.736476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15601385,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":600,"num_read_kb":3799,"num_write":6621,"num_write_kb":48470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5988","reported_seq":6230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.179221+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T06:03:54.179221+0000","last_peered":"2024-03-25T06:03:54.179221+0000","last_clean":"2024-03-25T06:03:54.179221+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T06:03:54.179221+0000","last_undegraded":"2024-03-25T06:03:54.179221+0000","last_fullsized":"2024-03-25T06:03:54.179221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5988,"log_dups_size":0,"ondisk_log_size":5988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260736,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":4183,"num_write_kb":127483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1705","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.028113+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T06:03:54.028113+0000","last_peered":"2024-03-25T06:03:54.028113+0000","last_clean":"2024-03-25T06:03:54.028113+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T06:03:54.028113+0000","last_undegraded":"2024-03-25T06:03:54.028113+0000","last_fullsized":"2024-03-25T06:03:54.028113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5364","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731252+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T06:03:54.731252+0000","last_peered":"2024-03-25T06:03:54.731252+0000","last_clean":"2024-03-25T06:03:54.731252+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T06:03:54.731252+0000","last_undegraded":"2024-03-25T06:03:54.731252+0000","last_fullsized":"2024-03-25T06:03:54.731252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5364,"log_dups_size":0,"ondisk_log_size":5364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5367,"num_write_kb":32641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5993","reported_seq":6080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.718186+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T06:03:53.718186+0000","last_peered":"2024-03-25T06:03:53.718186+0000","last_clean":"2024-03-25T06:03:53.718186+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T06:03:53.718186+0000","last_undegraded":"2024-03-25T06:03:53.718186+0000","last_fullsized":"2024-03-25T06:03:53.718186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5993,"log_dups_size":0,"ondisk_log_size":5993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365760,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":13970,"num_write":4176,"num_write_kb":117168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1733","reported_seq":1773,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.227863+0000","last_change":"2024-03-25T05:38:20.652289+0000","last_active":"2024-03-25T06:03:59.227863+0000","last_peered":"2024-03-25T06:03:59.227863+0000","last_clean":"2024-03-25T06:03:59.227863+0000","last_became_active":"2024-03-25T05:38:20.652007+0000","last_became_peered":"2024-03-25T05:38:20.652007+0000","last_unstale":"2024-03-25T06:03:59.227863+0000","last_undegraded":"2024-03-25T06:03:59.227863+0000","last_fullsized":"2024-03-25T06:03:59.227863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:15:33.110431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5604","reported_seq":5642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.695714+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T06:03:54.695714+0000","last_peered":"2024-03-25T06:03:54.695714+0000","last_clean":"2024-03-25T06:03:54.695714+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T06:03:54.695714+0000","last_undegraded":"2024-03-25T06:03:54.695714+0000","last_fullsized":"2024-03-25T06:03:54.695714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5607,"num_write_kb":40642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5709","reported_seq":6160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.520071+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T06:03:54.520071+0000","last_peered":"2024-03-25T06:03:54.520071+0000","last_clean":"2024-03-25T06:03:54.520071+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T06:03:54.520071+0000","last_undegraded":"2024-03-25T06:03:54.520071+0000","last_fullsized":"2024-03-25T06:03:54.520071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5709,"log_dups_size":0,"ondisk_log_size":5709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:27:40.435483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":106426,"num_write":4010,"num_write_kb":116755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1692","reported_seq":1728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.711024+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T06:03:53.711024+0000","last_peered":"2024-03-25T06:03:53.711024+0000","last_clean":"2024-03-25T06:03:53.711024+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T06:03:53.711024+0000","last_undegraded":"2024-03-25T06:03:53.711024+0000","last_fullsized":"2024-03-25T06:03:53.711024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4517","reported_seq":5355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.705336+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T06:03:54.705336+0000","last_peered":"2024-03-25T06:03:54.705336+0000","last_clean":"2024-03-25T06:03:54.705336+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T06:03:54.705336+0000","last_undegraded":"2024-03-25T06:03:54.705336+0000","last_fullsized":"2024-03-25T06:03:54.705336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4517,"log_dups_size":0,"ondisk_log_size":4517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":802,"num_read_kb":4614,"num_write":4524,"num_write_kb":35758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6263","reported_seq":6658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.401210+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T06:03:54.401210+0000","last_peered":"2024-03-25T06:03:54.401210+0000","last_clean":"2024-03-25T06:03:54.401210+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T06:03:54.401210+0000","last_undegraded":"2024-03-25T06:03:54.401210+0000","last_fullsized":"2024-03-25T06:03:54.401210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6263,"log_dups_size":0,"ondisk_log_size":6263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:25:03.802329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74402,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":363,"num_read_kb":92202,"num_write":4366,"num_write_kb":119516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5991","reported_seq":6089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.030228+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T06:03:59.030228+0000","last_peered":"2024-03-25T06:03:59.030228+0000","last_clean":"2024-03-25T06:03:59.030228+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T06:03:59.030228+0000","last_undegraded":"2024-03-25T06:03:59.030228+0000","last_fullsized":"2024-03-25T06:03:59.030228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5991,"log_dups_size":0,"ondisk_log_size":5991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268288,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":4230,"num_write_kb":107763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1670","reported_seq":1706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.067757+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T06:03:54.067757+0000","last_peered":"2024-03-25T06:03:54.067757+0000","last_clean":"2024-03-25T06:03:54.067757+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T06:03:54.067757+0000","last_undegraded":"2024-03-25T06:03:54.067757+0000","last_fullsized":"2024-03-25T06:03:54.067757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'8146","reported_seq":8184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.709010+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T06:03:54.709010+0000","last_peered":"2024-03-25T06:03:54.709010+0000","last_clean":"2024-03-25T06:03:54.709010+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T06:03:54.709010+0000","last_undegraded":"2024-03-25T06:03:54.709010+0000","last_fullsized":"2024-03-25T06:03:54.709010+0000","mapping_epoch":17,"log_start":"27'600","ondisk_log_start":"27'600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7546,"log_dups_size":0,"ondisk_log_size":7546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8142,"num_write_kb":58721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'6004","reported_seq":6326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.091602+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T06:03:54.091602+0000","last_peered":"2024-03-25T06:03:54.091602+0000","last_clean":"2024-03-25T06:03:54.091602+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T06:03:54.091602+0000","last_undegraded":"2024-03-25T06:03:54.091602+0000","last_fullsized":"2024-03-25T06:03:54.091602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6004,"log_dups_size":0,"ondisk_log_size":6004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74402,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":73406,"num_write":4229,"num_write_kb":113314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1743","reported_seq":1778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.090733+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T06:03:52.090733+0000","last_peered":"2024-03-25T06:03:52.090733+0000","last_clean":"2024-03-25T06:03:52.090733+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T06:03:52.090733+0000","last_undegraded":"2024-03-25T06:03:52.090733+0000","last_fullsized":"2024-03-25T06:03:52.090733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4099","reported_seq":4136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:08.398796+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T06:03:08.398796+0000","last_peered":"2024-03-25T06:03:08.398796+0000","last_clean":"2024-03-25T06:03:08.398796+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T06:03:08.398796+0000","last_undegraded":"2024-03-25T06:03:08.398796+0000","last_fullsized":"2024-03-25T06:03:08.398796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4099,"log_dups_size":0,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:56:37.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4095,"num_write_kb":35371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7947","reported_seq":7984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.659082+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T06:03:54.659082+0000","last_peered":"2024-03-25T06:03:54.659082+0000","last_clean":"2024-03-25T06:03:54.659082+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T06:03:54.659082+0000","last_undegraded":"2024-03-25T06:03:54.659082+0000","last_fullsized":"2024-03-25T06:03:54.659082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7947,"log_dups_size":0,"ondisk_log_size":7947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7943,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1689","reported_seq":1724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219387+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T06:03:59.219387+0000","last_peered":"2024-03-25T06:03:59.219387+0000","last_clean":"2024-03-25T06:03:59.219387+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T06:03:59.219387+0000","last_undegraded":"2024-03-25T06:03:59.219387+0000","last_fullsized":"2024-03-25T06:03:59.219387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1689,"log_dups_size":0,"ondisk_log_size":1689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'6116","reported_seq":6228,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.542464+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T06:03:54.542464+0000","last_peered":"2024-03-25T06:03:54.542464+0000","last_clean":"2024-03-25T06:03:54.542464+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T06:03:54.542464+0000","last_undegraded":"2024-03-25T06:03:54.542464+0000","last_fullsized":"2024-03-25T06:03:54.542464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6116,"log_dups_size":0,"ondisk_log_size":6116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:24.520405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":4275,"num_write_kb":113262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6308","reported_seq":6345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.654487+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T06:03:54.654487+0000","last_peered":"2024-03-25T06:03:54.654487+0000","last_clean":"2024-03-25T06:03:54.654487+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T06:03:54.654487+0000","last_undegraded":"2024-03-25T06:03:54.654487+0000","last_fullsized":"2024-03-25T06:03:54.654487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6308,"log_dups_size":0,"ondisk_log_size":6308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:15:02.475370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166700,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6300,"num_write_kb":53213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1715","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.084504+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T06:03:54.084504+0000","last_peered":"2024-03-25T06:03:54.084504+0000","last_clean":"2024-03-25T06:03:54.084504+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T06:03:54.084504+0000","last_undegraded":"2024-03-25T06:03:54.084504+0000","last_fullsized":"2024-03-25T06:03:54.084504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'6475","reported_seq":6968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.475889+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T06:03:54.475889+0000","last_peered":"2024-03-25T06:03:54.475889+0000","last_clean":"2024-03-25T06:03:54.475889+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T06:03:54.475889+0000","last_undegraded":"2024-03-25T06:03:54.475889+0000","last_fullsized":"2024-03-25T06:03:54.475889+0000","mapping_epoch":22,"log_start":"27'200","ondisk_log_start":"27'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6275,"log_dups_size":0,"ondisk_log_size":6275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:08:02.386273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2195264,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":117348,"num_write":4678,"num_write_kb":179166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1668","reported_seq":1705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.141247+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T06:03:54.141247+0000","last_peered":"2024-03-25T06:03:54.141247+0000","last_clean":"2024-03-25T06:03:54.141247+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T06:03:54.141247+0000","last_undegraded":"2024-03-25T06:03:54.141247+0000","last_fullsized":"2024-03-25T06:03:54.141247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1751","reported_seq":1794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:49.804346+0000","last_change":"2024-03-25T05:38:20.652638+0000","last_active":"2024-03-25T06:03:49.804346+0000","last_peered":"2024-03-25T06:03:49.804346+0000","last_clean":"2024-03-25T06:03:49.804346+0000","last_became_active":"2024-03-25T05:38:20.652189+0000","last_became_peered":"2024-03-25T05:38:20.652189+0000","last_unstale":"2024-03-25T06:03:49.804346+0000","last_undegraded":"2024-03-25T06:03:49.804346+0000","last_fullsized":"2024-03-25T06:03:49.804346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1670","reported_seq":1708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.645425+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T06:03:52.645425+0000","last_peered":"2024-03-25T06:03:52.645425+0000","last_clean":"2024-03-25T06:03:52.645425+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T06:03:52.645425+0000","last_undegraded":"2024-03-25T06:03:52.645425+0000","last_fullsized":"2024-03-25T06:03:52.645425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1790","reported_seq":1827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.255566+0000","last_change":"2024-03-25T05:37:31.164026+0000","last_active":"2024-03-25T06:03:59.255566+0000","last_peered":"2024-03-25T06:03:59.255566+0000","last_clean":"2024-03-25T06:03:59.255566+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T06:03:59.255566+0000","last_undegraded":"2024-03-25T06:03:59.255566+0000","last_fullsized":"2024-03-25T06:03:59.255566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1715","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.520282+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T06:03:54.520282+0000","last_peered":"2024-03-25T06:03:54.520282+0000","last_clean":"2024-03-25T06:03:54.520282+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T06:03:54.520282+0000","last_undegraded":"2024-03-25T06:03:54.520282+0000","last_fullsized":"2024-03-25T06:03:54.520282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1671","reported_seq":1709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.734156+0000","last_change":"2024-03-25T05:37:31.166178+0000","last_active":"2024-03-25T06:03:53.734156+0000","last_peered":"2024-03-25T06:03:53.734156+0000","last_clean":"2024-03-25T06:03:53.734156+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T06:03:53.734156+0000","last_undegraded":"2024-03-25T06:03:53.734156+0000","last_fullsized":"2024-03-25T06:03:53.734156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1749","reported_seq":1786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.779900+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T06:03:53.779900+0000","last_peered":"2024-03-25T06:03:53.779900+0000","last_clean":"2024-03-25T06:03:53.779900+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T06:03:53.779900+0000","last_undegraded":"2024-03-25T06:03:53.779900+0000","last_fullsized":"2024-03-25T06:03:53.779900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1712","reported_seq":1749,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.108884+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T06:03:54.108884+0000","last_peered":"2024-03-25T06:03:54.108884+0000","last_clean":"2024-03-25T06:03:54.108884+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T06:03:54.108884+0000","last_undegraded":"2024-03-25T06:03:54.108884+0000","last_fullsized":"2024-03-25T06:03:54.108884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1687","reported_seq":1725,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.991957+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T06:03:53.991957+0000","last_peered":"2024-03-25T06:03:53.991957+0000","last_clean":"2024-03-25T06:03:53.991957+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T06:03:53.991957+0000","last_undegraded":"2024-03-25T06:03:53.991957+0000","last_fullsized":"2024-03-25T06:03:53.991957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1687,"log_dups_size":0,"ondisk_log_size":1687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1721","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:51.522746+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T06:03:51.522746+0000","last_peered":"2024-03-25T06:03:51.522746+0000","last_clean":"2024-03-25T06:03:51.522746+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T06:03:51.522746+0000","last_undegraded":"2024-03-25T06:03:51.522746+0000","last_fullsized":"2024-03-25T06:03:51.522746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1721","reported_seq":1758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.454892+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T06:03:54.454892+0000","last_peered":"2024-03-25T06:03:54.454892+0000","last_clean":"2024-03-25T06:03:54.454892+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T06:03:54.454892+0000","last_undegraded":"2024-03-25T06:03:54.454892+0000","last_fullsized":"2024-03-25T06:03:54.454892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1756","reported_seq":1792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219689+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T06:03:59.219689+0000","last_peered":"2024-03-25T06:03:59.219689+0000","last_clean":"2024-03-25T06:03:59.219689+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T06:03:59.219689+0000","last_undegraded":"2024-03-25T06:03:59.219689+0000","last_fullsized":"2024-03-25T06:03:59.219689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1721","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.143173+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T06:03:52.143173+0000","last_peered":"2024-03-25T06:03:52.143173+0000","last_clean":"2024-03-25T06:03:52.143173+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T06:03:52.143173+0000","last_undegraded":"2024-03-25T06:03:52.143173+0000","last_fullsized":"2024-03-25T06:03:52.143173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1764","reported_seq":1801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.241081+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T06:03:54.241081+0000","last_peered":"2024-03-25T06:03:54.241081+0000","last_clean":"2024-03-25T06:03:54.241081+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T06:03:54.241081+0000","last_undegraded":"2024-03-25T06:03:54.241081+0000","last_fullsized":"2024-03-25T06:03:54.241081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1670","reported_seq":1707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.080061+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T06:03:50.080061+0000","last_peered":"2024-03-25T06:03:50.080061+0000","last_clean":"2024-03-25T06:03:50.080061+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T06:03:50.080061+0000","last_undegraded":"2024-03-25T06:03:50.080061+0000","last_fullsized":"2024-03-25T06:03:50.080061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1712","reported_seq":1749,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.135484+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T06:03:54.135484+0000","last_peered":"2024-03-25T06:03:54.135484+0000","last_clean":"2024-03-25T06:03:54.135484+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T06:03:54.135484+0000","last_undegraded":"2024-03-25T06:03:54.135484+0000","last_fullsized":"2024-03-25T06:03:54.135484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'1631","reported_seq":1668,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.535878+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T06:03:53.535878+0000","last_peered":"2024-03-25T06:03:53.535878+0000","last_clean":"2024-03-25T06:03:53.535878+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T06:03:53.535878+0000","last_undegraded":"2024-03-25T06:03:53.535878+0000","last_fullsized":"2024-03-25T06:03:53.535878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'1756","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.905819+0000","last_change":"2024-03-25T05:38:20.652965+0000","last_active":"2024-03-25T06:03:53.905819+0000","last_peered":"2024-03-25T06:03:53.905819+0000","last_clean":"2024-03-25T06:03:53.905819+0000","last_became_active":"2024-03-25T05:38:20.652582+0000","last_became_peered":"2024-03-25T05:38:20.652582+0000","last_unstale":"2024-03-25T06:03:53.905819+0000","last_undegraded":"2024-03-25T06:03:53.905819+0000","last_fullsized":"2024-03-25T06:03:53.905819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:25.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1702","reported_seq":1738,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.226036+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T06:03:59.226036+0000","last_peered":"2024-03-25T06:03:59.226036+0000","last_clean":"2024-03-25T06:03:59.226036+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T06:03:59.226036+0000","last_undegraded":"2024-03-25T06:03:59.226036+0000","last_fullsized":"2024-03-25T06:03:59.226036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1702,"log_dups_size":0,"ondisk_log_size":1702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:19:20.495852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1680","reported_seq":1715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.078984+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T06:03:52.078984+0000","last_peered":"2024-03-25T06:03:52.078984+0000","last_clean":"2024-03-25T06:03:52.078984+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T06:03:52.078984+0000","last_undegraded":"2024-03-25T06:03:52.078984+0000","last_fullsized":"2024-03-25T06:03:52.078984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1615","reported_seq":1651,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.791866+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T06:03:53.791866+0000","last_peered":"2024-03-25T06:03:53.791866+0000","last_clean":"2024-03-25T06:03:53.791866+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T06:03:53.791866+0000","last_undegraded":"2024-03-25T06:03:53.791866+0000","last_fullsized":"2024-03-25T06:03:53.791866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1671","reported_seq":1706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.257610+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T06:03:54.257610+0000","last_peered":"2024-03-25T06:03:54.257610+0000","last_clean":"2024-03-25T06:03:54.257610+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T06:03:54.257610+0000","last_undegraded":"2024-03-25T06:03:54.257610+0000","last_fullsized":"2024-03-25T06:03:54.257610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1729","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.551808+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T06:03:53.551808+0000","last_peered":"2024-03-25T06:03:53.551808+0000","last_clean":"2024-03-25T06:03:53.551808+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T06:03:53.551808+0000","last_undegraded":"2024-03-25T06:03:53.551808+0000","last_fullsized":"2024-03-25T06:03:53.551808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1754","reported_seq":1790,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.143674+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T06:03:54.143674+0000","last_peered":"2024-03-25T06:03:54.143674+0000","last_clean":"2024-03-25T06:03:54.143674+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T06:03:54.143674+0000","last_undegraded":"2024-03-25T06:03:54.143674+0000","last_fullsized":"2024-03-25T06:03:54.143674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1692","reported_seq":1727,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.366948+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T06:03:54.366948+0000","last_peered":"2024-03-25T06:03:54.366948+0000","last_clean":"2024-03-25T06:03:54.366948+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T06:03:54.366948+0000","last_undegraded":"2024-03-25T06:03:54.366948+0000","last_fullsized":"2024-03-25T06:03:54.366948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1671","reported_seq":1691,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:53.980717+0000","last_change":"2024-03-25T05:38:20.655980+0000","last_active":"2024-03-25T06:03:53.980717+0000","last_peered":"2024-03-25T06:03:53.980717+0000","last_clean":"2024-03-25T06:03:53.980717+0000","last_became_active":"2024-03-25T05:38:20.655743+0000","last_became_peered":"2024-03-25T05:38:20.655743+0000","last_unstale":"2024-03-25T06:03:53.980717+0000","last_undegraded":"2024-03-25T06:03:53.980717+0000","last_fullsized":"2024-03-25T06:03:53.980717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1671,"log_dups_size":0,"ondisk_log_size":1671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1649","reported_seq":1685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.294852+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T06:03:54.294852+0000","last_peered":"2024-03-25T06:03:54.294852+0000","last_clean":"2024-03-25T06:03:54.294852+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T06:03:54.294852+0000","last_undegraded":"2024-03-25T06:03:54.294852+0000","last_fullsized":"2024-03-25T06:03:54.294852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1743","reported_seq":1779,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.444157+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T06:03:54.444157+0000","last_peered":"2024-03-25T06:03:54.444157+0000","last_clean":"2024-03-25T06:03:54.444157+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T06:03:54.444157+0000","last_undegraded":"2024-03-25T06:03:54.444157+0000","last_fullsized":"2024-03-25T06:03:54.444157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1735","reported_seq":1774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.377939+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T06:03:54.377939+0000","last_peered":"2024-03-25T06:03:54.377939+0000","last_clean":"2024-03-25T06:03:54.377939+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T06:03:54.377939+0000","last_undegraded":"2024-03-25T06:03:54.377939+0000","last_fullsized":"2024-03-25T06:03:54.377939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1790","reported_seq":1827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.219156+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T06:03:59.219156+0000","last_peered":"2024-03-25T06:03:59.219156+0000","last_clean":"2024-03-25T06:03:59.219156+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T06:03:59.219156+0000","last_undegraded":"2024-03-25T06:03:59.219156+0000","last_fullsized":"2024-03-25T06:03:59.219156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1653","reported_seq":1691,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.048440+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T06:03:54.048440+0000","last_peered":"2024-03-25T06:03:54.048440+0000","last_clean":"2024-03-25T06:03:54.048440+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T06:03:54.048440+0000","last_undegraded":"2024-03-25T06:03:54.048440+0000","last_fullsized":"2024-03-25T06:03:54.048440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1653,"log_dups_size":0,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1632","reported_seq":1670,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:50.165893+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T06:03:50.165893+0000","last_peered":"2024-03-25T06:03:50.165893+0000","last_clean":"2024-03-25T06:03:50.165893+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T06:03:50.165893+0000","last_undegraded":"2024-03-25T06:03:50.165893+0000","last_fullsized":"2024-03-25T06:03:50.165893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":16475339,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":5893,"num_read_kb":1496822,"num_write":138176,"num_write_kb":3811190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2846720,"data_stored":32432128,"data_compressed":1517935,"data_compressed_allocated":2170880,"data_compressed_original":31756288,"omap_allocated":0,"internal_metadata":0},"log_size":195818,"ondisk_log_size":195818,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109510,"ondisk_log_size":109510,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":233712377,"num_objects":156,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":156,"num_whiteouts":0,"num_read":2368,"num_read_kb":13141,"num_write":159035,"num_write_kb":1156715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":312238080,"data_stored":467424754,"data_compressed":49492176,"data_compressed_allocated":73285632,"data_compressed_original":228712448,"omap_allocated":0,"internal_metadata":0},"log_size":154446,"ondisk_log_size":154446,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575168,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":762856,"kb_used_data":37600,"kb_used_omap":1,"kb_used_meta":725246,"kb_avail":93608984,"statfs":{"total":96636764160,"available":95855599616,"internally_reserved":0,"allocated":38502400,"data_stored":61630114,"data_compressed":6637588,"data_compressed_allocated":9715712,"data_compressed_original":33050624,"omap_allocated":1590,"internal_metadata":742652362},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575169,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":832708,"kb_used_data":47868,"kb_used_omap":1,"kb_used_meta":784830,"kb_avail":93539132,"statfs":{"total":96636764160,"available":95784071168,"internally_reserved":0,"allocated":49016832,"data_stored":81890893,"data_compressed":8454916,"data_compressed_allocated":12382208,"data_compressed_original":45449216,"omap_allocated":1594,"internal_metadata":803666374},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575168,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":798280,"kb_used_data":41088,"kb_used_omap":1,"kb_used_meta":757182,"kb_avail":93573560,"statfs":{"total":96636764160,"available":95819325440,"internally_reserved":0,"allocated":42074112,"data_stored":64998314,"data_compressed":6265657,"data_compressed_allocated":9469952,"data_compressed_original":32608256,"omap_allocated":1595,"internal_metadata":775354821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575168,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":722028,"kb_used_data":37028,"kb_used_omap":1,"kb_used_meta":684990,"kb_avail":93649812,"statfs":{"total":96636764160,"available":95897407488,"internally_reserved":0,"allocated":37916672,"data_stored":59007360,"data_compressed":5831432,"data_compressed_allocated":8654848,"data_compressed_original":29937664,"omap_allocated":1595,"internal_metadata":701430213},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575166,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":850692,"kb_used_data":57596,"kb_used_omap":1,"kb_used_meta":793086,"kb_avail":93521148,"statfs":{"total":96636764160,"available":95765655552,"internally_reserved":0,"allocated":58978304,"data_stored":94809711,"data_compressed":10106287,"data_compressed_allocated":14716928,"data_compressed_original":50745344,"omap_allocated":1593,"internal_metadata":812120519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457484,"kb_used_data":29380,"kb_used_omap":1,"kb_used_meta":428094,"kb_avail":93914356,"statfs":{"total":96636764160,"available":96168300544,"internally_reserved":0,"allocated":30085120,"data_stored":47804932,"data_compressed":4488376,"data_compressed_allocated":6733824,"data_compressed_original":24653824,"omap_allocated":1595,"internal_metadata":438368709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575167,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":882604,"kb_used_data":31140,"kb_used_omap":1,"kb_used_meta":851454,"kb_avail":93489236,"statfs":{"total":96636764160,"available":95732977664,"internally_reserved":0,"allocated":31887360,"data_stored":51585356,"data_compressed":5040023,"data_compressed_allocated":7471104,"data_compressed_original":27365376,"omap_allocated":1595,"internal_metadata":871889349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575168,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569564,"kb_used_data":28948,"kb_used_omap":1,"kb_used_meta":540606,"kb_avail":93802276,"statfs":{"total":96636764160,"available":96053530624,"internally_reserved":0,"allocated":29642752,"data_stored":47853786,"data_compressed":4606583,"data_compressed_allocated":6889472,"data_compressed_original":25300992,"omap_allocated":1595,"internal_metadata":553580997},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28741632,"data_stored":41943914,"data_compressed":4333814,"data_compressed_allocated":6488064,"data_compressed_original":19718144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31145984,"data_stored":46138876,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29335552,"data_stored":41944756,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58363904,"data_stored":91099935,"data_compressed":9938069,"data_compressed_allocated":14479360,"data_compressed_original":47243264,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37269504,"data_stored":54527536,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41308160,"data_stored":58724442,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":74322685,"data_compressed":8104798,"data_compressed_allocated":11894784,"data_compressed_original":38100992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37933056,"data_stored":58722610,"data_compressed":6502788,"data_compressed_allocated":9523200,"data_compressed_original":30347264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":4800512,"data_compressed":222366,"data_compressed_allocated":331776,"data_compressed_original":4653056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":5324800,"data_compressed":249368,"data_compressed_allocated":360448,"data_compressed_original":5234688,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":5738496,"data_compressed":269421,"data_compressed_allocated":380928,"data_compressed_original":5660672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":3588096,"data_compressed":168218,"data_compressed_allocated":237568,"data_compressed_original":3502080,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":4358144,"data_compressed":204710,"data_compressed_allocated":286720,"data_compressed_original":4288512,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":2035712,"data_compressed":95409,"data_compressed_allocated":135168,"data_compressed_original":1990656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":4390912,"data_compressed":206071,"data_compressed_allocated":290816,"data_compressed_original":4296704,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":2195456,"data_compressed":102372,"data_compressed_allocated":147456,"data_compressed_original":2129920,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T06:04:01.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T06:04:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.566+0000 7f4f04a00640 1 Processor -- start 2024-03-25T06:04:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.566+0000 7f4f04a00640 1 -- start start 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.567+0000 7f4f04a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00158270 0x7f4f00072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.567+0000 7f4f04a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f00071610 0x7f4f00071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4f04a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f000c5860 con 0x7f4f0006f470 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4f04a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f00162480 con 0x7f4f00071610 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4f04a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000c5580 con 0x7f4f00158270 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4efea00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4f0006f470 0x7f4f0015dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47446/0 (socket says 172.21.15.102:47446) 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4efea00640 1 -- 172.21.15.102:0/3736516215 learned_addr learned my addr 172.21.15.102:0/3736516215 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4eff400640 1 --2- 172.21.15.102:0/3736516215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00158270 0x7f4f00072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4effe00640 1 --2- 172.21.15.102:0/3736516215 >> v2:172.21.15.102:3300/0 conn(0x7f4f00071610 0x7f4f00071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4eff400640 1 -- 172.21.15.102:0/3736516215 >> v2:172.21.15.102:3300/0 conn(0x7f4f00071610 msgr2=0x7f4f00071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:01.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4eff400640 1 --2- 172.21.15.102:0/3736516215 >> v2:172.21.15.102:3300/0 conn(0x7f4f00071610 0x7f4f00071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4eff400640 1 -- 172.21.15.102:0/3736516215 >> v1:172.21.15.102:6789/0 conn(0x7f4f0006f470 legacy=0x7f4f0015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.568+0000 7f4eff400640 1 -- 172.21.15.102:0/3736516215 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f001616c0 con 0x7f4f00158270 2024-03-25T06:04:01.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.570+0000 7f4eff400640 1 --2- 172.21.15.102:0/3736516215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00158270 0x7f4f00072150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00097a0 tx=0x7f4ef002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bcf2295a894368b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:01.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.570+0000 7f4efe000640 1 -- 172.21.15.102:0/3736516215 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0030800 con 0x7f4f00158270 2024-03-25T06:04:01.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.570+0000 7f4efe000640 1 -- 172.21.15.102:0/3736516215 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0030960 con 0x7f4f00158270 2024-03-25T06:04:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.570+0000 7f4efe000640 1 -- 172.21.15.102:0/3736516215 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0030cf0 con 0x7f4f00158270 2024-03-25T06:04:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 -- 172.21.15.102:0/3736516215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00158270 msgr2=0x7f4f00072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 --2- 172.21.15.102:0/3736516215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00158270 0x7f4f00072150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00097a0 tx=0x7f4ef002b940 comp rx=0 tx=0).stop 2024-03-25T06:04:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 -- 172.21.15.102:0/3736516215 shutdown_connections 2024-03-25T06:04:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 --2- 172.21.15.102:0/3736516215 >> v2:172.21.15.102:3300/0 conn(0x7f4f00071610 0x7f4f00071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 --2- 172.21.15.102:0/3736516215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00158270 0x7f4f00072150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 -- 172.21.15.102:0/3736516215 >> 172.21.15.102:0/3736516215 conn(0x7f4f000cb340 msgr2=0x7f4f000cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 -- 172.21.15.102:0/3736516215 shutdown_connections 2024-03-25T06:04:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.571+0000 7f4f04a00640 1 -- 172.21.15.102:0/3736516215 wait complete. 2024-03-25T06:04:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.574+0000 7f4f04a00640 1 Processor -- start 2024-03-25T06:04:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.574+0000 7f4f04a00640 1 -- start start 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.575+0000 7f4f04a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f0006f470 0x7f4f001eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.575+0000 7f4f04a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00071610 0x7f4f001538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4f04a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f00158270 0x7f4f001589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4f04a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f00158f10 con 0x7f4f0006f470 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4f04a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f001522f0 con 0x7f4f00158270 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4f04a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f00152540 con 0x7f4f00071610 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4eff400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f0006f470 0x7f4f001eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4eff400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f0006f470 0x7f4f001eacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35180/0 (socket says 172.21.15.102:35180) 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4eff400640 1 -- 172.21.15.102:0/403643640 learned_addr learned my addr 172.21.15.102:0/403643640 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4efea00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00071610 0x7f4f001538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.576+0000 7f4effe00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f00158270 0x7f4f001589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4eff400640 1 -- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00071610 msgr2=0x7f4f001538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4eff400640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00071610 0x7f4f001538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4eff400640 1 -- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f00158270 msgr2=0x7f4f001589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4eff400640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f00158270 0x7f4f001589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4eff400640 1 -- 172.21.15.102:0/403643640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0009400 con 0x7f4f0006f470 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4effe00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f00158270 0x7f4f001589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4eff400640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f0006f470 0x7f4f001eacf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00098c0 tx=0x7f4ef00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.577+0000 7f4ef7400640 1 -- 172.21.15.102:0/403643640 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef003e070 con 0x7f4f0006f470 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.578+0000 7f4ef7400640 1 -- 172.21.15.102:0/403643640 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0039a10 con 0x7f4f0006f470 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.578+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f00152820 con 0x7f4f0006f470 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.578+0000 7f4ef7400640 1 -- 172.21.15.102:0/403643640 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0039dc0 con 0x7f4f0006f470 2024-03-25T06:04:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.578+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f00152de0 con 0x7f4f0006f470 2024-03-25T06:04:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.579+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0004f2f0 con 0x7f4f0006f470 2024-03-25T06:04:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.581+0000 7f4ef7400640 1 -- 172.21.15.102:0/403643640 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ef004b400 con 0x7f4f0006f470 2024-03-25T06:04:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.583+0000 7f4ef7400640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ee006b810 0x7f4ee006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.583+0000 7f4ef7400640 1 -- 172.21.15.102:0/403643640 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f4ef00acb60 con 0x7f4f0006f470 2024-03-25T06:04:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.586+0000 7f4efea00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ee006b810 0x7f4ee006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.586+0000 7f4efea00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ee006b810 0x7f4ee006dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f001e7cc0 tx=0x7f4eec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.592+0000 7f4ef7400640 1 -- 172.21.15.102:0/403643640 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4ef0077130 con 0x7f4f0006f470 2024-03-25T06:04:01.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.968+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f000713f0 con 0x7f4f0006f470 2024-03-25T06:04:01.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.970+0000 7f4ef7400640 1 -- 172.21.15.102:0/403643640 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19031 (secure 0 0 0) 0x7f4ef0034090 con 0x7f4f0006f470 2024-03-25T06:04:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:01.964 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":27,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:38:20.630095+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T06:04:01.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ee006b810 msgr2=0x7f4ee006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ee006b810 0x7f4ee006dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f001e7cc0 tx=0x7f4eec009040 comp rx=0 tx=0).stop 2024-03-25T06:04:01.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f0006f470 msgr2=0x7f4f001eacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:01.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f0006f470 0x7f4f001eacf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00098c0 tx=0x7f4ef00046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 shutdown_connections 2024-03-25T06:04:01.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f4ee006b810 0x7f4ee006dcd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f00158270 0x7f4f001589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f00071610 0x7f4f001538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 --2- 172.21.15.102:0/403643640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f0006f470 0x7f4f001eacf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:01.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 >> 172.21.15.102:0/403643640 conn(0x7f4f000cb340 msgr2=0x7f4f00154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:01.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 shutdown_connections 2024-03-25T06:04:01.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:01.973+0000 7f4f04a00640 1 -- 172.21.15.102:0/403643640 wait complete. 2024-03-25T06:04:02.983 INFO:tasks.ceph:Scrubbing osd.0 2024-03-25T06:04:02.983 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:03.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.269+0000 7f9cad200640 1 Processor -- start 2024-03-25T06:04:03.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.269+0000 7f9cad200640 1 -- start start 2024-03-25T06:04:03.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.271+0000 7f9cad200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ca815d3c0 0x7f9ca80c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.271+0000 7f9cad200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca80ca200 con 0x7f9ca80b5140 2024-03-25T06:04:03.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.271+0000 7f9cad200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca80cb4e0 con 0x7f9ca80c7f10 2024-03-25T06:04:03.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.271+0000 7f9cad200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca80cb090 con 0x7f9ca815d3c0 2024-03-25T06:04:03.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.271+0000 7f9ca6a00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9ca80c7f10 0x7f9ca815d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47796/0 (socket says 172.21.15.102:47796) 2024-03-25T06:04:03.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.271+0000 7f9ca6a00640 1 -- 172.21.15.102:0/4226225684 learned_addr learned my addr 172.21.15.102:0/4226225684 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:03.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.271+0000 7f9ca7400640 1 --2- 172.21.15.102:0/4226225684 >> v2:172.21.15.187:3300/0 conn(0x7f9ca815d3c0 0x7f9ca80c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.272+0000 7f9ca6000640 1 -- 172.21.15.102:0/4226225684 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397350728 0 0) 0x7f9ca80cb4e0 con 0x7f9ca80c7f10 2024-03-25T06:04:03.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.272+0000 7f9ca6000640 1 -- 172.21.15.102:0/4226225684 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c8c003520 con 0x7f9ca80c7f10 2024-03-25T06:04:03.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.272+0000 7f9ca7400640 1 -- 172.21.15.102:0/4226225684 >> v1:172.21.15.187:6789/0 conn(0x7f9ca80c7f10 legacy=0x7f9ca815d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.272+0000 7f9ca7400640 1 -- 172.21.15.102:0/4226225684 >> v1:172.21.15.102:6789/0 conn(0x7f9ca80b5140 legacy=0x7f9ca8153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:03.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.272+0000 7f9ca7400640 1 -- 172.21.15.102:0/4226225684 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca80cb820 con 0x7f9ca815d3c0 2024-03-25T06:04:03.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.274+0000 7f9ca7400640 1 --2- 172.21.15.102:0/4226225684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca815d3c0 0x7f9ca80c79d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097a0 tx=0x7f9c9802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bca511bcffe8d51 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:03.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.274+0000 7f9ca6000640 1 -- 172.21.15.102:0/4226225684 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98031830 con 0x7f9ca815d3c0 2024-03-25T06:04:03.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.274+0000 7f9ca6000640 1 -- 172.21.15.102:0/4226225684 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c98031990 con 0x7f9ca815d3c0 2024-03-25T06:04:03.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.274+0000 7f9ca6000640 1 -- 172.21.15.102:0/4226225684 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98031d20 con 0x7f9ca815d3c0 2024-03-25T06:04:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.275+0000 7f9cad200640 1 -- 172.21.15.102:0/4226225684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca815d3c0 msgr2=0x7f9ca80c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.275+0000 7f9cad200640 1 --2- 172.21.15.102:0/4226225684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca815d3c0 0x7f9ca80c79d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097a0 tx=0x7f9c9802b8d0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.275+0000 7f9cad200640 1 -- 172.21.15.102:0/4226225684 shutdown_connections 2024-03-25T06:04:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.275+0000 7f9cad200640 1 --2- 172.21.15.102:0/4226225684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca815d3c0 0x7f9ca80c79d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.275+0000 7f9cad200640 1 -- 172.21.15.102:0/4226225684 >> 172.21.15.102:0/4226225684 conn(0x7f9ca80cf3e0 msgr2=0x7f9ca80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:03.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.275+0000 7f9cad200640 1 -- 172.21.15.102:0/4226225684 shutdown_connections 2024-03-25T06:04:03.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.275+0000 7f9cad200640 1 -- 172.21.15.102:0/4226225684 wait complete. 2024-03-25T06:04:03.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.278+0000 7f9cad200640 1 Processor -- start 2024-03-25T06:04:03.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.278+0000 7f9cad200640 1 -- start start 2024-03-25T06:04:03.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.279+0000 7f9cad200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ca80b5140 0x7f9ca81f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.279+0000 7f9cad200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca80c7f10 0x7f9ca80c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.279+0000 7f9cad200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca815d3c0 0x7f9ca80c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.279+0000 7f9cad200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80c30c0 con 0x7f9ca815d3c0 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.279+0000 7f9cad200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca81f3ca0 con 0x7f9ca80c7f10 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.279+0000 7f9cad200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca8154980 con 0x7f9ca80b5140 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca6a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca80c7f10 0x7f9ca80c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ca80b5140 0x7f9ca81f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca6a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca80c7f10 0x7f9ca80c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37862/0 (socket says 172.21.15.102:37862) 2024-03-25T06:04:03.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca6a00640 1 -- 172.21.15.102:0/3351107040 learned_addr learned my addr 172.21.15.102:0/3351107040 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7e00640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca815d3c0 0x7f9ca80c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7400640 1 -- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca80c7f10 msgr2=0x7f9ca80c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7400640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca80c7f10 0x7f9ca80c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7400640 1 -- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca815d3c0 msgr2=0x7f9ca80c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7400640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca815d3c0 0x7f9ca80c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7400640 1 -- 172.21.15.102:0/3351107040 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98009400 con 0x7f9ca80b5140 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.280+0000 7f9ca7e00640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca815d3c0 0x7f9ca80c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:03.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.281+0000 7f9ca7400640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ca80b5140 0x7f9ca81f3760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:03.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.281+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9803a6f0 con 0x7f9ca80b5140 2024-03-25T06:04:03.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.281+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9803a890 con 0x7f9ca80b5140 2024-03-25T06:04:03.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.281+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9803ac40 con 0x7f9ca80b5140 2024-03-25T06:04:03.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.281+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca814de70 con 0x7f9ca80b5140 2024-03-25T06:04:03.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.282+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca814e130 con 0x7f9ca80b5140 2024-03-25T06:04:03.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.283+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ca80ca730 con 0x7f9ca80b5140 2024-03-25T06:04:03.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.285+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c98043410 con 0x7f9ca80b5140 2024-03-25T06:04:03.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.286+0000 7f9c9f400640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c8806b860 0x7f9c8806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.286+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f9c980ac430 con 0x7f9ca80b5140 2024-03-25T06:04:03.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.286+0000 7f9ca6a00640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c8806b860 0x7f9c8806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.286+0000 7f9c9f400640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f9c88075400 0x7f9c880778a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.286+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 --> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c88077f70 con 0x7f9c88075400 2024-03-25T06:04:03.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.286+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c980aea10 con 0x7f9ca80b5140 2024-03-25T06:04:03.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.287+0000 7f9ca7e00640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f9c88075400 0x7f9c880778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.287+0000 7f9ca6a00640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c8806b860 0x7f9c8806dd20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ca815aa50 tx=0x7f9c94007d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:03.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.288+0000 7f9ca7e00640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f9c88075400 0x7f9c880778a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:03.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.289+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== osd.0 v2:172.21.15.102:6800/1923769414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9c88077f70 con 0x7f9c88075400 2024-03-25T06:04:03.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.316+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 --> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ca8154da0 con 0x7f9c88075400 2024-03-25T06:04:03.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.317+0000 7f9c9f400640 1 -- 172.21.15.102:0/3351107040 <== osd.0 v2:172.21.15.102:6800/1923769414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ca8154da0 con 0x7f9c88075400 2024-03-25T06:04:03.309 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:03.310 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.317+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f9c88075400 msgr2=0x7f9c880778a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.317+0000 7f9cad200640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.102:6800/1923769414,v1:172.21.15.102:6801/1923769414] conn(0x7f9c88075400 0x7f9c880778a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.317+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c8806b860 msgr2=0x7f9c8806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.317+0000 7f9cad200640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f9c8806b860 0x7f9c8806dd20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ca815aa50 tx=0x7f9c94007d90 comp rx=0 tx=0).stop 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.317+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ca80b5140 msgr2=0x7f9ca81f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.317+0000 7f9cad200640 1 --2- 172.21.15.102:0/3351107040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ca80b5140 0x7f9ca81f3760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c980046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.318+0000 7f9ca7e00640 1 -- 172.21.15.102:0/3351107040 reap_dead start 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.318+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 shutdown_connections 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.318+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 >> 172.21.15.102:0/3351107040 conn(0x7f9ca80cf3e0 msgr2=0x7f9ca8151d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.318+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 shutdown_connections 2024-03-25T06:04:03.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.318+0000 7f9cad200640 1 -- 172.21.15.102:0/3351107040 wait complete. 2024-03-25T06:04:03.332 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-25T06:04:03.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.602+0000 7fc66d200640 1 Processor -- start 2024-03-25T06:04:03.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.602+0000 7fc66d200640 1 -- start start 2024-03-25T06:04:03.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.604+0000 7fc66d200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc668154120 0x7fc6680cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.604+0000 7fc66d200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680cbbe0 con 0x7fc6680c67e0 2024-03-25T06:04:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.604+0000 7fc66d200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680ca280 con 0x7fc6680c6c10 2024-03-25T06:04:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.604+0000 7fc66d200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc668154500 con 0x7fc668154120 2024-03-25T06:04:03.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc667e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc6680c6c10 0x7fc668164580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47802/0 (socket says 172.21.15.102:47802) 2024-03-25T06:04:03.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc667e00640 1 -- 172.21.15.102:0/1205273249 learned_addr learned my addr 172.21.15.102:0/1205273249 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:03.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc667400640 1 --2- 172.21.15.102:0/1205273249 >> v2:172.21.15.102:3300/0 conn(0x7fc668154120 0x7fc6680cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081051523 0 0) 0x7fc6680ca280 con 0x7fc6680c6c10 2024-03-25T06:04:03.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc64c003520 con 0x7fc6680c6c10 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3328497118 0 0) 0x7fc64c003520 con 0x7fc6680c6c10 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 >> v2:172.21.15.102:3300/0 conn(0x7fc668154120 msgr2=0x7fc6680cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc666000640 1 --2- 172.21.15.102:0/1205273249 >> v2:172.21.15.102:3300/0 conn(0x7fc668154120 0x7fc6680cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 >> v1:172.21.15.102:6789/0 conn(0x7fc6680c67e0 legacy=0x7fc6680c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66815aac0 con 0x7fc6680c6c10 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.605+0000 7fc667400640 1 --2- 172.21.15.102:0/1205273249 >> v2:172.21.15.102:3300/0 conn(0x7fc668154120 0x7fc6680cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7fc6600019f0 con 0x7fc6680c6c10 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 >> v1:172.21.15.187:6789/0 conn(0x7fc6680c6c10 legacy=0x7fc668164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc64c0039c0 0x7fc64c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0047c0 0x7fc64c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc64c005180 0x7fc64c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c00c050 con 0x7fc64c0047c0 2024-03-25T06:04:03.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c00c1c0 con 0x7fc64c0039c0 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c00c380 con 0x7fc64c005180 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc667400640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc64c0039c0 0x7fc64c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc666a00640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0047c0 0x7fc64c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.606+0000 7fc667e00640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc64c005180 0x7fc64c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.607+0000 7fc667400640 1 -- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc64c005180 msgr2=0x7fc64c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.607+0000 7fc667400640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc64c005180 0x7fc64c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.607+0000 7fc667400640 1 -- 172.21.15.102:0/1205273249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0047c0 msgr2=0x7fc64c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.607+0000 7fc667400640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0047c0 0x7fc64c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.607+0000 7fc667400640 1 -- 172.21.15.102:0/1205273249 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c003520 con 0x7fc64c0039c0 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.607+0000 7fc667e00640 1 -- 172.21.15.102:0/1205273249 reap_dead start 2024-03-25T06:04:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.607+0000 7fc666a00640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0047c0 0x7fc64c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.608+0000 7fc667400640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc64c0039c0 0x7fc64c003de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc658009c90 tx=0x7fc64c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c125d1822f2e171 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.608+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65802c8f0 con 0x7fc64c0039c0 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.608+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65802ca50 con 0x7fc64c0039c0 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.608+0000 7fc666000640 1 -- 172.21.15.102:0/1205273249 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65802ce80 con 0x7fc64c0039c0 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.609+0000 7fc66d200640 1 -- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc64c0039c0 msgr2=0x7fc64c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.609+0000 7fc66d200640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc64c0039c0 0x7fc64c003de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc658009c90 tx=0x7fc64c0057f0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.609+0000 7fc66d200640 1 -- 172.21.15.102:0/1205273249 shutdown_connections 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.609+0000 7fc66d200640 1 --2- 172.21.15.102:0/1205273249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc64c0039c0 0x7fc64c003de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.609+0000 7fc66d200640 1 -- 172.21.15.102:0/1205273249 >> 172.21.15.102:0/1205273249 conn(0x7fc6680cf3e0 msgr2=0x7fc6680cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.609+0000 7fc66d200640 1 -- 172.21.15.102:0/1205273249 shutdown_connections 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.609+0000 7fc66d200640 1 -- 172.21.15.102:0/1205273249 wait complete. 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.611+0000 7fc66d200640 1 Processor -- start 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.611+0000 7fc66d200640 1 -- start start 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.611+0000 7fc66d200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0039c0 0x7fc66815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.611+0000 7fc66d200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66815dc90 0x7fc6681525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.611+0000 7fc66d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6680c2fc0 0x7fc66815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.611+0000 7fc66d200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681f35e0 con 0x7fc64c0039c0 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.611+0000 7fc66d200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681f3300 con 0x7fc66815dc90 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc66d200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815aee0 con 0x7fc6680c2fc0 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0039c0 0x7fc66815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0039c0 0x7fc66815bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44148/0 (socket says 172.21.15.102:44148) 2024-03-25T06:04:03.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 -- 172.21.15.102:0/3432146671 learned_addr learned my addr 172.21.15.102:0/3432146671 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc666a00640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66815dc90 0x7fc6681525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667e00640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6680c2fc0 0x7fc66815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 -- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6680c2fc0 msgr2=0x7fc66815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6680c2fc0 0x7fc66815c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 -- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66815dc90 msgr2=0x7fc6681525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66815dc90 0x7fc6681525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667400640 1 -- 172.21.15.102:0/3432146671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66815b1c0 con 0x7fc64c0039c0 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.612+0000 7fc667e00640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6680c2fc0 0x7fc66815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.613+0000 7fc667400640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0039c0 0x7fc66815bca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc658009db0 tx=0x7fc658004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.613+0000 7fc65f400640 1 -- 172.21.15.102:0/3432146671 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658035c10 con 0x7fc64c0039c0 2024-03-25T06:04:03.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.613+0000 7fc65f400640 1 -- 172.21.15.102:0/3432146671 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658035d70 con 0x7fc64c0039c0 2024-03-25T06:04:03.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.613+0000 7fc65f400640 1 -- 172.21.15.102:0/3432146671 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65803e650 con 0x7fc64c0039c0 2024-03-25T06:04:03.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.613+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66815b4a0 con 0x7fc64c0039c0 2024-03-25T06:04:03.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.613+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc668152b20 con 0x7fc64c0039c0 2024-03-25T06:04:03.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.614+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66815c1e0 con 0x7fc64c0039c0 2024-03-25T06:04:03.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.615+0000 7fc65f400640 1 -- 172.21.15.102:0/3432146671 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc65803b050 con 0x7fc64c0039c0 2024-03-25T06:04:03.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.616+0000 7fc65f400640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc64806b810 0x7fc64806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:03.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.618+0000 7fc65f400640 1 -- 172.21.15.102:0/3432146671 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fc658079d20 con 0x7fc64c0039c0 2024-03-25T06:04:03.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.618+0000 7fc666a00640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc64806b810 0x7fc64806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:03.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.619+0000 7fc666a00640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc64806b810 0x7fc64806dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc668152060 tx=0x7fc654009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:03.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.625+0000 7fc65f400640 1 -- 172.21.15.102:0/3432146671 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc658075f30 con 0x7fc64c0039c0 2024-03-25T06:04:03.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.893+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc66815b050 con 0x7fc64806b810 2024-03-25T06:04:03.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.894+0000 7fc65f400640 1 -- 172.21.15.102:0/3432146671 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc66815b050 con 0x7fc64806b810 2024-03-25T06:04:03.887 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.896+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc64806b810 msgr2=0x7fc64806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.896+0000 7fc66d200640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc64806b810 0x7fc64806dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc668152060 tx=0x7fc654009040 comp rx=0 tx=0).stop 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0039c0 msgr2=0x7fc66815bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0039c0 0x7fc66815bca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc658009db0 tx=0x7fc658004730 comp rx=0 tx=0).stop 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 shutdown_connections 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fc64806b810 0x7fc64806dcd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6680c2fc0 0x7fc66815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66815dc90 0x7fc6681525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 --2- 172.21.15.102:0/3432146671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc64c0039c0 0x7fc66815bca0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 >> 172.21.15.102:0/3432146671 conn(0x7fc6680cf3e0 msgr2=0x7fc6680ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 shutdown_connections 2024-03-25T06:04:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:03.897+0000 7fc66d200640 1 -- 172.21.15.102:0/3432146671 wait complete. 2024-03-25T06:04:03.908 INFO:tasks.ceph:Scrubbing osd.1 2024-03-25T06:04:03.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.096+0000 7f6c06000640 1 Processor -- start 2024-03-25T06:04:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.096+0000 7f6c06000640 1 -- start start 2024-03-25T06:04:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c06000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6c0015d3c0 0x7f6c000c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c06000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00153a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c06000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c000ca200 con 0x7f6c000c7f10 2024-03-25T06:04:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c06000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000cb090 con 0x7f6c0015d3c0 2024-03-25T06:04:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c06000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000cb4e0 con 0x7f6c000b5140 2024-03-25T06:04:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c04c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6c0015d3c0 0x7f6c000c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c04c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6c0015d3c0 0x7f6c000c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44164/0 (socket says 172.21.15.102:44164) 2024-03-25T06:04:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c04c00640 1 -- 172.21.15.102:0/660361632 learned_addr learned my addr 172.21.15.102:0/660361632 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.097+0000 7f6c05600640 1 --2- 172.21.15.102:0/660361632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.098+0000 7f6c05600640 1 -- 172.21.15.102:0/660361632 >> v2:172.21.15.102:3300/0 conn(0x7f6c0015d3c0 msgr2=0x7f6c000c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.098+0000 7f6c05600640 1 --2- 172.21.15.102:0/660361632 >> v2:172.21.15.102:3300/0 conn(0x7f6c0015d3c0 0x7f6c000c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.098+0000 7f6c05600640 1 -- 172.21.15.102:0/660361632 >> v1:172.21.15.102:6789/0 conn(0x7f6c000c7f10 legacy=0x7f6c0015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.098+0000 7f6c05600640 1 -- 172.21.15.102:0/660361632 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000cb820 con 0x7f6c000b5140 2024-03-25T06:04:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.099+0000 7f6c05600640 1 --2- 172.21.15.102:0/660361632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00153a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009d90 tx=0x7f6bf802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f787f1099da75949 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.099+0000 7f6bff400640 1 -- 172.21.15.102:0/660361632 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf802cbd0 con 0x7f6c000b5140 2024-03-25T06:04:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.099+0000 7f6bff400640 1 -- 172.21.15.102:0/660361632 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf802cd30 con 0x7f6c000b5140 2024-03-25T06:04:04.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.099+0000 7f6bff400640 1 -- 172.21.15.102:0/660361632 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf802cea0 con 0x7f6c000b5140 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 -- 172.21.15.102:0/660361632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 msgr2=0x7f6c00153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 --2- 172.21.15.102:0/660361632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00153a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009d90 tx=0x7f6bf802be20 comp rx=0 tx=0).stop 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 -- 172.21.15.102:0/660361632 shutdown_connections 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 --2- 172.21.15.102:0/660361632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00153a80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 --2- 172.21.15.102:0/660361632 >> v2:172.21.15.102:3300/0 conn(0x7f6c0015d3c0 0x7f6c000c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 -- 172.21.15.102:0/660361632 >> 172.21.15.102:0/660361632 conn(0x7f6c000cf3e0 msgr2=0x7f6c000cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 -- 172.21.15.102:0/660361632 shutdown_connections 2024-03-25T06:04:04.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.100+0000 7f6c06000640 1 -- 172.21.15.102:0/660361632 wait complete. 2024-03-25T06:04:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.101+0000 7f6c06000640 1 Processor -- start 2024-03-25T06:04:04.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.102+0000 7f6c06000640 1 -- start start 2024-03-25T06:04:04.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.102+0000 7f6c06000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.102+0000 7f6c06000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c000c7f10 0x7f6c000cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.102+0000 7f6c06000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c0015d3c0 0x7f6c000cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.102+0000 7f6c06000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00155e70 con 0x7f6c0015d3c0 2024-03-25T06:04:04.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.102+0000 7f6c06000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c001efe40 con 0x7f6c000c7f10 2024-03-25T06:04:04.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.102+0000 7f6c06000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00156630 con 0x7f6c000b5140 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c05600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c0015d3c0 0x7f6c000cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c05600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c0015d3c0 0x7f6c000cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44166/0 (socket says 172.21.15.102:44166) 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c04c00640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c05600640 1 -- 172.21.15.102:0/2055126059 learned_addr learned my addr 172.21.15.102:0/2055126059 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c05600640 1 -- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 msgr2=0x7f6c00154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c05600640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c000b5140 0x7f6c00154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c05600640 1 -- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c000c7f10 msgr2=0x7f6c000cd800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.103+0000 7f6c05600640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c000c7f10 0x7f6c000cd800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.104+0000 7f6c05600640 1 -- 172.21.15.102:0/2055126059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8009a70 con 0x7f6c0015d3c0 2024-03-25T06:04:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.104+0000 7f6c05600640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c0015d3c0 0x7f6c000cdd40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009d90 tx=0x7f6bf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.104+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf802cea0 con 0x7f6c0015d3c0 2024-03-25T06:04:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.104+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8040650 con 0x7f6c0015d3c0 2024-03-25T06:04:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.104+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8040a00 con 0x7f6c0015d3c0 2024-03-25T06:04:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.105+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c00156910 con 0x7f6c0015d3c0 2024-03-25T06:04:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.105+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c000c84e0 con 0x7f6c0015d3c0 2024-03-25T06:04:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.106+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c000ca730 con 0x7f6c0015d3c0 2024-03-25T06:04:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.108+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6bf8040b60 con 0x7f6c0015d3c0 2024-03-25T06:04:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.109+0000 7f6bfcc00640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6be006b860 0x7f6be006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.110+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f6bf80ad1e0 con 0x7f6c0015d3c0 2024-03-25T06:04:04.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.110+0000 7f6c04c00640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6be006b860 0x7f6be006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.110+0000 7f6bfcc00640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f6be00753f0 0x7f6be0077890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.110+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 --> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6be0077f60 con 0x7f6be00753f0 2024-03-25T06:04:04.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.110+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bf80af7c0 con 0x7f6c0015d3c0 2024-03-25T06:04:04.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.110+0000 7f6bffe00640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f6be00753f0 0x7f6be0077890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.110+0000 7f6c04c00640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6be006b860 0x7f6be006dd20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4015ae0 tx=0x7f6bf4018040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.111+0000 7f6bffe00640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f6be00753f0 0x7f6be0077890 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.112+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== osd.1 v2:172.21.15.102:6818/3411688389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6be0077f60 con 0x7f6be00753f0 2024-03-25T06:04:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.138+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 --> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c000ca450 con 0x7f6be00753f0 2024-03-25T06:04:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.138+0000 7f6bfcc00640 1 -- 172.21.15.102:0/2055126059 <== osd.1 v2:172.21.15.102:6818/3411688389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6bec0050b0 con 0x7f6be00753f0 2024-03-25T06:04:04.131 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:04.132 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:04.132 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f6be00753f0 msgr2=0x7f6be0077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:6818/3411688389,v1:172.21.15.102:6821/3411688389] conn(0x7f6be00753f0 0x7f6be0077890 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6be006b860 msgr2=0x7f6be006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6be006b860 0x7f6be006dd20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4015ae0 tx=0x7f6bf4018040 comp rx=0 tx=0).stop 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c0015d3c0 msgr2=0x7f6c000cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 --2- 172.21.15.102:0/2055126059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c0015d3c0 0x7f6c000cdd40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009d90 tx=0x7f6bf8004a40 comp rx=0 tx=0).stop 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c05600640 1 -- 172.21.15.102:0/2055126059 reap_dead start 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 shutdown_connections 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 >> 172.21.15.102:0/2055126059 conn(0x7f6c000cf3e0 msgr2=0x7f6c0006b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 shutdown_connections 2024-03-25T06:04:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.139+0000 7f6c06000640 1 -- 172.21.15.102:0/2055126059 wait complete. 2024-03-25T06:04:04.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-25T06:04:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.336+0000 7f03adc00640 1 Processor -- start 2024-03-25T06:04:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.336+0000 7f03adc00640 1 -- start start 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.337+0000 7f03adc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f03a8154120 0x7f03a80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03adc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03a80c67e0 0x7f03a80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03adc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80cbbe0 con 0x7f03a80c6c10 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03adc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a8154500 con 0x7f03a80c67e0 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03adc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a806b250 con 0x7f03a8154120 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03ad200640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f03a80c6c10 0x7f03a80c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47806/0 (socket says 172.21.15.102:47806) 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03ad200640 1 -- 172.21.15.102:0/2942043958 learned_addr learned my addr 172.21.15.102:0/2942043958 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03a7e00640 1 --2- 172.21.15.102:0/2942043958 >> v2:172.21.15.187:3300/0 conn(0x7f03a8154120 0x7f03a80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03a7400640 1 --2- 172.21.15.102:0/2942043958 >> v2:172.21.15.102:3300/0 conn(0x7f03a80c67e0 0x7f03a80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03a6a00640 1 -- 172.21.15.102:0/2942043958 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554853929 0 0) 0x7f03a80cbbe0 con 0x7f03a80c6c10 2024-03-25T06:04:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.338+0000 7f03a6a00640 1 -- 172.21.15.102:0/2942043958 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c003520 con 0x7f03a80c6c10 2024-03-25T06:04:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.339+0000 7f03a6a00640 1 -- 172.21.15.102:0/2942043958 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 70079724 0 0) 0x7f038c003520 con 0x7f03a80c6c10 2024-03-25T06:04:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.339+0000 7f03a7e00640 1 -- 172.21.15.102:0/2942043958 >> v2:172.21.15.102:3300/0 conn(0x7f03a80c67e0 msgr2=0x7f03a80cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.339+0000 7f03a7e00640 1 --2- 172.21.15.102:0/2942043958 >> v2:172.21.15.102:3300/0 conn(0x7f03a80c67e0 0x7f03a80cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.339+0000 7f03a7e00640 1 -- 172.21.15.102:0/2942043958 >> v1:172.21.15.187:6789/0 conn(0x7f03a80c6c10 legacy=0x7f03a80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.339+0000 7f03a7e00640 1 -- 172.21.15.102:0/2942043958 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80ca280 con 0x7f03a8154120 2024-03-25T06:04:04.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.339+0000 7f03a7400640 1 --2- 172.21.15.102:0/2942043958 >> v2:172.21.15.102:3300/0 conn(0x7f03a80c67e0 0x7f03a80cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:04.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.341+0000 7f03a7e00640 1 --2- 172.21.15.102:0/2942043958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a8154120 0x7f03a80cb000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f03a806d300 tx=0x7f039802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b496c93d5c96c03 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.341+0000 7f03a6a00640 1 -- 172.21.15.102:0/2942043958 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00019f0 con 0x7f03a8154120 2024-03-25T06:04:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.341+0000 7f03a6a00640 1 -- 172.21.15.102:0/2942043958 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398033440 con 0x7f03a8154120 2024-03-25T06:04:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.341+0000 7f03a6a00640 1 -- 172.21.15.102:0/2942043958 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03980337d0 con 0x7f03a8154120 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 -- 172.21.15.102:0/2942043958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a8154120 msgr2=0x7f03a80cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 --2- 172.21.15.102:0/2942043958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a8154120 0x7f03a80cb000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f03a806d300 tx=0x7f039802b7a0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 -- 172.21.15.102:0/2942043958 shutdown_connections 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 --2- 172.21.15.102:0/2942043958 >> v2:172.21.15.102:3300/0 conn(0x7f03a80c67e0 0x7f03a80cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 --2- 172.21.15.102:0/2942043958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a8154120 0x7f03a80cb000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 -- 172.21.15.102:0/2942043958 >> 172.21.15.102:0/2942043958 conn(0x7f03a80cf3e0 msgr2=0x7f03a80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 -- 172.21.15.102:0/2942043958 shutdown_connections 2024-03-25T06:04:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.342+0000 7f03adc00640 1 -- 172.21.15.102:0/2942043958 wait complete. 2024-03-25T06:04:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.344+0000 7f03adc00640 1 Processor -- start 2024-03-25T06:04:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.345+0000 7f03adc00640 1 -- start start 2024-03-25T06:04:04.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03adc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03a80c67e0 0x7f03a815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03adc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a80c6c10 0x7f03a8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03adc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a8154120 0x7f03a81597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03adc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81efd90 con 0x7f03a8154120 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03adc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81f0030 con 0x7f03a80c6c10 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03adc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81556a0 con 0x7f03a80c67e0 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03a7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03a80c67e0 0x7f03a815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03a7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03a80c67e0 0x7f03a815cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38692/0 (socket says 172.21.15.102:38692) 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03a7e00640 1 -- 172.21.15.102:0/2760225502 learned_addr learned my addr 172.21.15.102:0/2760225502 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03ad200640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a8154120 0x7f03a81597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.346+0000 7f03a7400640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a80c6c10 0x7f03a8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.347+0000 7f03a7e00640 1 -- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a80c6c10 msgr2=0x7f03a8156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.347+0000 7f03a7e00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a80c6c10 0x7f03a8156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.347+0000 7f03a7e00640 1 -- 172.21.15.102:0/2760225502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a8154120 msgr2=0x7f03a81597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.347+0000 7f03a7e00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a8154120 0x7f03a81597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.347+0000 7f03a7e00640 1 -- 172.21.15.102:0/2760225502 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009400 con 0x7f03a80c67e0 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.347+0000 7f03a7e00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03a80c67e0 0x7f03a815cc10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0398000c00 tx=0x7f03980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.348+0000 7f039fe00640 1 -- 172.21.15.102:0/2760225502 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398030940 con 0x7f03a80c67e0 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.348+0000 7f039fe00640 1 -- 172.21.15.102:0/2760225502 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398030ac0 con 0x7f03a80c67e0 2024-03-25T06:04:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.348+0000 7f039fe00640 1 -- 172.21.15.102:0/2760225502 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398030e70 con 0x7f03a80c67e0 2024-03-25T06:04:04.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.348+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0398009400 con 0x7f03a80c67e0 2024-03-25T06:04:04.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.348+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a8155960 con 0x7f03a80c67e0 2024-03-25T06:04:04.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.349+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8155e80 con 0x7f03a80c67e0 2024-03-25T06:04:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.351+0000 7f039fe00640 1 -- 172.21.15.102:0/2760225502 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f039803a040 con 0x7f03a80c67e0 2024-03-25T06:04:04.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.352+0000 7f039fe00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f038806b840 0x7f038806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.352+0000 7f039fe00640 1 -- 172.21.15.102:0/2760225502 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f03980ac4a0 con 0x7f03a80c67e0 2024-03-25T06:04:04.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.352+0000 7f03a7400640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f038806b840 0x7f038806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.353+0000 7f03a7400640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f038806b840 0x7f038806dd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f03a80c9fb0 tx=0x7f0394009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.356+0000 7f039fe00640 1 -- 172.21.15.102:0/2760225502 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f03a8155e80 con 0x7f03a80c67e0 2024-03-25T06:04:04.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.581+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f03a80ca7b0 con 0x7f038806b840 2024-03-25T06:04:04.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.581+0000 7f039fe00640 1 -- 172.21.15.102:0/2760225502 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0394009920 con 0x7f038806b840 2024-03-25T06:04:04.574 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f038806b840 msgr2=0x7f038806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f038806b840 0x7f038806dd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f03a80c9fb0 tx=0x7f0394009190 comp rx=0 tx=0).stop 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03a80c67e0 msgr2=0x7f03a815cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03a80c67e0 0x7f03a815cc10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0398000c00 tx=0x7f03980046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 shutdown_connections 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f038806b840 0x7f038806dd00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a8154120 0x7f03a81597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03a80c6c10 0x7f03a8156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 --2- 172.21.15.102:0/2760225502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03a80c67e0 0x7f03a815cc10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 >> 172.21.15.102:0/2760225502 conn(0x7f03a80cf3e0 msgr2=0x7f03a80ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:04.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 shutdown_connections 2024-03-25T06:04:04.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.585+0000 7f03adc00640 1 -- 172.21.15.102:0/2760225502 wait complete. 2024-03-25T06:04:04.593 INFO:tasks.ceph:Scrubbing osd.2 2024-03-25T06:04:04.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:04.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.793+0000 7f139d800640 1 Processor -- start 2024-03-25T06:04:04.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.793+0000 7f139d800640 1 -- start start 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f139d800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f13980b5140 0x7f139815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f139d800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13980c6a70 0x7f1398153a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f139d800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13980ca200 con 0x7f139815d3c0 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f139d800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980cb090 con 0x7f13980c6a70 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f139d800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980cb4e0 con 0x7f13980b5140 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f1397400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f13980b5140 0x7f139815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f139ce00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13980c6a70 0x7f1398153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f1397e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f139815d3c0 0x7f13980c79d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47818/0 (socket says 172.21.15.102:47818) 2024-03-25T06:04:04.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f1397e00640 1 -- 172.21.15.102:0/2905625186 learned_addr learned my addr 172.21.15.102:0/2905625186 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:04.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f1397400640 1 -- 172.21.15.102:0/2905625186 >> v2:172.21.15.102:3300/0 conn(0x7f13980c6a70 msgr2=0x7f1398153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:04.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f1397400640 1 --2- 172.21.15.102:0/2905625186 >> v2:172.21.15.102:3300/0 conn(0x7f13980c6a70 0x7f1398153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f1397400640 1 -- 172.21.15.102:0/2905625186 >> v1:172.21.15.187:6789/0 conn(0x7f139815d3c0 legacy=0x7f13980c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.795+0000 7f1397400640 1 -- 172.21.15.102:0/2905625186 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980cb820 con 0x7f13980b5140 2024-03-25T06:04:04.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.797+0000 7f1397400640 1 --2- 172.21.15.102:0/2905625186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f139815d7a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13980d04c0 tx=0x7f138402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52d374ef25f775a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.797+0000 7f1396a00640 1 -- 172.21.15.102:0/2905625186 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384031830 con 0x7f13980b5140 2024-03-25T06:04:04.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.797+0000 7f1396a00640 1 -- 172.21.15.102:0/2905625186 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384031990 con 0x7f13980b5140 2024-03-25T06:04:04.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.797+0000 7f1396a00640 1 -- 172.21.15.102:0/2905625186 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384031d20 con 0x7f13980b5140 2024-03-25T06:04:04.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.797+0000 7f139d800640 1 -- 172.21.15.102:0/2905625186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 msgr2=0x7f139815d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.797+0000 7f139d800640 1 --2- 172.21.15.102:0/2905625186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f139815d7a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13980d04c0 tx=0x7f138402b8d0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.798+0000 7f139d800640 1 -- 172.21.15.102:0/2905625186 shutdown_connections 2024-03-25T06:04:04.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.798+0000 7f139d800640 1 --2- 172.21.15.102:0/2905625186 >> v2:172.21.15.102:3300/0 conn(0x7f13980c6a70 0x7f1398153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.798+0000 7f139d800640 1 --2- 172.21.15.102:0/2905625186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f139815d7a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.798+0000 7f139d800640 1 -- 172.21.15.102:0/2905625186 >> 172.21.15.102:0/2905625186 conn(0x7f13980cf3e0 msgr2=0x7f13980cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:04.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.798+0000 7f139d800640 1 -- 172.21.15.102:0/2905625186 shutdown_connections 2024-03-25T06:04:04.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.798+0000 7f139d800640 1 -- 172.21.15.102:0/2905625186 wait complete. 2024-03-25T06:04:04.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.799+0000 7f139d800640 1 Processor -- start 2024-03-25T06:04:04.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.800+0000 7f139d800640 1 -- start start 2024-03-25T06:04:04.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.800+0000 7f139d800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f13981f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.800+0000 7f139d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13980c6a70 0x7f139815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f139d800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f139815d3c0 0x7f13981514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f139d800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13981e49f0 con 0x7f139815d3c0 2024-03-25T06:04:04.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f139d800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139815ccf0 con 0x7f13980b5140 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f139d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1398152ea0 con 0x7f13980c6a70 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f13981f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f13981f2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37922/0 (socket says 172.21.15.102:37922) 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 -- 172.21.15.102:0/3655314893 learned_addr learned my addr 172.21.15.102:0/3655314893 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397400640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13980c6a70 0x7f139815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f139ce00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f139815d3c0 0x7f13981514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 -- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13980c6a70 msgr2=0x7f139815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13980c6a70 0x7f139815c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 -- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f139815d3c0 msgr2=0x7f13981514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f139815d3c0 0x7f13981514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f1397e00640 1 -- 172.21.15.102:0/3655314893 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1384009400 con 0x7f13980b5140 2024-03-25T06:04:04.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.801+0000 7f139ce00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f139815d3c0 0x7f13981514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:04.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.802+0000 7f1397e00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f13981f2c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f138800c3c0 tx=0x7f138800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.802+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388005ce0 con 0x7f13980b5140 2024-03-25T06:04:04.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.802+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388005e40 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.802+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880072d0 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.802+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1398153180 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.802+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13981e4610 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.803+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13980c80e0 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.805+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f13880074f0 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.806+0000 7f138fe00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f137806b810 0x7f137806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.806+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f1388089c30 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.807+0000 7f1397400640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f137806b810 0x7f137806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.807+0000 7f138fe00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7f1378075320 0x7f13780777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.807+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 --> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1378077e90 con 0x7f1378075320 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.807+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f138808e2a0 con 0x7f13980b5140 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.807+0000 7f139ce00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7f1378075320 0x7f13780777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.807+0000 7f1397400640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f137806b810 0x7f137806dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1384036000 tx=0x7f138403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.808+0000 7f139ce00640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7f1378075320 0x7f13780777c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:04.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.809+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== osd.2 v2:172.21.15.102:6816/3156921662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1378077e90 con 0x7f1378075320 2024-03-25T06:04:04.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.835+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 --> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13980ca450 con 0x7f1378075320 2024-03-25T06:04:04.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.835+0000 7f138fe00640 1 -- 172.21.15.102:0/3655314893 <== osd.2 v2:172.21.15.102:6816/3156921662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f139000f040 con 0x7f1378075320 2024-03-25T06:04:04.828 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:04.829 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7f1378075320 msgr2=0x7f13780777c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.102:6816/3156921662,v1:172.21.15.102:6817/3156921662] conn(0x7f1378075320 0x7f13780777c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f137806b810 msgr2=0x7f137806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f137806b810 0x7f137806dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1384036000 tx=0x7f138403c040 comp rx=0 tx=0).stop 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 msgr2=0x7f13981f2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 --2- 172.21.15.102:0/3655314893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13980b5140 0x7f13981f2c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f138800c3c0 tx=0x7f138800c880 comp rx=0 tx=0).stop 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139ce00640 1 -- 172.21.15.102:0/3655314893 reap_dead start 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 shutdown_connections 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 >> 172.21.15.102:0/3655314893 conn(0x7f13980cf3e0 msgr2=0x7f1398150b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 shutdown_connections 2024-03-25T06:04:04.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:04.836+0000 7f139d800640 1 -- 172.21.15.102:0/3655314893 wait complete. 2024-03-25T06:04:04.849 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-25T06:04:05.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.057+0000 7fb493200640 1 Processor -- start 2024-03-25T06:04:05.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.057+0000 7fb493200640 1 -- start start 2024-03-25T06:04:05.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.058+0000 7fb493200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4940cb1f0 0x7fb4940cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.059+0000 7fb493200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb494161f40 con 0x7fb49406b250 2024-03-25T06:04:05.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.059+0000 7fb493200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4941621c0 con 0x7fb494158230 2024-03-25T06:04:05.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.059+0000 7fb493200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940cbc10 con 0x7fb4940cb1f0 2024-03-25T06:04:05.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.059+0000 7fb491400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4940cb1f0 0x7fb4940cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.059+0000 7fb491400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4940cb1f0 0x7fb4940cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38712/0 (socket says 172.21.15.102:38712) 2024-03-25T06:04:05.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.059+0000 7fb491400640 1 -- 172.21.15.102:0/1046018118 learned_addr learned my addr 172.21.15.102:0/1046018118 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:05.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122296818 0 0) 0x7fb4941621c0 con 0x7fb494158230 2024-03-25T06:04:05.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb478003520 con 0x7fb494158230 2024-03-25T06:04:05.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415211517 0 0) 0x7fb494161f40 con 0x7fb49406b250 2024-03-25T06:04:05.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4941621c0 con 0x7fb49406b250 2024-03-25T06:04:05.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb491400640 1 -- 172.21.15.102:0/1046018118 >> v1:172.21.15.187:6789/0 conn(0x7fb494158230 legacy=0x7fb4940b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb491400640 1 -- 172.21.15.102:0/1046018118 >> v1:172.21.15.102:6789/0 conn(0x7fb49406b250 legacy=0x7fb4940ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb491400640 1 -- 172.21.15.102:0/1046018118 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494162480 con 0x7fb4940cb1f0 2024-03-25T06:04:05.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.060+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104444914 0 0) 0x7fb478003520 con 0x7fb494158230 2024-03-25T06:04:05.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.062+0000 7fb491400640 1 --2- 172.21.15.102:0/1046018118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4940cb1f0 0x7fb4940cb6d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb480009820 tx=0x7fb48002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d848eaefd557d93 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.062+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484001670 con 0x7fb4940cb1f0 2024-03-25T06:04:05.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.062+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480031670 con 0x7fb4940cb1f0 2024-03-25T06:04:05.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.062+0000 7fb490a00640 1 -- 172.21.15.102:0/1046018118 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480031a00 con 0x7fb4940cb1f0 2024-03-25T06:04:05.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.063+0000 7fb493200640 1 -- 172.21.15.102:0/1046018118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4940cb1f0 msgr2=0x7fb4940cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.063+0000 7fb493200640 1 --2- 172.21.15.102:0/1046018118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4940cb1f0 0x7fb4940cb6d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb480009820 tx=0x7fb48002b910 comp rx=0 tx=0).stop 2024-03-25T06:04:05.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.064+0000 7fb493200640 1 -- 172.21.15.102:0/1046018118 shutdown_connections 2024-03-25T06:04:05.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.064+0000 7fb493200640 1 --2- 172.21.15.102:0/1046018118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4940cb1f0 0x7fb4940cb6d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.064+0000 7fb493200640 1 -- 172.21.15.102:0/1046018118 >> 172.21.15.102:0/1046018118 conn(0x7fb4940cf3e0 msgr2=0x7fb4940cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:05.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.064+0000 7fb493200640 1 -- 172.21.15.102:0/1046018118 shutdown_connections 2024-03-25T06:04:05.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.064+0000 7fb493200640 1 -- 172.21.15.102:0/1046018118 wait complete. 2024-03-25T06:04:05.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.066+0000 7fb493200640 1 Processor -- start 2024-03-25T06:04:05.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.066+0000 7fb493200640 1 -- start start 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb493200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb49406b250 0x7fb4941e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb493200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4940cb1f0 0x7fb4941531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb493200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb494158230 0x7fb494155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb493200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4941f4390 con 0x7fb4940cb1f0 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb493200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4941564a0 con 0x7fb49406b250 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb493200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49406e770 con 0x7fb494158230 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb491e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb49406b250 0x7fb4941e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb491e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb49406b250 0x7fb4941e73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37934/0 (socket says 172.21.15.102:37934) 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb491e00640 1 -- 172.21.15.102:0/537650667 learned_addr learned my addr 172.21.15.102:0/537650667 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb491400640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4940cb1f0 0x7fb4941531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.068+0000 7fb492800640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb494158230 0x7fb494155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb491e00640 1 -- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb494158230 msgr2=0x7fb494155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb491e00640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb494158230 0x7fb494155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb491e00640 1 -- 172.21.15.102:0/537650667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4940cb1f0 msgr2=0x7fb4941531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb491e00640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4940cb1f0 0x7fb4941531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb491e00640 1 -- 172.21.15.102:0/537650667 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800094d0 con 0x7fb49406b250 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb491400640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4940cb1f0 0x7fb4941531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb491e00640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb49406b250 0x7fb4941e73b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c750 tx=0x7fb48400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.069+0000 7fb48a000640 1 -- 172.21.15.102:0/537650667 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484005270 con 0x7fb49406b250 2024-03-25T06:04:05.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.070+0000 7fb48a000640 1 -- 172.21.15.102:0/537650667 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4840053d0 con 0x7fb49406b250 2024-03-25T06:04:05.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.070+0000 7fb48a000640 1 -- 172.21.15.102:0/537650667 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400a860 con 0x7fb49406b250 2024-03-25T06:04:05.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.070+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4941f3aa0 con 0x7fb49406b250 2024-03-25T06:04:05.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.070+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4941f4820 con 0x7fb49406b250 2024-03-25T06:04:05.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.072+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49404f2f0 con 0x7fb49406b250 2024-03-25T06:04:05.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.073+0000 7fb48a000640 1 -- 172.21.15.102:0/537650667 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb48400a9c0 con 0x7fb49406b250 2024-03-25T06:04:05.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.074+0000 7fb48a000640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb47406b840 0x7fb47406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.074+0000 7fb48a000640 1 -- 172.21.15.102:0/537650667 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb48408a4a0 con 0x7fb49406b250 2024-03-25T06:04:05.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.075+0000 7fb491400640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb47406b840 0x7fb47406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.075+0000 7fb491400640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb47406b840 0x7fb47406dd00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb480036000 tx=0x7fb48003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.078+0000 7fb48a000640 1 -- 172.21.15.102:0/537650667 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb484054950 con 0x7fb49406b250 2024-03-25T06:04:05.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.327+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4940ccd30 con 0x7fb47406b840 2024-03-25T06:04:05.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.328+0000 7fb48a000640 1 -- 172.21.15.102:0/537650667 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb4940ccd30 con 0x7fb47406b840 2024-03-25T06:04:05.321 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb47406b840 msgr2=0x7fb47406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb47406b840 0x7fb47406dd00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb480036000 tx=0x7fb48003c040 comp rx=0 tx=0).stop 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb49406b250 msgr2=0x7fb4941e73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb49406b250 0x7fb4941e73b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c750 tx=0x7fb48400cc10 comp rx=0 tx=0).stop 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 shutdown_connections 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb47406b840 0x7fb47406dd00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb494158230 0x7fb494155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4940cb1f0 0x7fb4941531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 --2- 172.21.15.102:0/537650667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb49406b250 0x7fb4941e73b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.330+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 >> 172.21.15.102:0/537650667 conn(0x7fb4940cf3e0 msgr2=0x7fb4940b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.331+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 shutdown_connections 2024-03-25T06:04:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.331+0000 7fb493200640 1 -- 172.21.15.102:0/537650667 wait complete. 2024-03-25T06:04:05.340 INFO:tasks.ceph:Scrubbing osd.3 2024-03-25T06:04:05.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:05.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.517+0000 7f6fb6c00640 1 Processor -- start 2024-03-25T06:04:05.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.518+0000 7f6fb6c00640 1 -- start start 2024-03-25T06:04:05.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.519+0000 7f6fb6c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6fb00b5140 0x7f6fb015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fb6c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb00ca200 con 0x7f6fb00c6a70 2024-03-25T06:04:05.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fb6c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb00cb4e0 con 0x7f6fb015d3c0 2024-03-25T06:04:05.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fb6c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb00cb090 con 0x7f6fb00b5140 2024-03-25T06:04:05.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fb5800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f6fb015d3c0 0x7f6fb00c79d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47844/0 (socket says 172.21.15.102:47844) 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fb5800640 1 -- 172.21.15.102:0/2235585403 learned_addr learned my addr 172.21.15.102:0/2235585403 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fb4e00640 1 --2- 172.21.15.102:0/2235585403 >> v2:172.21.15.102:3300/0 conn(0x7f6fb00b5140 0x7f6fb015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394248536 0 0) 0x7f6fb00cb4e0 con 0x7f6fb015d3c0 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f98003520 con 0x7f6fb015d3c0 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.520+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891922442 0 0) 0x7f6fb00ca200 con 0x7f6fb00c6a70 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.521+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb00cb4e0 con 0x7f6fb00c6a70 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.521+0000 7f6fb4e00640 1 -- 172.21.15.102:0/2235585403 >> v1:172.21.15.187:6789/0 conn(0x7f6fb015d3c0 legacy=0x7f6fb00c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.521+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3528281140 0 0) 0x7f6f98003520 con 0x7f6fb015d3c0 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.521+0000 7f6fb4e00640 1 -- 172.21.15.102:0/2235585403 >> v1:172.21.15.102:6789/0 conn(0x7f6fb00c6a70 legacy=0x7f6fb0153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.521+0000 7f6fb4e00640 1 -- 172.21.15.102:0/2235585403 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00cb820 con 0x7f6fb00b5140 2024-03-25T06:04:05.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.522+0000 7f6fb4e00640 1 --2- 172.21.15.102:0/2235585403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb00b5140 0x7f6fb015d7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0097a0 tx=0x7f6f9c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46126443aaa0d47c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.523+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8001970 con 0x7f6fb00b5140 2024-03-25T06:04:05.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.523+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c02e050 con 0x7f6fb00b5140 2024-03-25T06:04:05.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.523+0000 7f6fafe00640 1 -- 172.21.15.102:0/2235585403 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4001670 con 0x7f6fb00b5140 2024-03-25T06:04:05.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.523+0000 7f6fb6c00640 1 -- 172.21.15.102:0/2235585403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb00b5140 msgr2=0x7f6fb015d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.523+0000 7f6fb6c00640 1 --2- 172.21.15.102:0/2235585403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb00b5140 0x7f6fb015d7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0097a0 tx=0x7f6f9c02b710 comp rx=0 tx=0).stop 2024-03-25T06:04:05.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.524+0000 7f6fb6c00640 1 -- 172.21.15.102:0/2235585403 shutdown_connections 2024-03-25T06:04:05.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.524+0000 7f6fb6c00640 1 --2- 172.21.15.102:0/2235585403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb00b5140 0x7f6fb015d7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.524+0000 7f6fb6c00640 1 -- 172.21.15.102:0/2235585403 >> 172.21.15.102:0/2235585403 conn(0x7f6fb00cf3e0 msgr2=0x7f6fb00cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:05.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.524+0000 7f6fb6c00640 1 -- 172.21.15.102:0/2235585403 shutdown_connections 2024-03-25T06:04:05.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.524+0000 7f6fb6c00640 1 -- 172.21.15.102:0/2235585403 wait complete. 2024-03-25T06:04:05.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.526+0000 7f6fb6c00640 1 Processor -- start 2024-03-25T06:04:05.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.526+0000 7f6fb6c00640 1 -- start start 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb6c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fb00b5140 0x7f6fb0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb6c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fb00c6a70 0x7f6fb01eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb6c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb015d3c0 0x7f6fb01ef510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb6c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb01e3e00 con 0x7f6fb015d3c0 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb6c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb01e4620 con 0x7f6fb00b5140 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb6c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00c7260 con 0x7f6fb00c6a70 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb5800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fb00b5140 0x7f6fb0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb4e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fb00c6a70 0x7f6fb01eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb6200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb015d3c0 0x7f6fb01ef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb4e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fb00c6a70 0x7f6fb01eefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38720/0 (socket says 172.21.15.102:38720) 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.528+0000 7f6fb4e00640 1 -- 172.21.15.102:0/466256414 learned_addr learned my addr 172.21.15.102:0/466256414 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fb4e00640 1 -- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fb00b5140 msgr2=0x7f6fb0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fb4e00640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fb00b5140 0x7f6fb0150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fb4e00640 1 -- 172.21.15.102:0/466256414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb015d3c0 msgr2=0x7f6fb01ef510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fb4e00640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb015d3c0 0x7f6fb01ef510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fb4e00640 1 -- 172.21.15.102:0/466256414 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c009400 con 0x7f6fb00c6a70 2024-03-25T06:04:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fb5800640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fb00b5140 0x7f6fb0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:05.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fb4e00640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fb00c6a70 0x7f6fb01eefd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0098c0 tx=0x7f6f9c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.529+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c03c880 con 0x7f6fb00c6a70 2024-03-25T06:04:05.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.530+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c03c9e0 con 0x7f6fb00c6a70 2024-03-25T06:04:05.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.530+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c03cd90 con 0x7f6fb00c6a70 2024-03-25T06:04:05.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.530+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb01f2f80 con 0x7f6fb00c6a70 2024-03-25T06:04:05.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.530+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb01e4340 con 0x7f6fb00c6a70 2024-03-25T06:04:05.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.531+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fb00c80e0 con 0x7f6fb00c6a70 2024-03-25T06:04:05.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.533+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6f9c039040 con 0x7f6fb00c6a70 2024-03-25T06:04:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fad600640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f9006b810 0x7f6f9006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f6f9c0aca30 con 0x7f6fb00c6a70 2024-03-25T06:04:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fb5800640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f9006b810 0x7f6f9006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fad600640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7f6f90075320 0x7f6f900777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 --> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f90077e90 con 0x7f6f90075320 2024-03-25T06:04:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f9c0acda0 con 0x7f6fb00c6a70 2024-03-25T06:04:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fb6200640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7f6f90075320 0x7f6f900777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.534+0000 7f6fb5800640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f9006b810 0x7f6f9006dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4001eb0 tx=0x7f6fa4001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.535+0000 7f6fb6200640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7f6f90075320 0x7f6f900777c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.536+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== osd.3 v2:172.21.15.102:6808/3429470735 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6f90077e90 con 0x7f6f90075320 2024-03-25T06:04:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.550+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 --> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6fb00ca450 con 0x7f6f90075320 2024-03-25T06:04:05.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fad600640 1 -- 172.21.15.102:0/466256414 <== osd.3 v2:172.21.15.102:6808/3429470735 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6fa8007e50 con 0x7f6f90075320 2024-03-25T06:04:05.544 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:05.544 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:05.544 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:05.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7f6f90075320 msgr2=0x7f6f900777c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.102:6808/3429470735,v1:172.21.15.102:6809/3429470735] conn(0x7f6f90075320 0x7f6f900777c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f9006b810 msgr2=0x7f6f9006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f6f9006b810 0x7f6f9006dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4001eb0 tx=0x7f6fa4001e40 comp rx=0 tx=0).stop 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fb00c6a70 msgr2=0x7f6fb01eefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 --2- 172.21.15.102:0/466256414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fb00c6a70 0x7f6fb01eefd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0098c0 tx=0x7f6f9c0046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6200640 1 -- 172.21.15.102:0/466256414 reap_dead start 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 shutdown_connections 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 >> 172.21.15.102:0/466256414 conn(0x7f6fb00cf3e0 msgr2=0x7f6fb00c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 shutdown_connections 2024-03-25T06:04:05.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.551+0000 7f6fb6c00640 1 -- 172.21.15.102:0/466256414 wait complete. 2024-03-25T06:04:05.566 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-25T06:04:05.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.742+0000 7fec50c00640 1 Processor -- start 2024-03-25T06:04:05.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.743+0000 7fec50c00640 1 -- start start 2024-03-25T06:04:05.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec50c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c154120 0x7fec4c0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec50c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c0cbbe0 con 0x7fec4c0c67e0 2024-03-25T06:04:05.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec50c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c0ca280 con 0x7fec4c0c6c10 2024-03-25T06:04:05.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec50c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c154500 con 0x7fec4c154120 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec4be00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fec4c0c6c10 0x7fec4c164580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47856/0 (socket says 172.21.15.102:47856) 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec4be00640 1 -- 172.21.15.102:0/819537130 learned_addr learned my addr 172.21.15.102:0/819537130 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec4b400640 1 --2- 172.21.15.102:0/819537130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c154120 0x7fec4c0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.744+0000 7fec4a000640 1 -- 172.21.15.102:0/819537130 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281314170 0 0) 0x7fec4c0ca280 con 0x7fec4c0c6c10 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.745+0000 7fec4a000640 1 -- 172.21.15.102:0/819537130 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec30003520 con 0x7fec4c0c6c10 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.745+0000 7fec4b400640 1 -- 172.21.15.102:0/819537130 >> v1:172.21.15.187:6789/0 conn(0x7fec4c0c6c10 legacy=0x7fec4c164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.745+0000 7fec4a000640 1 -- 172.21.15.102:0/819537130 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430773340 0 0) 0x7fec4c0cbbe0 con 0x7fec4c0c67e0 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.745+0000 7fec4b400640 1 -- 172.21.15.102:0/819537130 >> v1:172.21.15.102:6789/0 conn(0x7fec4c0c67e0 legacy=0x7fec4c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.745+0000 7fec4b400640 1 -- 172.21.15.102:0/819537130 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c15aac0 con 0x7fec4c154120 2024-03-25T06:04:05.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.746+0000 7fec4b400640 1 --2- 172.21.15.102:0/819537130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c154120 0x7fec4c0cb000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec340097d0 tx=0x7fec3402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43875a2dc86de1c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.746+0000 7fec4a000640 1 -- 172.21.15.102:0/819537130 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34030610 con 0x7fec4c154120 2024-03-25T06:04:05.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.746+0000 7fec4a000640 1 -- 172.21.15.102:0/819537130 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34030770 con 0x7fec4c154120 2024-03-25T06:04:05.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.747+0000 7fec4a000640 1 -- 172.21.15.102:0/819537130 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34030b00 con 0x7fec4c154120 2024-03-25T06:04:05.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.747+0000 7fec50c00640 1 -- 172.21.15.102:0/819537130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c154120 msgr2=0x7fec4c0cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.747+0000 7fec50c00640 1 --2- 172.21.15.102:0/819537130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c154120 0x7fec4c0cb000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec340097d0 tx=0x7fec3402b960 comp rx=0 tx=0).stop 2024-03-25T06:04:05.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.747+0000 7fec50c00640 1 -- 172.21.15.102:0/819537130 shutdown_connections 2024-03-25T06:04:05.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.747+0000 7fec50c00640 1 --2- 172.21.15.102:0/819537130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c154120 0x7fec4c0cb000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.747+0000 7fec50c00640 1 -- 172.21.15.102:0/819537130 >> 172.21.15.102:0/819537130 conn(0x7fec4c0cf3e0 msgr2=0x7fec4c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:05.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.747+0000 7fec50c00640 1 -- 172.21.15.102:0/819537130 shutdown_connections 2024-03-25T06:04:05.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.748+0000 7fec50c00640 1 -- 172.21.15.102:0/819537130 wait complete. 2024-03-25T06:04:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.750+0000 7fec50c00640 1 Processor -- start 2024-03-25T06:04:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.750+0000 7fec50c00640 1 -- start start 2024-03-25T06:04:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.751+0000 7fec50c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec4c0c67e0 0x7fec4c15cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.751+0000 7fec50c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0c6c10 0x7fec4c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.751+0000 7fec50c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c154120 0x7fec4c0c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.751+0000 7fec50c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c15c800 con 0x7fec4c0c67e0 2024-03-25T06:04:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.751+0000 7fec50c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0c2c30 con 0x7fec4c154120 2024-03-25T06:04:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.751+0000 7fec50c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c15d160 con 0x7fec4c0c6c10 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4b400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec4c0c67e0 0x7fec4c15cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4b400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec4c0c67e0 0x7fec4c15cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44256/0 (socket says 172.21.15.102:44256) 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4b400640 1 -- 172.21.15.102:0/1402805453 learned_addr learned my addr 172.21.15.102:0/1402805453 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4aa00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0c6c10 0x7fec4c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4be00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c154120 0x7fec4c0c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4aa00640 1 -- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c154120 msgr2=0x7fec4c0c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4aa00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c154120 0x7fec4c0c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4aa00640 1 -- 172.21.15.102:0/1402805453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec4c0c67e0 msgr2=0x7fec4c15cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4aa00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec4c0c67e0 0x7fec4c15cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4aa00640 1 -- 172.21.15.102:0/1402805453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009400 con 0x7fec4c0c6c10 2024-03-25T06:04:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.752+0000 7fec4b400640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec4c0c67e0 0x7fec4c15cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.753+0000 7fec4aa00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0c6c10 0x7fec4c1596d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0c6bc0 tx=0x7fec3c00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.753+0000 7fec43400640 1 -- 172.21.15.102:0/1402805453 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c003610 con 0x7fec4c0c6c10 2024-03-25T06:04:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.753+0000 7fec43400640 1 -- 172.21.15.102:0/1402805453 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c003770 con 0x7fec4c0c6c10 2024-03-25T06:04:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.753+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c1482a0 con 0x7fec4c0c6c10 2024-03-25T06:04:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.753+0000 7fec43400640 1 -- 172.21.15.102:0/1402805453 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c003ae0 con 0x7fec4c0c6c10 2024-03-25T06:04:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.753+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c15c140 con 0x7fec4c0c6c10 2024-03-25T06:04:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.755+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c04f2f0 con 0x7fec4c0c6c10 2024-03-25T06:04:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.756+0000 7fec43400640 1 -- 172.21.15.102:0/1402805453 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fec3c003c40 con 0x7fec4c0c6c10 2024-03-25T06:04:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.757+0000 7fec43400640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fec2806b810 0x7fec2806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.757+0000 7fec43400640 1 -- 172.21.15.102:0/1402805453 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fec3c089b90 con 0x7fec4c0c6c10 2024-03-25T06:04:05.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.757+0000 7fec4b400640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fec2806b810 0x7fec2806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:05.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.758+0000 7fec4b400640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fec2806b810 0x7fec2806dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec3402b9a0 tx=0x7fec3403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:05.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:05.761+0000 7fec43400640 1 -- 172.21.15.102:0/1402805453 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fec3c0540f0 con 0x7fec4c0c6c10 2024-03-25T06:04:06.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.058+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fec4c0c77e0 con 0x7fec2806b810 2024-03-25T06:04:06.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.059+0000 7fec43400640 1 -- 172.21.15.102:0/1402805453 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fec3403f040 con 0x7fec2806b810 2024-03-25T06:04:06.051 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 3 to deep-scrub 2024-03-25T06:04:06.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.061+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fec2806b810 msgr2=0x7fec2806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.061+0000 7fec50c00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fec2806b810 0x7fec2806dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec3402b9a0 tx=0x7fec3403b040 comp rx=0 tx=0).stop 2024-03-25T06:04:06.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.061+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0c6c10 msgr2=0x7fec4c1596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.061+0000 7fec50c00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0c6c10 0x7fec4c1596d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0c6bc0 tx=0x7fec3c00c890 comp rx=0 tx=0).stop 2024-03-25T06:04:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 shutdown_connections 2024-03-25T06:04:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fec2806b810 0x7fec2806dcd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c154120 0x7fec4c0c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0c6c10 0x7fec4c1596d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 --2- 172.21.15.102:0/1402805453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec4c0c67e0 0x7fec4c15cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 >> 172.21.15.102:0/1402805453 conn(0x7fec4c0cf3e0 msgr2=0x7fec4c0c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:06.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 shutdown_connections 2024-03-25T06:04:06.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.062+0000 7fec50c00640 1 -- 172.21.15.102:0/1402805453 wait complete. 2024-03-25T06:04:06.070 INFO:tasks.ceph:Scrubbing osd.4 2024-03-25T06:04:06.071 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:06.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.262+0000 7fdf8be00640 1 Processor -- start 2024-03-25T06:04:06.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.262+0000 7fdf8be00640 1 -- start start 2024-03-25T06:04:06.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8be00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdf8c15d3c0 0x7fdf8c0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c0c7f10 0x7fdf8c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8be00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0ca200 con 0x7fdf8c0b5140 2024-03-25T06:04:06.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8be00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cb090 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cb4e0 con 0x7fdf8c0c7f10 2024-03-25T06:04:06.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8aa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdf8c15d3c0 0x7fdf8c0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c0c7f10 0x7fdf8c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8b400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fdf8c0b5140 0x7fdf8c153a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47864/0 (socket says 172.21.15.102:47864) 2024-03-25T06:04:06.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.263+0000 7fdf8b400640 1 -- 172.21.15.102:0/3838144276 learned_addr learned my addr 172.21.15.102:0/3838144276 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:06.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.264+0000 7fdf8a000640 1 -- 172.21.15.102:0/3838144276 >> v2:172.21.15.102:3300/0 conn(0x7fdf8c15d3c0 msgr2=0x7fdf8c0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:06.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.264+0000 7fdf8a000640 1 --2- 172.21.15.102:0/3838144276 >> v2:172.21.15.102:3300/0 conn(0x7fdf8c15d3c0 0x7fdf8c0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.264+0000 7fdf8a000640 1 -- 172.21.15.102:0/3838144276 >> v1:172.21.15.187:6789/0 conn(0x7fdf8c0b5140 legacy=0x7fdf8c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.264+0000 7fdf8a000640 1 -- 172.21.15.102:0/3838144276 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0cb820 con 0x7fdf8c0c7f10 2024-03-25T06:04:06.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.264+0000 7fdf89600640 1 -- 172.21.15.102:0/3838144276 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423639991 0 0) 0x7fdf8c0ca200 con 0x7fdf8c0b5140 2024-03-25T06:04:06.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.265+0000 7fdf8a000640 1 --2- 172.21.15.102:0/3838144276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c0c7f10 0x7fdf8c15d7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf780097a0 tx=0x7fdf7802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fbb8db6a5f9067 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:06.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.265+0000 7fdf89600640 1 -- 172.21.15.102:0/3838144276 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7802d040 con 0x7fdf8c0c7f10 2024-03-25T06:04:06.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf89600640 1 -- 172.21.15.102:0/3838144276 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78031810 con 0x7fdf8c0c7f10 2024-03-25T06:04:06.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf89600640 1 -- 172.21.15.102:0/3838144276 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78031ba0 con 0x7fdf8c0c7f10 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 -- 172.21.15.102:0/3838144276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c0c7f10 msgr2=0x7fdf8c15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 --2- 172.21.15.102:0/3838144276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c0c7f10 0x7fdf8c15d7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf780097a0 tx=0x7fdf7802b8b0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 -- 172.21.15.102:0/3838144276 shutdown_connections 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 --2- 172.21.15.102:0/3838144276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c0c7f10 0x7fdf8c15d7a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 --2- 172.21.15.102:0/3838144276 >> v2:172.21.15.102:3300/0 conn(0x7fdf8c15d3c0 0x7fdf8c0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 -- 172.21.15.102:0/3838144276 >> 172.21.15.102:0/3838144276 conn(0x7fdf8c0cf3e0 msgr2=0x7fdf8c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 -- 172.21.15.102:0/3838144276 shutdown_connections 2024-03-25T06:04:06.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.266+0000 7fdf8be00640 1 -- 172.21.15.102:0/3838144276 wait complete. 2024-03-25T06:04:06.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.268+0000 7fdf8be00640 1 Processor -- start 2024-03-25T06:04:06.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.268+0000 7fdf8be00640 1 -- start start 2024-03-25T06:04:06.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf8c0b5140 0x7fdf8c1f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf8c0c7f10 0x7fdf8c1efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c15d3c0 0x7fdf8c15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8be00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c151b30 con 0x7fdf8c0c7f10 2024-03-25T06:04:06.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8be00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1f3500 con 0x7fdf8c0b5140 2024-03-25T06:04:06.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1f0000 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c15d3c0 0x7fdf8c15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf8c0b5140 0x7fdf8c1f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c15d3c0 0x7fdf8c15c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38768/0 (socket says 172.21.15.102:38768) 2024-03-25T06:04:06.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8b400640 1 -- 172.21.15.102:0/2739289885 learned_addr learned my addr 172.21.15.102:0/2739289885 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:06.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.269+0000 7fdf8a000640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf8c0c7f10 0x7fdf8c1efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf8b400640 1 -- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf8c0b5140 msgr2=0x7fdf8c1f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf8b400640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf8c0b5140 0x7fdf8c1f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf8b400640 1 -- 172.21.15.102:0/2739289885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf8c0c7f10 msgr2=0x7fdf8c1efac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf8b400640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf8c0c7f10 0x7fdf8c1efac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf8b400640 1 -- 172.21.15.102:0/2739289885 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78009400 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf8b400640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c15d3c0 0x7fdf8c15c8e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf84001560 tx=0x7fdf8400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400a640 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400a7a0 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400ab30 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.270+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c1ef630 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.271+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c151d60 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.271+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf8c0ca730 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.273+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf8400ac90 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.274+0000 7fdf82a00640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdf6c06b840 0x7fdf6c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.274+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fdf84089ef0 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.274+0000 7fdf8aa00640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdf6c06b840 0x7fdf6c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.274+0000 7fdf82a00640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fdf6c075360 0x7fdf6c077800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.275+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 --> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf6c077ed0 con 0x7fdf6c075360 2024-03-25T06:04:06.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.275+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf8408c4d0 con 0x7fdf8c15d3c0 2024-03-25T06:04:06.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.275+0000 7fdf8a000640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fdf6c075360 0x7fdf6c077800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.275+0000 7fdf8aa00640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdf6c06b840 0x7fdf6c06dd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009aa0 tx=0x7fdf7c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:06.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.275+0000 7fdf8a000640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fdf6c075360 0x7fdf6c077800 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:06.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.276+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== osd.4 v2:172.21.15.187:6816/2431545666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdf6c077ed0 con 0x7fdf6c075360 2024-03-25T06:04:06.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.290+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 --> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf8c0ca450 con 0x7fdf6c075360 2024-03-25T06:04:06.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.290+0000 7fdf82a00640 1 -- 172.21.15.102:0/2739289885 <== osd.4 v2:172.21.15.187:6816/2431545666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdf78031ad0 con 0x7fdf6c075360 2024-03-25T06:04:06.283 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:06.283 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:06.283 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:06.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.290+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fdf6c075360 msgr2=0x7fdf6c077800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.290+0000 7fdf8be00640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6816/2431545666,v1:172.21.15.187:6817/2431545666] conn(0x7fdf6c075360 0x7fdf6c077800 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdf6c06b840 msgr2=0x7fdf6c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdf6c06b840 0x7fdf6c06dd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009aa0 tx=0x7fdf7c009190 comp rx=0 tx=0).stop 2024-03-25T06:04:06.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c15d3c0 msgr2=0x7fdf8c15c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 --2- 172.21.15.102:0/2739289885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf8c15d3c0 0x7fdf8c15c8e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf84001560 tx=0x7fdf8400cc70 comp rx=0 tx=0).stop 2024-03-25T06:04:06.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8b400640 1 -- 172.21.15.102:0/2739289885 reap_dead start 2024-03-25T06:04:06.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 shutdown_connections 2024-03-25T06:04:06.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 >> 172.21.15.102:0/2739289885 conn(0x7fdf8c0cf3e0 msgr2=0x7fdf8c14d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:06.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 shutdown_connections 2024-03-25T06:04:06.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.291+0000 7fdf8be00640 1 -- 172.21.15.102:0/2739289885 wait complete. 2024-03-25T06:04:06.300 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-25T06:04:06.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.544+0000 7f55abe00640 1 Processor -- start 2024-03-25T06:04:06.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.544+0000 7f55abe00640 1 -- start start 2024-03-25T06:04:06.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.545+0000 7f55abe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac154120 0x7f55ac0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.545+0000 7f55abe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f55ac0c6c10 0x7f55ac0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.545+0000 7f55abe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac0cbbe0 con 0x7f55ac0c67e0 2024-03-25T06:04:06.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.545+0000 7f55abe00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac154500 con 0x7f55ac0c6c10 2024-03-25T06:04:06.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.545+0000 7f55abe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac06b250 con 0x7f55ac154120 2024-03-25T06:04:06.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.545+0000 7f55aa000640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f55ac0c67e0 0x7f55ac0c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47866/0 (socket says 172.21.15.102:47866) 2024-03-25T06:04:06.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.545+0000 7f55aa000640 1 -- 172.21.15.102:0/3295702537 learned_addr learned my addr 172.21.15.102:0/3295702537 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:06.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55ab400640 1 --2- 172.21.15.102:0/3295702537 >> v2:172.21.15.102:3300/0 conn(0x7f55ac0c6c10 0x7f55ac0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55aaa00640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac154120 0x7f55ac0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259776886 0 0) 0x7f55ac0cbbe0 con 0x7f55ac0c67e0 2024-03-25T06:04:06.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5590003520 con 0x7f55ac0c67e0 2024-03-25T06:04:06.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4244839560 0 0) 0x7f5590003520 con 0x7f55ac0c67e0 2024-03-25T06:04:06.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac154120 msgr2=0x7f55ac0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:06.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac154120 0x7f55ac0cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 >> v2:172.21.15.102:3300/0 conn(0x7f55ac0c6c10 msgr2=0x7f55ac0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 --2- 172.21.15.102:0/3295702537 >> v2:172.21.15.102:3300/0 conn(0x7f55ac0c6c10 0x7f55ac0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0ca280 con 0x7f55ac0c67e0 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3632885584 0 0) 0x7f5598001670 con 0x7f55ac0c67e0 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 >> v1:172.21.15.187:6789/0 conn(0x7f55ac0c67e0 legacy=0x7f55ac0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac154120 0x7f5590003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5590003ef0 0x7f55900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f5590005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559000b980 con 0x7f5590003ef0 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559000bac0 con 0x7f5590004d00 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.546+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559000bc00 con 0x7f55ac154120 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.547+0000 7f55ab400640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f5590005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.547+0000 7f55aa000640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5590003ef0 0x7f55900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.547+0000 7f55ab400640 1 -- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac154120 msgr2=0x7f5590003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.547+0000 7f55ab400640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac154120 0x7f5590003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.547+0000 7f55ab400640 1 -- 172.21.15.102:0/3295702537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5590003ef0 msgr2=0x7f55900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.547+0000 7f55ab400640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5590003ef0 0x7f55900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.547+0000 7f55ab400640 1 -- 172.21.15.102:0/3295702537 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0ca280 con 0x7f5590004d00 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.549+0000 7f55ab400640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f5590005180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009fc0 tx=0x7f55900057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4bf46d7808e7d91 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.549+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a402cc40 con 0x7f5590004d00 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.549+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a400f040 con 0x7f5590004d00 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.549+0000 7f55a9600640 1 -- 172.21.15.102:0/3295702537 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4034440 con 0x7f5590004d00 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.550+0000 7f55abe00640 1 -- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 msgr2=0x7f5590005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.550+0000 7f55abe00640 1 --2- 172.21.15.102:0/3295702537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f5590005180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009fc0 tx=0x7f55900057f0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.550+0000 7f55ab400640 1 -- 172.21.15.102:0/3295702537 reap_dead start 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.550+0000 7f55abe00640 1 -- 172.21.15.102:0/3295702537 shutdown_connections 2024-03-25T06:04:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.550+0000 7f55abe00640 1 -- 172.21.15.102:0/3295702537 >> 172.21.15.102:0/3295702537 conn(0x7f55ac0cf3e0 msgr2=0x7f55ac0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:06.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.550+0000 7f55abe00640 1 -- 172.21.15.102:0/3295702537 shutdown_connections 2024-03-25T06:04:06.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.550+0000 7f55abe00640 1 -- 172.21.15.102:0/3295702537 wait complete. 2024-03-25T06:04:06.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.553+0000 7f55abe00640 1 Processor -- start 2024-03-25T06:04:06.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.553+0000 7f55abe00640 1 -- start start 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.554+0000 7f55abe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f55ac1e2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.554+0000 7f55abe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac0c2f70 0x7f55ac158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.554+0000 7f55abe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac158da0 0x7f55ac156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.554+0000 7f55abe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0c5cc0 con 0x7f55ac0c2f70 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.554+0000 7f55abe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac1f3230 con 0x7f5590004d00 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.554+0000 7f55abe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac1f3760 con 0x7f55ac158da0 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f55ac1e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f55ac1e2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37992/0 (socket says 172.21.15.102:37992) 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55ab400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac158da0 0x7f55ac156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 -- 172.21.15.102:0/1611469384 learned_addr learned my addr 172.21.15.102:0/1611469384 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:06.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aa000640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac0c2f70 0x7f55ac158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 -- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac158da0 msgr2=0x7f55ac156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac158da0 0x7f55ac156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 -- 172.21.15.102:0/1611469384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac0c2f70 msgr2=0x7f55ac158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac0c2f70 0x7f55ac158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aaa00640 1 -- 172.21.15.102:0/1611469384 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac1f0210 con 0x7f5590004d00 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.555+0000 7f55aa000640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac0c2f70 0x7f55ac158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.556+0000 7f55aaa00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f55ac1e2980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f559c00e850 tx=0x7f559c00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.556+0000 7f55a2a00640 1 -- 172.21.15.102:0/1611469384 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00c940 con 0x7f5590004d00 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.556+0000 7f55a2a00640 1 -- 172.21.15.102:0/1611469384 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00cac0 con 0x7f5590004d00 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.556+0000 7f55a2a00640 1 -- 172.21.15.102:0/1611469384 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00ce70 con 0x7f5590004d00 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.556+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac15a190 con 0x7f5590004d00 2024-03-25T06:04:06.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.556+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac1ef450 con 0x7f5590004d00 2024-03-25T06:04:06.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.557+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac04f2f0 con 0x7f5590004d00 2024-03-25T06:04:06.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.559+0000 7f55a2a00640 1 -- 172.21.15.102:0/1611469384 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f559c013470 con 0x7f5590004d00 2024-03-25T06:04:06.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.560+0000 7f55a2a00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f558c06b810 0x7f558c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:06.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.560+0000 7f55a2a00640 1 -- 172.21.15.102:0/1611469384 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f559c08aa70 con 0x7f5590004d00 2024-03-25T06:04:06.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.560+0000 7f55aa000640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f558c06b810 0x7f558c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:06.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.561+0000 7f55aa000640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f558c06b810 0x7f558c06dcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55ac159ae0 tx=0x7f5598009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:06.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.564+0000 7f55a2a00640 1 -- 172.21.15.102:0/1611469384 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f559c054fd0 con 0x7f5590004d00 2024-03-25T06:04:06.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.758+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f55ac0c9a30 con 0x7f558c06b810 2024-03-25T06:04:06.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.758+0000 7f55a2a00640 1 -- 172.21.15.102:0/1611469384 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55ac0c9a30 con 0x7f558c06b810 2024-03-25T06:04:06.752 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 4 to deep-scrub 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f558c06b810 msgr2=0x7f558c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f558c06b810 0x7f558c06dcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55ac159ae0 tx=0x7f5598009040 comp rx=0 tx=0).stop 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 msgr2=0x7f55ac1e2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f55ac1e2980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f559c00e850 tx=0x7f559c00ed10 comp rx=0 tx=0).stop 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 shutdown_connections 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f558c06b810 0x7f558c06dcd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55ac158da0 0x7f55ac156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac0c2f70 0x7f55ac158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 --2- 172.21.15.102:0/1611469384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590004d00 0x7f55ac1e2980 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:06.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.761+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 >> 172.21.15.102:0/1611469384 conn(0x7f55ac0cf3e0 msgr2=0x7f55ac06b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:06.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.762+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 shutdown_connections 2024-03-25T06:04:06.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:06.762+0000 7f55abe00640 1 -- 172.21.15.102:0/1611469384 wait complete. 2024-03-25T06:04:06.777 INFO:tasks.ceph:Scrubbing osd.5 2024-03-25T06:04:06.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:07.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.034+0000 7ff7e2000640 1 Processor -- start 2024-03-25T06:04:07.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.034+0000 7ff7e2000640 1 -- start start 2024-03-25T06:04:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.035+0000 7ff7e2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.035+0000 7ff7e2000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff7dc0c7f10 0x7ff7dc15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.036+0000 7ff7e2000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc0ca200 con 0x7ff7dc0b5140 2024-03-25T06:04:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.036+0000 7ff7e2000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7dc0cb090 con 0x7ff7dc0c7f10 2024-03-25T06:04:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.036+0000 7ff7e2000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0cb4e0 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.036+0000 7ff7e0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.036+0000 7ff7e0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38788/0 (socket says 172.21.15.102:38788) 2024-03-25T06:04:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.036+0000 7ff7e0c00640 1 -- 172.21.15.102:0/1206331271 learned_addr learned my addr 172.21.15.102:0/1206331271 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.036+0000 7ff7dbe00640 1 --2- 172.21.15.102:0/1206331271 >> v2:172.21.15.102:3300/0 conn(0x7ff7dc0c7f10 0x7ff7dc15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.037+0000 7ff7db400640 1 -- 172.21.15.102:0/1206331271 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215285824 0 0) 0x7ff7dc0ca200 con 0x7ff7dc0b5140 2024-03-25T06:04:07.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.037+0000 7ff7db400640 1 -- 172.21.15.102:0/1206331271 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c4003520 con 0x7ff7dc0b5140 2024-03-25T06:04:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.038+0000 7ff7db400640 1 -- 172.21.15.102:0/1206331271 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884190828 0 0) 0x7ff7c4003520 con 0x7ff7dc0b5140 2024-03-25T06:04:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.038+0000 7ff7dbe00640 1 -- 172.21.15.102:0/1206331271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 msgr2=0x7ff7dc0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.038+0000 7ff7dbe00640 1 --2- 172.21.15.102:0/1206331271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.038+0000 7ff7dbe00640 1 -- 172.21.15.102:0/1206331271 >> v1:172.21.15.102:6789/0 conn(0x7ff7dc0b5140 legacy=0x7ff7dc153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.038+0000 7ff7dbe00640 1 -- 172.21.15.102:0/1206331271 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc0cb820 con 0x7ff7dc0c7f10 2024-03-25T06:04:07.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.039+0000 7ff7dbe00640 1 --2- 172.21.15.102:0/1206331271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc15d7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80097a0 tx=0x7ff7c802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a5800bf25e85eb server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.040+0000 7ff7db400640 1 -- 172.21.15.102:0/1206331271 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40019f0 con 0x7ff7dc0c7f10 2024-03-25T06:04:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.040+0000 7ff7db400640 1 -- 172.21.15.102:0/1206331271 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c802e050 con 0x7ff7dc0c7f10 2024-03-25T06:04:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.040+0000 7ff7db400640 1 -- 172.21.15.102:0/1206331271 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8030730 con 0x7ff7dc0c7f10 2024-03-25T06:04:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.041+0000 7ff7e2000640 1 -- 172.21.15.102:0/1206331271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 msgr2=0x7ff7dc15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.041+0000 7ff7e2000640 1 --2- 172.21.15.102:0/1206331271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc15d7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80097a0 tx=0x7ff7c802b790 comp rx=0 tx=0).stop 2024-03-25T06:04:07.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.041+0000 7ff7e2000640 1 -- 172.21.15.102:0/1206331271 shutdown_connections 2024-03-25T06:04:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.042+0000 7ff7e2000640 1 --2- 172.21.15.102:0/1206331271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc15d7a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.042+0000 7ff7e2000640 1 --2- 172.21.15.102:0/1206331271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.042+0000 7ff7e2000640 1 -- 172.21.15.102:0/1206331271 >> 172.21.15.102:0/1206331271 conn(0x7ff7dc0cf3e0 msgr2=0x7ff7dc0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.042+0000 7ff7e2000640 1 -- 172.21.15.102:0/1206331271 shutdown_connections 2024-03-25T06:04:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.042+0000 7ff7e2000640 1 -- 172.21.15.102:0/1206331271 wait complete. 2024-03-25T06:04:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.044+0000 7ff7e2000640 1 Processor -- start 2024-03-25T06:04:07.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.045+0000 7ff7e2000640 1 -- start start 2024-03-25T06:04:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.047+0000 7ff7e2000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7dc0b5140 0x7ff7dc1eff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.047+0000 7ff7e2000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.047+0000 7ff7e2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.048+0000 7ff7e0c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7dc0b5140 0x7ff7dc1eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.048+0000 7ff7e0c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7dc0b5140 0x7ff7dc1eff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:37996/0 (socket says 172.21.15.102:37996) 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.048+0000 7ff7dbe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.048+0000 7ff7dbe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44318/0 (socket says 172.21.15.102:44318) 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.048+0000 7ff7e1600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.048+0000 7ff7e1600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38802/0 (socket says 172.21.15.102:38802) 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.048+0000 7ff7e2000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc1efa70 con 0x7ff7dc0c7f10 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.049+0000 7ff7e2000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc1f3a60 con 0x7ff7dc0b5140 2024-03-25T06:04:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.049+0000 7ff7e2000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0c30d0 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.049+0000 7ff7e0c00640 1 -- 172.21.15.102:0/352760727 learned_addr learned my addr 172.21.15.102:0/352760727 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.050+0000 7ff7e1600640 1 -- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7dc0b5140 msgr2=0x7ff7dc1eff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.050+0000 7ff7e1600640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7dc0b5140 0x7ff7dc1eff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.050+0000 7ff7e1600640 1 -- 172.21.15.102:0/352760727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 msgr2=0x7ff7dc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.050+0000 7ff7e1600640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.050+0000 7ff7e1600640 1 -- 172.21.15.102:0/352760727 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8009400 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.050+0000 7ff7dbe00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7dc0c7f10 0x7ff7dc0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.051+0000 7ff7e0c00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7dc0b5140 0x7ff7dc1eff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T06:04:07.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.052+0000 7ff7e1600640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c3f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40012e0 tx=0x7ff7d400cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:07.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.052+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d400aa20 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.053+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d400abe0 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.053+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc0c3650 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.053+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc1ef700 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.053+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4012420 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.056+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7b8001030 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.057+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff7d4012580 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.059+0000 7ff7d8c00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff7bc06b860 0x7ff7bc06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.059+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7ff7d408a770 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.059+0000 7ff7d8c00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7ff7bc0753f0 0x7ff7bc077890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.059+0000 7ff7e0c00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff7bc06b860 0x7ff7bc06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.059+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 --> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7bc077f60 con 0x7ff7bc0753f0 2024-03-25T06:04:07.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.059+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7d408ce00 con 0x7ff7dc15d3c0 2024-03-25T06:04:07.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.059+0000 7ff7dbe00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7ff7bc0753f0 0x7ff7bc077890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.060+0000 7ff7e0c00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff7bc06b860 0x7ff7bc06dd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0006f40 tx=0x7ff7d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:07.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.060+0000 7ff7dbe00640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7ff7bc0753f0 0x7ff7bc077890 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:07.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.061+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== osd.5 v2:172.21.15.187:6820/2672437380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff7bc077f60 con 0x7ff7bc0753f0 2024-03-25T06:04:07.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.088+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 --> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff7b8002d90 con 0x7ff7bc0753f0 2024-03-25T06:04:07.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7d8c00640 1 -- 172.21.15.102:0/352760727 <== osd.5 v2:172.21.15.187:6820/2672437380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff7b8002d90 con 0x7ff7bc0753f0 2024-03-25T06:04:07.082 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:07.082 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:07.082 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7ff7bc0753f0 msgr2=0x7ff7bc077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7e2000640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6820/2672437380,v1:172.21.15.187:6822/2672437380] conn(0x7ff7bc0753f0 0x7ff7bc077890 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff7bc06b860 msgr2=0x7ff7bc06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7e2000640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7ff7bc06b860 0x7ff7bc06dd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0006f40 tx=0x7ff7d0008040 comp rx=0 tx=0).stop 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 msgr2=0x7ff7dc0c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7e2000640 1 --2- 172.21.15.102:0/352760727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7dc15d3c0 0x7ff7dc0c3f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40012e0 tx=0x7ff7d400cd20 comp rx=0 tx=0).stop 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.089+0000 7ff7e1600640 1 -- 172.21.15.102:0/352760727 reap_dead start 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.090+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 shutdown_connections 2024-03-25T06:04:07.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.090+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 >> 172.21.15.102:0/352760727 conn(0x7ff7dc0cf3e0 msgr2=0x7ff7dc150220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:07.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.090+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 shutdown_connections 2024-03-25T06:04:07.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.090+0000 7ff7e2000640 1 -- 172.21.15.102:0/352760727 wait complete. 2024-03-25T06:04:07.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-25T06:04:07.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.339+0000 7fd0aea00640 1 Processor -- start 2024-03-25T06:04:07.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.339+0000 7fd0aea00640 1 -- start start 2024-03-25T06:04:07.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0aea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a816aad0 0x7fd0a81668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0aea00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd0a806f470 0x7fd0a8071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0aea00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80c5320 con 0x7fd0a8164000 2024-03-25T06:04:07.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0aea00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80c5600 con 0x7fd0a806f470 2024-03-25T06:04:07.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0aea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8169ff0 con 0x7fd0a816aad0 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a816aad0 0x7fd0a81668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a816aad0 0x7fd0a81668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38804/0 (socket says 172.21.15.102:38804) 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.341+0000 7fd0acc00640 1 -- 172.21.15.102:0/490890044 learned_addr learned my addr 172.21.15.102:0/490890044 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.512+0000 7fd0acc00640 1 -- 172.21.15.102:0/490890044 >> v2:172.21.15.187:3300/0 conn(0x7fd0a806f470 msgr2=0x7fd0a8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.342+0000 7fd0ae000640 1 --2- 172.21.15.102:0/490890044 >> v2:172.21.15.187:3300/0 conn(0x7fd0a806f470 0x7fd0a8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.513+0000 7fd0acc00640 1 --2- 172.21.15.102:0/490890044 >> v2:172.21.15.187:3300/0 conn(0x7fd0a806f470 0x7fd0a8071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.513+0000 7fd0acc00640 1 -- 172.21.15.102:0/490890044 >> v1:172.21.15.102:6789/0 conn(0x7fd0a8164000 legacy=0x7fd0a8072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.513+0000 7fd0acc00640 1 -- 172.21.15.102:0/490890044 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a816a2d0 con 0x7fd0a816aad0 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.343+0000 7fd0a7e00640 1 -- 172.21.15.102:0/490890044 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170330251 0 0) 0x7fd0a80c5320 con 0x7fd0a8164000 2024-03-25T06:04:07.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.514+0000 7fd0ae000640 1 --2- 172.21.15.102:0/490890044 >> v2:172.21.15.187:3300/0 conn(0x7fd0a806f470 0x7fd0a8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T06:04:07.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.514+0000 7fd0acc00640 1 --2- 172.21.15.102:0/490890044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a816aad0 0x7fd0a81668e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd094007860 tx=0x7fd09402cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa60e169f3639c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:07.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.515+0000 7fd0a7e00640 1 -- 172.21.15.102:0/490890044 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09402da40 con 0x7fd0a816aad0 2024-03-25T06:04:07.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.515+0000 7fd0a7e00640 1 -- 172.21.15.102:0/490890044 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09402dba0 con 0x7fd0a816aad0 2024-03-25T06:04:07.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.515+0000 7fd0a7e00640 1 -- 172.21.15.102:0/490890044 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09402da40 con 0x7fd0a816aad0 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 -- 172.21.15.102:0/490890044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a816aad0 msgr2=0x7fd0a81668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 --2- 172.21.15.102:0/490890044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a816aad0 0x7fd0a81668e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd094007860 tx=0x7fd09402cc90 comp rx=0 tx=0).stop 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 -- 172.21.15.102:0/490890044 shutdown_connections 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 --2- 172.21.15.102:0/490890044 >> v2:172.21.15.187:3300/0 conn(0x7fd0a806f470 0x7fd0a8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 --2- 172.21.15.102:0/490890044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a816aad0 0x7fd0a81668e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 -- 172.21.15.102:0/490890044 >> 172.21.15.102:0/490890044 conn(0x7fd0a80cb340 msgr2=0x7fd0a80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 -- 172.21.15.102:0/490890044 shutdown_connections 2024-03-25T06:04:07.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.516+0000 7fd0aea00640 1 -- 172.21.15.102:0/490890044 wait complete. 2024-03-25T06:04:07.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.519+0000 7fd0aea00640 1 Processor -- start 2024-03-25T06:04:07.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.519+0000 7fd0aea00640 1 -- start start 2024-03-25T06:04:07.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.521+0000 7fd0aea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0a806f470 0x7fd0a806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.521+0000 7fd0aea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a8164000 0x7fd0a82046a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.521+0000 7fd0aea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0a816aad0 0x7fd0a8204be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.521+0000 7fd0aea00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81646b0 con 0x7fd0a816aad0 2024-03-25T06:04:07.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.521+0000 7fd0aea00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815b100 con 0x7fd0a806f470 2024-03-25T06:04:07.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.521+0000 7fd0aea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8165100 con 0x7fd0a8164000 2024-03-25T06:04:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.522+0000 7fd0ad600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0a806f470 0x7fd0a806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.522+0000 7fd0ad600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0a806f470 0x7fd0a806e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:38020/0 (socket says 172.21.15.102:38020) 2024-03-25T06:04:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.522+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a8164000 0x7fd0a82046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.522+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a8164000 0x7fd0a82046a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38818/0 (socket says 172.21.15.102:38818) 2024-03-25T06:04:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.522+0000 7fd0acc00640 1 -- 172.21.15.102:0/125640979 learned_addr learned my addr 172.21.15.102:0/125640979 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.523+0000 7fd0acc00640 1 -- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0a806f470 msgr2=0x7fd0a806e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.523+0000 7fd0acc00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0a806f470 0x7fd0a806e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.523+0000 7fd0acc00640 1 -- 172.21.15.102:0/125640979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0a816aad0 msgr2=0x7fd0a8204be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-25T06:04:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.523+0000 7fd0ae000640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0a816aad0 0x7fd0a8204be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.523+0000 7fd0acc00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0a816aad0 0x7fd0a8204be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.523+0000 7fd0acc00640 1 -- 172.21.15.102:0/125640979 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094007540 con 0x7fd0a8164000 2024-03-25T06:04:07.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.524+0000 7fd0acc00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a8164000 0x7fd0a82046a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd09402ccd0 tx=0x7fd0940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:07.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.524+0000 7fd0a5600640 1 -- 172.21.15.102:0/125640979 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0940073c0 con 0x7fd0a8164000 2024-03-25T06:04:07.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.525+0000 7fd0a5600640 1 -- 172.21.15.102:0/125640979 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd094003bd0 con 0x7fd0a8164000 2024-03-25T06:04:07.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.525+0000 7fd0a5600640 1 -- 172.21.15.102:0/125640979 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094003de0 con 0x7fd0a8164000 2024-03-25T06:04:07.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.525+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a815b3a0 con 0x7fd0a8164000 2024-03-25T06:04:07.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.526+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a815b940 con 0x7fd0a8164000 2024-03-25T06:04:07.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.534+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a8164e20 con 0x7fd0a8164000 2024-03-25T06:04:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.536+0000 7fd0a5600640 1 -- 172.21.15.102:0/125640979 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd09403f450 con 0x7fd0a8164000 2024-03-25T06:04:07.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.538+0000 7fd0a5600640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd08806b810 0x7fd08806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.538+0000 7fd0a5600640 1 -- 172.21.15.102:0/125640979 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fd0940acff0 con 0x7fd0a8164000 2024-03-25T06:04:07.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.539+0000 7fd0ad600640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd08806b810 0x7fd08806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.540+0000 7fd0ad600640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd08806b810 0x7fd08806dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd09c000f60 tx=0x7fd09c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:07.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.542+0000 7fd0a5600640 1 -- 172.21.15.102:0/125640979 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd0940e0e10 con 0x7fd0a8164000 2024-03-25T06:04:07.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.785+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0a8069d00 con 0x7fd08806b810 2024-03-25T06:04:07.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.786+0000 7fd0a5600640 1 -- 172.21.15.102:0/125640979 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd0a8069d00 con 0x7fd08806b810 2024-03-25T06:04:07.779 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 5 to deep-scrub 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd08806b810 msgr2=0x7fd08806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd08806b810 0x7fd08806dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd09c000f60 tx=0x7fd09c009040 comp rx=0 tx=0).stop 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a8164000 msgr2=0x7fd0a82046a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a8164000 0x7fd0a82046a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd09402ccd0 tx=0x7fd0940046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 shutdown_connections 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd08806b810 0x7fd08806dcd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0a816aad0 0x7fd0a8204be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0a8164000 0x7fd0a82046a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 --2- 172.21.15.102:0/125640979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0a806f470 0x7fd0a806e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 >> 172.21.15.102:0/125640979 conn(0x7fd0a80cb340 msgr2=0x7fd0a80c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:07.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 shutdown_connections 2024-03-25T06:04:07.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:07.788+0000 7fd0aea00640 1 -- 172.21.15.102:0/125640979 wait complete. 2024-03-25T06:04:07.804 INFO:tasks.ceph:Scrubbing osd.6 2024-03-25T06:04:07.804 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:07.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.001+0000 7fb848c00640 1 Processor -- start 2024-03-25T06:04:07.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.001+0000 7fb848c00640 1 -- start start 2024-03-25T06:04:07.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb848c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb8440c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb848c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb8440b5140 0x7fb844153a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:07.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb848c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440ca200 con 0x7fb8440c7f10 2024-03-25T06:04:07.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb848c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8440cb090 con 0x7fb8440b5140 2024-03-25T06:04:07.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb848c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440cb4e0 con 0x7fb84415d3c0 2024-03-25T06:04:07.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb843400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb8440c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb843400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb8440c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38822/0 (socket says 172.21.15.102:38822) 2024-03-25T06:04:07.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.003+0000 7fb843400640 1 -- 172.21.15.102:0/558653964 learned_addr learned my addr 172.21.15.102:0/558653964 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:07.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.004+0000 7fb843e00640 1 --2- 172.21.15.102:0/558653964 >> v2:172.21.15.102:3300/0 conn(0x7fb8440b5140 0x7fb844153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:07.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.004+0000 7fb843e00640 1 -- 172.21.15.102:0/558653964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 msgr2=0x7fb8440c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:07.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.004+0000 7fb843e00640 1 --2- 172.21.15.102:0/558653964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb8440c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:07.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.004+0000 7fb843e00640 1 -- 172.21.15.102:0/558653964 >> v1:172.21.15.102:6789/0 conn(0x7fb8440c7f10 legacy=0x7fb84415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:07.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.005+0000 7fb843e00640 1 -- 172.21.15.102:0/558653964 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440cb820 con 0x7fb8440b5140 2024-03-25T06:04:07.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.006+0000 7fb843e00640 1 --2- 172.21.15.102:0/558653964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 0x7fb844153a80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009d90 tx=0x7fb83c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc77e41bd46b3a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb842000640 1 -- 172.21.15.102:0/558653964 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c02cc60 con 0x7fb8440b5140 2024-03-25T06:04:08.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb842000640 1 -- 172.21.15.102:0/558653964 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c02cdc0 con 0x7fb8440b5140 2024-03-25T06:04:08.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb842000640 1 -- 172.21.15.102:0/558653964 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c034660 con 0x7fb8440b5140 2024-03-25T06:04:08.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb848c00640 1 -- 172.21.15.102:0/558653964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 msgr2=0x7fb844153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb848c00640 1 --2- 172.21.15.102:0/558653964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 0x7fb844153a80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009d90 tx=0x7fb83c02beb0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb848c00640 1 -- 172.21.15.102:0/558653964 shutdown_connections 2024-03-25T06:04:08.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb848c00640 1 --2- 172.21.15.102:0/558653964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 0x7fb844153a80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb848c00640 1 --2- 172.21.15.102:0/558653964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb8440c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.007+0000 7fb848c00640 1 -- 172.21.15.102:0/558653964 >> 172.21.15.102:0/558653964 conn(0x7fb8440cf3e0 msgr2=0x7fb8440cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:08.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.008+0000 7fb848c00640 1 -- 172.21.15.102:0/558653964 shutdown_connections 2024-03-25T06:04:08.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.008+0000 7fb848c00640 1 -- 172.21.15.102:0/558653964 wait complete. 2024-03-25T06:04:08.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.009+0000 7fb848c00640 1 Processor -- start 2024-03-25T06:04:08.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.009+0000 7fb848c00640 1 -- start start 2024-03-25T06:04:08.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.010+0000 7fb848c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 0x7fb8441f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.010+0000 7fb848c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8440c7f10 0x7fb84415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.010+0000 7fb848c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb84415c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.010+0000 7fb848c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415b930 con 0x7fb8440b5140 2024-03-25T06:04:08.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.010+0000 7fb848c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415ad40 con 0x7fb8440c7f10 2024-03-25T06:04:08.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.010+0000 7fb848c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8441f3390 con 0x7fb84415d3c0 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb843400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 0x7fb8441f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8440c7f10 0x7fb84415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8440c7f10 0x7fb84415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:38034/0 (socket says 172.21.15.102:38034) 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb843e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb84415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 -- 172.21.15.102:0/3300403633 learned_addr learned my addr 172.21.15.102:0/3300403633 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb843400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 0x7fb8441f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44352/0 (socket says 172.21.15.102:44352) 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 -- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 msgr2=0x7fb84415c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb84415d3c0 0x7fb84415c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 -- 172.21.15.102:0/3300403633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 msgr2=0x7fb8441f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440b5140 0x7fb8441f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 -- 172.21.15.102:0/3300403633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009a70 con 0x7fb8440c7f10 2024-03-25T06:04:08.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.011+0000 7fb842a00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8440c7f10 0x7fb84415bd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c430 tx=0x7fb83000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.012+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300052d0 con 0x7fb8440c7f10 2024-03-25T06:04:08.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.012+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830005430 con 0x7fb8440c7f10 2024-03-25T06:04:08.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.012+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84415af90 con 0x7fb8440c7f10 2024-03-25T06:04:08.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.012+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830003830 con 0x7fb8440c7f10 2024-03-25T06:04:08.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.012+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84415b550 con 0x7fb8440c7f10 2024-03-25T06:04:08.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.013+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8440ca730 con 0x7fb8440c7f10 2024-03-25T06:04:08.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.015+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb830003990 con 0x7fb8440c7f10 2024-03-25T06:04:08.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.016+0000 7fb83b400640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb82406b810 0x7fb82406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.016+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb830089b50 con 0x7fb8440c7f10 2024-03-25T06:04:08.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.016+0000 7fb843400640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb82406b810 0x7fb82406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.017+0000 7fb83b400640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fb824075330 0x7fb8240777d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.017+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 --> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb824077ea0 con 0x7fb824075330 2024-03-25T06:04:08.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.017+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb83008e2a0 con 0x7fb8440c7f10 2024-03-25T06:04:08.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.017+0000 7fb843e00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fb824075330 0x7fb8240777d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.017+0000 7fb843400640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb82406b810 0x7fb82406dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb834009b30 tx=0x7fb834009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.018+0000 7fb843e00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fb824075330 0x7fb8240777d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.019+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== osd.6 v2:172.21.15.187:6808/1811146406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb824077ea0 con 0x7fb824075330 2024-03-25T06:04:08.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.046+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 --> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8440ca450 con 0x7fb824075330 2024-03-25T06:04:08.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.046+0000 7fb83b400640 1 -- 172.21.15.102:0/3300403633 <== osd.6 v2:172.21.15.187:6808/1811146406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb83c02cb80 con 0x7fb824075330 2024-03-25T06:04:08.040 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:08.040 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:08.040 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fb824075330 msgr2=0x7fb8240777d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6808/1811146406,v1:172.21.15.187:6809/1811146406] conn(0x7fb824075330 0x7fb8240777d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb82406b810 msgr2=0x7fb82406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb82406b810 0x7fb82406dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb834009b30 tx=0x7fb834009240 comp rx=0 tx=0).stop 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8440c7f10 msgr2=0x7fb84415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 --2- 172.21.15.102:0/3300403633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8440c7f10 0x7fb84415bd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c430 tx=0x7fb83000c8f0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb843e00640 1 -- 172.21.15.102:0/3300403633 reap_dead start 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 shutdown_connections 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 >> 172.21.15.102:0/3300403633 conn(0x7fb8440cf3e0 msgr2=0x7fb84406b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 shutdown_connections 2024-03-25T06:04:08.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.047+0000 7fb848c00640 1 -- 172.21.15.102:0/3300403633 wait complete. 2024-03-25T06:04:08.060 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-25T06:04:08.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.268+0000 7f1f51600640 1 Processor -- start 2024-03-25T06:04:08.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.268+0000 7f1f51600640 1 -- start start 2024-03-25T06:04:08.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.270+0000 7f1f51600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1f4c0c5940 0x7f1f4c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.270+0000 7f1f51600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.270+0000 7f1f51600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1f4c0cfcc0 0x7f1f4c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.270+0000 7f1f51600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0caa10 con 0x7f1f4c0cfcc0 2024-03-25T06:04:08.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.270+0000 7f1f51600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c15a060 con 0x7f1f4c0c5940 2024-03-25T06:04:08.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.270+0000 7f1f51600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c15a340 con 0x7f1f4c0c6240 2024-03-25T06:04:08.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.271+0000 7f1f4b400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1f4c0cfcc0 0x7f1f4c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.271+0000 7f1f4b400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1f4c0cfcc0 0x7f1f4c0c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44356/0 (socket says 172.21.15.102:44356) 2024-03-25T06:04:08.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.271+0000 7f1f4b400640 1 -- 172.21.15.102:0/1150079858 learned_addr learned my addr 172.21.15.102:0/1150079858 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:08.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.271+0000 7f1f4aa00640 1 --2- 172.21.15.102:0/1150079858 >> v2:172.21.15.187:3300/0 conn(0x7f1f4c0c5940 0x7f1f4c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.271+0000 7f1f4b400640 1 -- 172.21.15.102:0/1150079858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 msgr2=0x7f1f4c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:08.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.271+0000 7f1f4a000640 1 --2- 172.21.15.102:0/1150079858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.272+0000 7f1f4b400640 1 --2- 172.21.15.102:0/1150079858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c0cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.272+0000 7f1f4b400640 1 -- 172.21.15.102:0/1150079858 >> v2:172.21.15.187:3300/0 conn(0x7f1f4c0c5940 msgr2=0x7f1f4c0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:08.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.272+0000 7f1f4b400640 1 --2- 172.21.15.102:0/1150079858 >> v2:172.21.15.187:3300/0 conn(0x7f1f4c0c5940 0x7f1f4c0ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.273+0000 7f1f4b400640 1 -- 172.21.15.102:0/1150079858 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c15a620 con 0x7f1f4c0cfcc0 2024-03-25T06:04:08.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.273+0000 7f1f4a000640 1 --2- 172.21.15.102:0/1150079858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T06:04:08.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.273+0000 7f1f4aa00640 1 --2- 172.21.15.102:0/1150079858 >> v2:172.21.15.187:3300/0 conn(0x7f1f4c0c5940 0x7f1f4c0ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-25T06:04:08.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.276+0000 7f1f4b400640 1 --2- 172.21.15.102:0/1150079858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0cfcc0 0x7f1f4c0c7940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06cc70 tx=0x7f1f4402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be539af8cc7b0765 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.276+0000 7f1f49600640 1 -- 172.21.15.102:0/1150079858 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4402ca80 con 0x7f1f4c0cfcc0 2024-03-25T06:04:08.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.277+0000 7f1f49600640 1 -- 172.21.15.102:0/1150079858 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4402cbe0 con 0x7f1f4c0cfcc0 2024-03-25T06:04:08.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.277+0000 7f1f49600640 1 -- 172.21.15.102:0/1150079858 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440343f0 con 0x7f1f4c0cfcc0 2024-03-25T06:04:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.279+0000 7f1f51600640 1 -- 172.21.15.102:0/1150079858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0cfcc0 msgr2=0x7f1f4c0c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.279+0000 7f1f51600640 1 --2- 172.21.15.102:0/1150079858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0cfcc0 0x7f1f4c0c7940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06cc70 tx=0x7f1f4402bee0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.281+0000 7f1f51600640 1 -- 172.21.15.102:0/1150079858 shutdown_connections 2024-03-25T06:04:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.281+0000 7f1f51600640 1 --2- 172.21.15.102:0/1150079858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0cfcc0 0x7f1f4c0c7940 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.281+0000 7f1f51600640 1 --2- 172.21.15.102:0/1150079858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.281+0000 7f1f51600640 1 --2- 172.21.15.102:0/1150079858 >> v2:172.21.15.187:3300/0 conn(0x7f1f4c0c5940 0x7f1f4c0ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.281+0000 7f1f51600640 1 -- 172.21.15.102:0/1150079858 >> 172.21.15.102:0/1150079858 conn(0x7f1f4c0728c0 msgr2=0x7f1f4c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:08.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.283+0000 7f1f51600640 1 -- 172.21.15.102:0/1150079858 shutdown_connections 2024-03-25T06:04:08.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.283+0000 7f1f51600640 1 -- 172.21.15.102:0/1150079858 wait complete. 2024-03-25T06:04:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.286+0000 7f1f51600640 1 Processor -- start 2024-03-25T06:04:08.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.288+0000 7f1f51600640 1 -- start start 2024-03-25T06:04:08.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.290+0000 7f1f51600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0c5940 0x7f1f4c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.290+0000 7f1f51600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c1e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.290+0000 7f1f51600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f4c0cfcc0 0x7f1f4c1e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.290+0000 7f1f51600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1e4300 con 0x7f1f4c0c5940 2024-03-25T06:04:08.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.290+0000 7f1f51600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1e3810 con 0x7f1f4c0cfcc0 2024-03-25T06:04:08.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.290+0000 7f1f51600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1e6d20 con 0x7f1f4c0c6240 2024-03-25T06:04:08.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.291+0000 7f1f4a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c1e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.291+0000 7f1f4a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c1e5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38852/0 (socket says 172.21.15.102:38852) 2024-03-25T06:04:08.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.291+0000 7f1f4a000640 1 -- 172.21.15.102:0/2773042515 learned_addr learned my addr 172.21.15.102:0/2773042515 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:08.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.291+0000 7f1f4aa00640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0c5940 0x7f1f4c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.292+0000 7f1f4b400640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f4c0cfcc0 0x7f1f4c1e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.292+0000 7f1f4a000640 1 -- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f4c0cfcc0 msgr2=0x7f1f4c1e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.292+0000 7f1f4a000640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f4c0cfcc0 0x7f1f4c1e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.292+0000 7f1f4a000640 1 -- 172.21.15.102:0/2773042515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0c5940 msgr2=0x7f1f4c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.292+0000 7f1f4a000640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0c5940 0x7f1f4c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.292+0000 7f1f4a000640 1 -- 172.21.15.102:0/2773042515 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44009b30 con 0x7f1f4c0c6240 2024-03-25T06:04:08.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.293+0000 7f1f4a000640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c1e5f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800c7f0 tx=0x7f1f3800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.294+0000 7f1f42a00640 1 -- 172.21.15.102:0/2773042515 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38007a30 con 0x7f1f4c0c6240 2024-03-25T06:04:08.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.294+0000 7f1f42a00640 1 -- 172.21.15.102:0/2773042515 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38007b90 con 0x7f1f4c0c6240 2024-03-25T06:04:08.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.294+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c0c5ea0 con 0x7f1f4c0c6240 2024-03-25T06:04:08.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.294+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c1e3b10 con 0x7f1f4c0c6240 2024-03-25T06:04:08.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.295+0000 7f1f42a00640 1 -- 172.21.15.102:0/2773042515 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800ce40 con 0x7f1f4c0c6240 2024-03-25T06:04:08.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.299+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f24005290 con 0x7f1f4c0c6240 2024-03-25T06:04:08.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.301+0000 7f1f42a00640 1 -- 172.21.15.102:0/2773042515 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1f380113f0 con 0x7f1f4c0c6240 2024-03-25T06:04:08.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.306+0000 7f1f42a00640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1f2c06b8e0 0x7f1f2c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.307+0000 7f1f42a00640 1 -- 172.21.15.102:0/2773042515 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f1f3808a6e0 con 0x7f1f4c0c6240 2024-03-25T06:04:08.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.307+0000 7f1f4aa00640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1f2c06b8e0 0x7f1f2c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.307+0000 7f1f42a00640 1 -- 172.21.15.102:0/2773042515 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1f3808cc50 con 0x7f1f4c0c6240 2024-03-25T06:04:08.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.311+0000 7f1f4aa00640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1f2c06b8e0 0x7f1f2c06dda0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c006b10 tx=0x7f1f3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.675+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f24000bc0 con 0x7f1f2c06b8e0 2024-03-25T06:04:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.675+0000 7f1f42a00640 1 -- 172.21.15.102:0/2773042515 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1f24000bc0 con 0x7f1f2c06b8e0 2024-03-25T06:04:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 6 to deep-scrub 2024-03-25T06:04:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1f2c06b8e0 msgr2=0x7f1f2c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1f2c06b8e0 0x7f1f2c06dda0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c006b10 tx=0x7f1f3c008040 comp rx=0 tx=0).stop 2024-03-25T06:04:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 msgr2=0x7f1f4c1e5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c1e5f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800c7f0 tx=0x7f1f3800cbf0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 shutdown_connections 2024-03-25T06:04:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1f2c06b8e0 0x7f1f2c06dda0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f4c0cfcc0 0x7f1f4c1e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4c0c6240 0x7f1f4c1e5f50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 --2- 172.21.15.102:0/2773042515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f4c0c5940 0x7f1f4c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 >> 172.21.15.102:0/2773042515 conn(0x7f1f4c0728c0 msgr2=0x7f1f4c0b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 shutdown_connections 2024-03-25T06:04:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.679+0000 7f1f51600640 1 -- 172.21.15.102:0/2773042515 wait complete. 2024-03-25T06:04:08.696 INFO:tasks.ceph:Scrubbing osd.7 2024-03-25T06:04:08.696 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-25T06:04:08.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.877+0000 7f7b46000640 1 Processor -- start 2024-03-25T06:04:08.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.877+0000 7f7b46000640 1 -- start start 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.878+0000 7f7b46000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4015d3c0 0x7f7b400c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.878+0000 7f7b46000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b400c7f10 0x7f7b4015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b46000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b400ca200 con 0x7f7b400b5140 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b46000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400cb090 con 0x7f7b400c7f10 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b46000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400cb4e0 con 0x7f7b4015d3c0 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b44c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4015d3c0 0x7f7b400c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b3fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b400c7f10 0x7f7b4015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b45600640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f7b400b5140 0x7f7b40153a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:47872/0 (socket says 172.21.15.102:47872) 2024-03-25T06:04:08.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b45600640 1 -- 172.21.15.102:0/3409189805 learned_addr learned my addr 172.21.15.102:0/3409189805 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:08.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b44c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4015d3c0 0x7f7b400c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38864/0 (socket says 172.21.15.102:38864) 2024-03-25T06:04:08.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b3fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b400c7f10 0x7f7b4015d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:38064/0 (socket says 172.21.15.102:38064) 2024-03-25T06:04:08.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b3fe00640 1 -- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4015d3c0 msgr2=0x7f7b400c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:08.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b3fe00640 1 --2- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4015d3c0 0x7f7b400c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b3fe00640 1 -- 172.21.15.102:0/3409189805 >> v1:172.21.15.187:6789/0 conn(0x7f7b400b5140 legacy=0x7f7b40153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b3fe00640 1 -- 172.21.15.102:0/3409189805 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400cb820 con 0x7f7b400c7f10 2024-03-25T06:04:08.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b3f400640 1 -- 172.21.15.102:0/3409189805 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067173971 0 0) 0x7f7b400ca200 con 0x7f7b400b5140 2024-03-25T06:04:08.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.879+0000 7f7b44c00640 1 --2- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4015d3c0 0x7f7b400c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:08.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.880+0000 7f7b3fe00640 1 --2- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b400c7f10 0x7f7b4015d7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0097a0 tx=0x7f7b2c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbebfd3e14d2041d server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b3f400640 1 -- 172.21.15.102:0/3409189805 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c02d040 con 0x7f7b400c7f10 2024-03-25T06:04:08.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b3f400640 1 -- 172.21.15.102:0/3409189805 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c031810 con 0x7f7b400c7f10 2024-03-25T06:04:08.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b3f400640 1 -- 172.21.15.102:0/3409189805 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c031ba0 con 0x7f7b400c7f10 2024-03-25T06:04:08.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 -- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b400c7f10 msgr2=0x7f7b4015d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 --2- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b400c7f10 0x7f7b4015d7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0097a0 tx=0x7f7b2c02b8b0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 -- 172.21.15.102:0/3409189805 shutdown_connections 2024-03-25T06:04:08.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 --2- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b400c7f10 0x7f7b4015d7a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 --2- 172.21.15.102:0/3409189805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4015d3c0 0x7f7b400c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 -- 172.21.15.102:0/3409189805 >> 172.21.15.102:0/3409189805 conn(0x7f7b400cf3e0 msgr2=0x7f7b400cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:08.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 -- 172.21.15.102:0/3409189805 shutdown_connections 2024-03-25T06:04:08.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.881+0000 7f7b46000640 1 -- 172.21.15.102:0/3409189805 wait complete. 2024-03-25T06:04:08.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.884+0000 7f7b46000640 1 Processor -- start 2024-03-25T06:04:08.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.884+0000 7f7b46000640 1 -- start start 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.885+0000 7f7b46000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b400b5140 0x7f7b401f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.885+0000 7f7b46000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b400c7f10 0x7f7b4014b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.885+0000 7f7b46000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b4015d3c0 0x7f7b4014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.885+0000 7f7b46000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4014c130 con 0x7f7b400b5140 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.885+0000 7f7b46000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401ef760 con 0x7f7b4015d3c0 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.885+0000 7f7b46000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40158700 con 0x7f7b400c7f10 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b400c7f10 0x7f7b4014b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b400c7f10 0x7f7b4014b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38866/0 (socket says 172.21.15.102:38866) 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 -- 172.21.15.102:0/779842105 learned_addr learned my addr 172.21.15.102:0/779842105 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b44c00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b400b5140 0x7f7b401f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b45600640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b4015d3c0 0x7f7b4014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 -- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b4015d3c0 msgr2=0x7f7b4014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b4015d3c0 0x7f7b4014bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 -- 172.21.15.102:0/779842105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b400b5140 msgr2=0x7f7b401f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b400b5140 0x7f7b401f0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.886+0000 7f7b3fe00640 1 -- 172.21.15.102:0/779842105 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009400 con 0x7f7b400c7f10 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.887+0000 7f7b3fe00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b400c7f10 0x7f7b4014b6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c02bec0 tx=0x7f7b2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.887+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c03ad60 con 0x7f7b400c7f10 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.887+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c0423f0 con 0x7f7b400c7f10 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.887+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c0427a0 con 0x7f7b400c7f10 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.887+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c009400 con 0x7f7b400c7f10 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.887+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b40157e60 con 0x7f7b400c7f10 2024-03-25T06:04:08.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.888+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b400ca730 con 0x7f7b400c7f10 2024-03-25T06:04:08.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.890+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b2c04b3b0 con 0x7f7b400c7f10 2024-03-25T06:04:08.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.891+0000 7f7b3cc00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7b2006b810 0x7f7b2006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.891+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f7b2c0ac620 con 0x7f7b400c7f10 2024-03-25T06:04:08.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.892+0000 7f7b44c00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7b2006b810 0x7f7b2006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.892+0000 7f7b3cc00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f7b20075320 0x7f7b200777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:08.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.892+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 --> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b20077e90 con 0x7f7b20075320 2024-03-25T06:04:08.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.892+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b2c0aec80 con 0x7f7b400c7f10 2024-03-25T06:04:08.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.892+0000 7f7b45600640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f7b20075320 0x7f7b200777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:08.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.892+0000 7f7b44c00640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7b2006b810 0x7f7b2006dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009c30 tx=0x7f7b34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.893+0000 7f7b45600640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f7b20075320 0x7f7b200777c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:08.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.893+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== osd.7 v2:172.21.15.187:6800/69914825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7b20077e90 con 0x7f7b20075320 2024-03-25T06:04:08.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.915+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 --> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b400ca450 con 0x7f7b20075320 2024-03-25T06:04:08.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b3cc00640 1 -- 172.21.15.102:0/779842105 <== osd.7 v2:172.21.15.187:6800/69914825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7b38001bd0 con 0x7f7b20075320 2024-03-25T06:04:08.909 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-25T06:04:08.909 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-25T06:04:08.909 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f7b20075320 msgr2=0x7f7b200777c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6800/69914825,v1:172.21.15.187:6801/69914825] conn(0x7f7b20075320 0x7f7b200777c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7b2006b810 msgr2=0x7f7b2006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f7b2006b810 0x7f7b2006dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009c30 tx=0x7f7b34009190 comp rx=0 tx=0).stop 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b400c7f10 msgr2=0x7f7b4014b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 --2- 172.21.15.102:0/779842105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b400c7f10 0x7f7b4014b6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c02bec0 tx=0x7f7b2c0046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b45600640 1 -- 172.21.15.102:0/779842105 reap_dead start 2024-03-25T06:04:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 shutdown_connections 2024-03-25T06:04:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.916+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 >> 172.21.15.102:0/779842105 conn(0x7f7b400cf3e0 msgr2=0x7f7b400cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.917+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 shutdown_connections 2024-03-25T06:04:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:08.917+0000 7f7b46000640 1 -- 172.21.15.102:0/779842105 wait complete. 2024-03-25T06:04:08.924 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-25T06:04:09.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.119+0000 7f1cc7e00640 1 Processor -- start 2024-03-25T06:04:09.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.119+0000 7f1cc7e00640 1 -- start start 2024-03-25T06:04:09.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.120+0000 7f1cc7e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1cc8154120 0x7f1cc80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.120+0000 7f1cc7e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1cc80c6c10 0x7f1cc80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.120+0000 7f1cc7e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc80cbbe0 con 0x7f1cc80c67e0 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.120+0000 7f1cc7e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc8154500 con 0x7f1cc8154120 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.120+0000 7f1cc7e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc806b250 con 0x7f1cc80c6c10 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc6a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1cc8154120 0x7f1cc80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc6000640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1cc80c67e0 0x7f1cc80c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57606/0 (socket says 172.21.15.102:57606) 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc6000640 1 -- 172.21.15.102:0/438687752 learned_addr learned my addr 172.21.15.102:0/438687752 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:09.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc7400640 1 --2- 172.21.15.102:0/438687752 >> v2:172.21.15.187:3300/0 conn(0x7f1cc80c6c10 0x7f1cc80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc7400640 1 -- 172.21.15.102:0/438687752 >> v2:172.21.15.102:3300/0 conn(0x7f1cc8154120 msgr2=0x7f1cc80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:09.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc7400640 1 --2- 172.21.15.102:0/438687752 >> v2:172.21.15.102:3300/0 conn(0x7f1cc8154120 0x7f1cc80cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc7400640 1 -- 172.21.15.102:0/438687752 >> v1:172.21.15.102:6789/0 conn(0x7f1cc80c67e0 legacy=0x7f1cc80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.121+0000 7f1cc7400640 1 -- 172.21.15.102:0/438687752 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80ca280 con 0x7f1cc80c6c10 2024-03-25T06:04:09.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.123+0000 7f1cc7400640 1 --2- 172.21.15.102:0/438687752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc80cb540 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1cc815e2f0 tx=0x7f1cc002bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76b49fa2bde85020 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:09.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.123+0000 7f1cc5600640 1 -- 172.21.15.102:0/438687752 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc002ca30 con 0x7f1cc80c6c10 2024-03-25T06:04:09.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.123+0000 7f1cc5600640 1 -- 172.21.15.102:0/438687752 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc002cb90 con 0x7f1cc80c6c10 2024-03-25T06:04:09.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.123+0000 7f1cc5600640 1 -- 172.21.15.102:0/438687752 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0034440 con 0x7f1cc80c6c10 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.123+0000 7f1cc7e00640 1 -- 172.21.15.102:0/438687752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 msgr2=0x7f1cc80cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.123+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/438687752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc80cb540 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1cc815e2f0 tx=0x7f1cc002bd00 comp rx=0 tx=0).stop 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.124+0000 7f1cc7e00640 1 -- 172.21.15.102:0/438687752 shutdown_connections 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.124+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/438687752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc80cb540 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.124+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/438687752 >> v2:172.21.15.102:3300/0 conn(0x7f1cc8154120 0x7f1cc80cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.124+0000 7f1cc7e00640 1 -- 172.21.15.102:0/438687752 >> 172.21.15.102:0/438687752 conn(0x7f1cc80cf3e0 msgr2=0x7f1cc80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.124+0000 7f1cc7e00640 1 -- 172.21.15.102:0/438687752 shutdown_connections 2024-03-25T06:04:09.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.124+0000 7f1cc7e00640 1 -- 172.21.15.102:0/438687752 wait complete. 2024-03-25T06:04:09.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.125+0000 7f1cc7e00640 1 Processor -- start 2024-03-25T06:04:09.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.126+0000 7f1cc7e00640 1 -- start start 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cc80c67e0 0x7f1cc8159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc81f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc7e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc8154120 0x7f1cc81f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc7e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc81f2800 con 0x7f1cc8154120 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc7e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc81ef060 con 0x7f1cc80c6c10 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc7e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80c6030 con 0x7f1cc80c67e0 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc6a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cc80c67e0 0x7f1cc8159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc6a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cc80c67e0 0x7f1cc8159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38868/0 (socket says 172.21.15.102:38868) 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc6000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc81f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.127+0000 7f1cc6a00640 1 -- 172.21.15.102:0/3611561106 learned_addr learned my addr 172.21.15.102:0/3611561106 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc7400640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc8154120 0x7f1cc81f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc6000640 1 -- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cc80c67e0 msgr2=0x7f1cc8159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc6000640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cc80c67e0 0x7f1cc8159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc6000640 1 -- 172.21.15.102:0/3611561106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc8154120 msgr2=0x7f1cc81f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc6000640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc8154120 0x7f1cc81f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc6000640 1 -- 172.21.15.102:0/3611561106 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009a70 con 0x7f1cc80c6c10 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc7400640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc8154120 0x7f1cc81f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:09.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cc6000640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc81f2c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80c6bc0 tx=0x7f1cb400cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.128+0000 7f1cbea00640 1 -- 172.21.15.102:0/3611561106 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40072d0 con 0x7f1cc80c6c10 2024-03-25T06:04:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.129+0000 7f1cbea00640 1 -- 172.21.15.102:0/3611561106 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4007430 con 0x7f1cc80c6c10 2024-03-25T06:04:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.129+0000 7f1cbea00640 1 -- 172.21.15.102:0/3611561106 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40047e0 con 0x7f1cc80c6c10 2024-03-25T06:04:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.129+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc80c54b0 con 0x7f1cc80c6c10 2024-03-25T06:04:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.129+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc80c5a70 con 0x7f1cc80c6c10 2024-03-25T06:04:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.130+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc804f2f0 con 0x7f1cc80c6c10 2024-03-25T06:04:09.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.133+0000 7f1cbea00640 1 -- 172.21.15.102:0/3611561106 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1cb4004940 con 0x7f1cc80c6c10 2024-03-25T06:04:09.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.134+0000 7f1cbea00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1ca806b810 0x7f1ca806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.134+0000 7f1cbea00640 1 -- 172.21.15.102:0/3611561106 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f1cb4089ae0 con 0x7f1cc80c6c10 2024-03-25T06:04:09.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.134+0000 7f1cc6a00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1ca806b810 0x7f1ca806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.135+0000 7f1cc6a00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1ca806b810 0x7f1ca806dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009b60 tx=0x7f1cb8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.140+0000 7f1cbea00640 1 -- 172.21.15.102:0/3611561106 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1cb4054210 con 0x7f1cc80c6c10 2024-03-25T06:04:09.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.398+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cc80ca4d0 con 0x7f1ca806b810 2024-03-25T06:04:09.392 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 7 to deep-scrub 2024-03-25T06:04:09.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.399+0000 7f1cbea00640 1 -- 172.21.15.102:0/3611561106 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1cb8011ac0 con 0x7f1ca806b810 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1ca806b810 msgr2=0x7f1ca806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1ca806b810 0x7f1ca806dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009b60 tx=0x7f1cb8009190 comp rx=0 tx=0).stop 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 msgr2=0x7f1cc81f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc81f2c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80c6bc0 tx=0x7f1cb400cbe0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 shutdown_connections 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1ca806b810 0x7f1ca806dcd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc8154120 0x7f1cc81f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cc80c6c10 0x7f1cc81f2c20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 --2- 172.21.15.102:0/3611561106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cc80c67e0 0x7f1cc8159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 >> 172.21.15.102:0/3611561106 conn(0x7f1cc80cf3e0 msgr2=0x7f1cc80ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:09.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 shutdown_connections 2024-03-25T06:04:09.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.401+0000 7f1cc7e00640 1 -- 172.21.15.102:0/3611561106 wait complete. 2024-03-25T06:04:09.411 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T06:04:09.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.591+0000 7fd2c3e00640 1 Processor -- start 2024-03-25T06:04:09.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.591+0000 7fd2c3e00640 1 -- start start 2024-03-25T06:04:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.592+0000 7fd2c3e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd2c40c67e0 0x7fd2c40c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.592+0000 7fd2c3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c40c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.592+0000 7fd2c3e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c40cbbe0 con 0x7fd2c4154120 2024-03-25T06:04:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.592+0000 7fd2c3e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c4154500 con 0x7fd2c40c67e0 2024-03-25T06:04:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.592+0000 7fd2c3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c406b250 con 0x7fd2c40c6c10 2024-03-25T06:04:09.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.592+0000 7fd2c2000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd2c40c67e0 0x7fd2c40c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.593+0000 7fd2c2000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd2c40c67e0 0x7fd2c40c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:38116/0 (socket says 172.21.15.102:38116) 2024-03-25T06:04:09.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.593+0000 7fd2c3400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c40c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.593+0000 7fd2c2000640 1 -- 172.21.15.102:0/3828747142 learned_addr learned my addr 172.21.15.102:0/3828747142 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:09.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.593+0000 7fd2c2000640 1 -- 172.21.15.102:0/3828747142 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 msgr2=0x7fd2c40c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:09.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.593+0000 7fd2c2000640 1 --2- 172.21.15.102:0/3828747142 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c40c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.593+0000 7fd2c2000640 1 -- 172.21.15.102:0/3828747142 >> v1:172.21.15.102:6789/0 conn(0x7fd2c4154120 legacy=0x7fd2c40cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.593+0000 7fd2c2000640 1 -- 172.21.15.102:0/3828747142 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40ca280 con 0x7fd2c40c67e0 2024-03-25T06:04:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.594+0000 7fd2c2000640 1 --2- 172.21.15.102:0/3828747142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c40c67e0 0x7fd2c40c7d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009870 tx=0x7fd2b002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5bb1cba47cc8503 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.594+0000 7fd2c1600640 1 -- 172.21.15.102:0/3828747142 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0030840 con 0x7fd2c40c67e0 2024-03-25T06:04:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.594+0000 7fd2c1600640 1 -- 172.21.15.102:0/3828747142 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b00309a0 con 0x7fd2c40c67e0 2024-03-25T06:04:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.594+0000 7fd2c1600640 1 -- 172.21.15.102:0/3828747142 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0030d30 con 0x7fd2c40c67e0 2024-03-25T06:04:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 -- 172.21.15.102:0/3828747142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c40c67e0 msgr2=0x7fd2c40c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/3828747142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c40c67e0 0x7fd2c40c7d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009870 tx=0x7fd2b002b980 comp rx=0 tx=0).stop 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 -- 172.21.15.102:0/3828747142 shutdown_connections 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/3828747142 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c40c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/3828747142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c40c67e0 0x7fd2c40c7d00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 -- 172.21.15.102:0/3828747142 >> 172.21.15.102:0/3828747142 conn(0x7fd2c40cf3e0 msgr2=0x7fd2c40cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 -- 172.21.15.102:0/3828747142 shutdown_connections 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.595+0000 7fd2c3e00640 1 -- 172.21.15.102:0/3828747142 wait complete. 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.597+0000 7fd2c3e00640 1 Processor -- start 2024-03-25T06:04:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.597+0000 7fd2c3e00640 1 -- start start 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.597+0000 7fd2c3e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40c67e0 0x7fd2c4152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c4154120 0x7fd2c414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c41f0c00 con 0x7fd2c40c67e0 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c415d680 con 0x7fd2c4154120 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c415d920 con 0x7fd2c40c6c10 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c4154120 0x7fd2c414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c415b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38880/0 (socket says 172.21.15.102:38880) 2024-03-25T06:04:09.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c2000640 1 -- 172.21.15.102:0/2136266627 learned_addr learned my addr 172.21.15.102:0/2136266627 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:09.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c2a00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40c67e0 0x7fd2c4152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3400640 1 -- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 msgr2=0x7fd2c415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3400640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3400640 1 -- 172.21.15.102:0/2136266627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40c67e0 msgr2=0x7fd2c4152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3400640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40c67e0 0x7fd2c4152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.598+0000 7fd2c3400640 1 -- 172.21.15.102:0/2136266627 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00094d0 con 0x7fd2c4154120 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.599+0000 7fd2c3400640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c4154120 0x7fd2c414d540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009d90 tx=0x7fd2bc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.599+0000 7fd2baa00640 1 -- 172.21.15.102:0/2136266627 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc014480 con 0x7fd2c4154120 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.599+0000 7fd2baa00640 1 -- 172.21.15.102:0/2136266627 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc00f040 con 0x7fd2c4154120 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.599+0000 7fd2baa00640 1 -- 172.21.15.102:0/2136266627 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc014840 con 0x7fd2c4154120 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.599+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c415ae40 con 0x7fd2c4154120 2024-03-25T06:04:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.600+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c415b400 con 0x7fd2c4154120 2024-03-25T06:04:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.601+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c4068a80 con 0x7fd2c4154120 2024-03-25T06:04:09.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.602+0000 7fd2baa00640 1 -- 172.21.15.102:0/2136266627 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2bc0149a0 con 0x7fd2c4154120 2024-03-25T06:04:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.603+0000 7fd2baa00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd2a406b890 0x7fd2a406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.603+0000 7fd2baa00640 1 -- 172.21.15.102:0/2136266627 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fd2bc08b400 con 0x7fd2c4154120 2024-03-25T06:04:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.603+0000 7fd2c2a00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd2a406b890 0x7fd2a406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.603+0000 7fd2c2a00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd2a406b890 0x7fd2a406dd50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40016e0 tx=0x7fd2b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:09.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.607+0000 7fd2baa00640 1 -- 172.21.15.102:0/2136266627 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd2bc0559e0 con 0x7fd2c4154120 2024-03-25T06:04:09.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.802+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2c40ca7b0 con 0x7fd2a406b890 2024-03-25T06:04:09.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.810+0000 7fd2baa00640 1 -- 172.21.15.102:0/2136266627 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+333689 (secure 0 0 0) 0x7fd2b4001cc0 con 0x7fd2a406b890 2024-03-25T06:04:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd2a406b890 msgr2=0x7fd2a406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd2a406b890 0x7fd2a406dd50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40016e0 tx=0x7fd2b4009040 comp rx=0 tx=0).stop 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c4154120 msgr2=0x7fd2c414d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c4154120 0x7fd2c414d540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009d90 tx=0x7fd2bc00c490 comp rx=0 tx=0).stop 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 shutdown_connections 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fd2a406b890 0x7fd2a406dd50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c4154120 0x7fd2c414d540 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2c40c6c10 0x7fd2c415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 --2- 172.21.15.102:0/2136266627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40c67e0 0x7fd2c4152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:09.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 >> 172.21.15.102:0/2136266627 conn(0x7fd2c40cf3e0 msgr2=0x7fd2c40cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:09.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 shutdown_connections 2024-03-25T06:04:09.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:09.816+0000 7fd2c3e00640 1 -- 172.21.15.102:0/2136266627 wait complete. 2024-03-25T06:04:09.832 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":823,"stamp":"2024-03-25T06:04:09.350390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":234642563,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":8379,"num_read_kb":1510074,"num_write":298681,"num_write_kb":4974594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":460612,"ondisk_log_size":460612,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5877208,"kb_used_data":307480,"kb_used_omap":12,"kb_used_meta":5569651,"kb_avail":749097512,"statfs":{"total":773094113280,"available":767075852288,"internally_reserved":0,"allocated":314859520,"data_stored":470258566,"data_compressed":49649372,"data_compressed_allocated":73498624,"data_compressed_original":230506496,"omap_allocated":12752,"internal_metadata":5703323184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18706902,"num_objects":-106,"num_object_clones":0,"num_object_copies":-334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-106,"num_whiteouts":0,"num_read":2,"num_read_kb":11,"num_write":263,"num_write_kb":5599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002460"},"pg_stats":[{"pgid":"2.1f","version":"27'1877","reported_seq":1925,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.020267+0000","last_change":"2024-03-25T06:04:06.020346+0000","last_active":"2024-03-25T06:04:06.020267+0000","last_peered":"2024-03-25T06:04:06.020267+0000","last_clean":"2024-03-25T06:04:06.020267+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T06:04:06.020267+0000","last_undegraded":"2024-03-25T06:04:06.020267+0000","last_fullsized":"2024-03-25T06:04:06.020267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1877","last_scrub_stamp":"2024-03-25T06:04:06.020170+0000","last_deep_scrub":"27'1877","last_deep_scrub_stamp":"2024-03-25T06:04:06.020170+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.020170+0000","objects_scrubbed":6,"log_size":1877,"log_dups_size":0,"ondisk_log_size":1877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:04.258197+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1876,"num_write_kb":13587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1712","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.812969+0000","last_change":"2024-03-25T05:37:31.197548+0000","last_active":"2024-03-25T06:03:59.812969+0000","last_peered":"2024-03-25T06:03:59.812969+0000","last_clean":"2024-03-25T06:03:59.812969+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T06:03:59.812969+0000","last_undegraded":"2024-03-25T06:03:59.812969+0000","last_fullsized":"2024-03-25T06:03:59.812969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'6044","reported_seq":6156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.796917+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T06:03:59.796917+0000","last_peered":"2024-03-25T06:03:59.796917+0000","last_clean":"2024-03-25T06:03:59.796917+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T06:03:59.796917+0000","last_undegraded":"2024-03-25T06:03:59.796917+0000","last_fullsized":"2024-03-25T06:03:59.796917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6044,"log_dups_size":0,"ondisk_log_size":6044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":4304,"num_write_kb":115529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'5159","reported_seq":5200,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.718315+0000","last_change":"2024-03-25T05:37:30.429785+0000","last_active":"2024-03-25T06:03:54.718315+0000","last_peered":"2024-03-25T06:03:54.718315+0000","last_clean":"2024-03-25T06:03:54.718315+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T06:03:54.718315+0000","last_undegraded":"2024-03-25T06:03:54.718315+0000","last_fullsized":"2024-03-25T06:03:54.718315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5171,"num_write_kb":32292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1712","reported_seq":1758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.989585+0000","last_change":"2024-03-25T06:04:08.989608+0000","last_active":"2024-03-25T06:04:08.989585+0000","last_peered":"2024-03-25T06:04:08.989585+0000","last_clean":"2024-03-25T06:04:08.989585+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T06:04:08.989585+0000","last_undegraded":"2024-03-25T06:04:08.989585+0000","last_fullsized":"2024-03-25T06:04:08.989585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1712","last_scrub_stamp":"2024-03-25T06:04:08.989509+0000","last_deep_scrub":"27'1712","last_deep_scrub_stamp":"2024-03-25T06:04:08.989509+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.989509+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:17:26.592685+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5973","reported_seq":6074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.402947+0000","last_change":"2024-03-25T05:38:20.806371+0000","last_active":"2024-03-25T06:03:59.402947+0000","last_peered":"2024-03-25T06:03:59.402947+0000","last_clean":"2024-03-25T06:03:59.402947+0000","last_became_active":"2024-03-25T05:38:20.805843+0000","last_became_peered":"2024-03-25T05:38:20.805843+0000","last_unstale":"2024-03-25T06:03:59.402947+0000","last_undegraded":"2024-03-25T06:03:59.402947+0000","last_fullsized":"2024-03-25T06:03:59.402947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5973,"log_dups_size":0,"ondisk_log_size":5973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:02:43.608618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":16002,"num_write":4134,"num_write_kb":115071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7852","reported_seq":7890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.642765+0000","last_change":"2024-03-25T05:37:30.409548+0000","last_active":"2024-03-25T06:03:54.642765+0000","last_peered":"2024-03-25T06:03:54.642765+0000","last_clean":"2024-03-25T06:03:54.642765+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T06:03:54.642765+0000","last_undegraded":"2024-03-25T06:03:54.642765+0000","last_fullsized":"2024-03-25T06:03:54.642765+0000","mapping_epoch":17,"log_start":"27'800","ondisk_log_start":"27'800","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7052,"log_dups_size":0,"ondisk_log_size":7052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:14.742149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7854,"num_write_kb":54498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1772","reported_seq":1808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.182854+0000","last_change":"2024-03-25T05:37:31.137848+0000","last_active":"2024-03-25T06:03:59.182854+0000","last_peered":"2024-03-25T06:03:59.182854+0000","last_clean":"2024-03-25T06:03:59.182854+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T06:03:59.182854+0000","last_undegraded":"2024-03-25T06:03:59.182854+0000","last_fullsized":"2024-03-25T06:03:59.182854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1772,"log_dups_size":0,"ondisk_log_size":1772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5981","reported_seq":6136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.433836+0000","last_change":"2024-03-25T05:37:35.462936+0000","last_active":"2024-03-25T06:03:59.433836+0000","last_peered":"2024-03-25T06:03:59.433836+0000","last_clean":"2024-03-25T06:03:59.433836+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T06:03:59.433836+0000","last_undegraded":"2024-03-25T06:03:59.433836+0000","last_fullsized":"2024-03-25T06:03:59.433836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5981,"log_dups_size":0,"ondisk_log_size":5981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:47:17.194755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":31496,"num_write":4151,"num_write_kb":107318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4412","reported_seq":4450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:02:30.058411+0000","last_change":"2024-03-25T05:37:30.407972+0000","last_active":"2024-03-25T06:02:30.058411+0000","last_peered":"2024-03-25T06:02:30.058411+0000","last_clean":"2024-03-25T06:02:30.058411+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T06:02:30.058411+0000","last_undegraded":"2024-03-25T06:02:30.058411+0000","last_fullsized":"2024-03-25T06:02:30.058411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4409,"num_write_kb":35629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1703","reported_seq":1739,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.198934+0000","last_change":"2024-03-25T05:37:31.137456+0000","last_active":"2024-03-25T06:03:59.198934+0000","last_peered":"2024-03-25T06:03:59.198934+0000","last_clean":"2024-03-25T06:03:59.198934+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T06:03:59.198934+0000","last_undegraded":"2024-03-25T06:03:59.198934+0000","last_fullsized":"2024-03-25T06:03:59.198934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5907","reported_seq":6005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.332320+0000","last_change":"2024-03-25T05:37:35.471478+0000","last_active":"2024-03-25T06:03:59.332320+0000","last_peered":"2024-03-25T06:03:59.332320+0000","last_clean":"2024-03-25T06:03:59.332320+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T06:03:59.332320+0000","last_undegraded":"2024-03-25T06:03:59.332320+0000","last_fullsized":"2024-03-25T06:03:59.332320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:48.902519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":4127,"num_write_kb":118658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1739","reported_seq":1776,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.163357+0000","last_change":"2024-03-25T05:37:31.190210+0000","last_active":"2024-03-25T06:03:59.163357+0000","last_peered":"2024-03-25T06:03:59.163357+0000","last_clean":"2024-03-25T06:03:59.163357+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T06:03:59.163357+0000","last_undegraded":"2024-03-25T06:03:59.163357+0000","last_fullsized":"2024-03-25T06:03:59.163357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:46:17.573872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'5826","reported_seq":5865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.701813+0000","last_change":"2024-03-25T05:37:30.414108+0000","last_active":"2024-03-25T06:03:54.701813+0000","last_peered":"2024-03-25T06:03:54.701813+0000","last_clean":"2024-03-25T06:03:54.701813+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T06:03:54.701813+0000","last_undegraded":"2024-03-25T06:03:54.701813+0000","last_fullsized":"2024-03-25T06:03:54.701813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:00:59.314440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5838,"num_write_kb":40868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'6422","reported_seq":6560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.635204+0000","last_change":"2024-03-25T05:38:20.653005+0000","last_active":"2024-03-25T06:03:59.635204+0000","last_peered":"2024-03-25T06:03:59.635204+0000","last_clean":"2024-03-25T06:03:59.635204+0000","last_became_active":"2024-03-25T05:38:20.652530+0000","last_became_peered":"2024-03-25T05:38:20.652530+0000","last_unstale":"2024-03-25T06:03:59.635204+0000","last_undegraded":"2024-03-25T06:03:59.635204+0000","last_fullsized":"2024-03-25T06:03:59.635204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6422,"log_dups_size":0,"ondisk_log_size":6422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:23.447608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":25146,"num_write":4573,"num_write_kb":128923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1760","reported_seq":1797,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.708678+0000","last_change":"2024-03-25T05:37:31.170972+0000","last_active":"2024-03-25T06:03:59.708678+0000","last_peered":"2024-03-25T06:03:59.708678+0000","last_clean":"2024-03-25T06:03:59.708678+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T06:03:59.708678+0000","last_undegraded":"2024-03-25T06:03:59.708678+0000","last_fullsized":"2024-03-25T06:03:59.708678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'5252","reported_seq":5293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.247134+0000","last_change":"2024-03-25T05:37:30.429867+0000","last_active":"2024-03-25T06:03:59.247134+0000","last_peered":"2024-03-25T06:03:59.247134+0000","last_clean":"2024-03-25T06:03:59.247134+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T06:03:59.247134+0000","last_undegraded":"2024-03-25T06:03:59.247134+0000","last_fullsized":"2024-03-25T06:03:59.247134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":40419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'6245","reported_seq":6390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.552499+0000","last_change":"2024-03-25T05:38:20.809959+0000","last_active":"2024-03-25T06:03:59.552499+0000","last_peered":"2024-03-25T06:03:59.552499+0000","last_clean":"2024-03-25T06:03:59.552499+0000","last_became_active":"2024-03-25T05:38:20.809544+0000","last_became_peered":"2024-03-25T05:38:20.809544+0000","last_unstale":"2024-03-25T06:03:59.552499+0000","last_undegraded":"2024-03-25T06:03:59.552499+0000","last_fullsized":"2024-03-25T06:03:59.552499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6245,"log_dups_size":0,"ondisk_log_size":6245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:17:17.764182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":26924,"num_write":4477,"num_write_kb":122118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1773","reported_seq":1811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.327024+0000","last_change":"2024-03-25T05:37:31.166959+0000","last_active":"2024-03-25T06:03:59.327024+0000","last_peered":"2024-03-25T06:03:59.327024+0000","last_clean":"2024-03-25T06:03:59.327024+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T06:03:59.327024+0000","last_undegraded":"2024-03-25T06:03:59.327024+0000","last_fullsized":"2024-03-25T06:03:59.327024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2777","reported_seq":2826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.245615+0000","last_change":"2024-03-25T06:04:06.245663+0000","last_active":"2024-03-25T06:04:06.245615+0000","last_peered":"2024-03-25T06:04:06.245615+0000","last_clean":"2024-03-25T06:04:06.245615+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T06:04:06.245615+0000","last_undegraded":"2024-03-25T06:04:06.245615+0000","last_fullsized":"2024-03-25T06:04:06.245615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2777","last_scrub_stamp":"2024-03-25T06:04:06.245521+0000","last_deep_scrub":"27'2777","last_deep_scrub_stamp":"2024-03-25T06:04:06.245521+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.245521+0000","objects_scrubbed":4,"log_size":2777,"log_dups_size":0,"ondisk_log_size":2777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:25:43.873830+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2784,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5899","reported_seq":6118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.439240+0000","last_change":"2024-03-25T05:37:35.926429+0000","last_active":"2024-03-25T06:03:59.439240+0000","last_peered":"2024-03-25T06:03:59.439240+0000","last_clean":"2024-03-25T06:03:59.439240+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T06:03:59.439240+0000","last_undegraded":"2024-03-25T06:03:59.439240+0000","last_fullsized":"2024-03-25T06:03:59.439240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5899,"log_dups_size":0,"ondisk_log_size":5899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":47244,"num_write":4145,"num_write_kb":109724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1772","reported_seq":1810,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:52.152849+0000","last_change":"2024-03-25T05:37:31.172432+0000","last_active":"2024-03-25T06:03:52.152849+0000","last_peered":"2024-03-25T06:03:52.152849+0000","last_clean":"2024-03-25T06:03:52.152849+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T06:03:52.152849+0000","last_undegraded":"2024-03-25T06:03:52.152849+0000","last_fullsized":"2024-03-25T06:03:52.152849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1772,"log_dups_size":0,"ondisk_log_size":1772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:23.623970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1612","reported_seq":1652,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.715052+0000","last_change":"2024-03-25T05:37:30.411141+0000","last_active":"2024-03-25T06:03:54.715052+0000","last_peered":"2024-03-25T06:03:54.715052+0000","last_clean":"2024-03-25T06:03:54.715052+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T06:03:54.715052+0000","last_undegraded":"2024-03-25T06:03:54.715052+0000","last_fullsized":"2024-03-25T06:03:54.715052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5913","reported_seq":5997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.437882+0000","last_change":"2024-03-25T05:37:35.462392+0000","last_active":"2024-03-25T06:03:59.437882+0000","last_peered":"2024-03-25T06:03:59.437882+0000","last_clean":"2024-03-25T06:03:59.437882+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T06:03:59.437882+0000","last_undegraded":"2024-03-25T06:03:59.437882+0000","last_fullsized":"2024-03-25T06:03:59.437882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5913,"log_dups_size":0,"ondisk_log_size":5913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:45:06.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4059,"num_write_kb":104872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1713","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.884487+0000","last_change":"2024-03-25T05:37:31.164593+0000","last_active":"2024-03-25T06:03:59.884487+0000","last_peered":"2024-03-25T06:03:59.884487+0000","last_clean":"2024-03-25T06:03:59.884487+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T06:03:59.884487+0000","last_undegraded":"2024-03-25T06:03:59.884487+0000","last_fullsized":"2024-03-25T06:03:59.884487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'2886","reported_seq":2925,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.726047+0000","last_change":"2024-03-25T05:37:30.408139+0000","last_active":"2024-03-25T06:03:54.726047+0000","last_peered":"2024-03-25T06:03:54.726047+0000","last_clean":"2024-03-25T06:03:54.726047+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T06:03:54.726047+0000","last_undegraded":"2024-03-25T06:03:54.726047+0000","last_fullsized":"2024-03-25T06:03:54.726047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2906,"num_write_kb":22398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'6071","reported_seq":6156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.797858+0000","last_change":"2024-03-25T05:37:35.926997+0000","last_active":"2024-03-25T06:03:58.797858+0000","last_peered":"2024-03-25T06:03:58.797858+0000","last_clean":"2024-03-25T06:03:58.797858+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T06:03:58.797858+0000","last_undegraded":"2024-03-25T06:03:58.797858+0000","last_fullsized":"2024-03-25T06:03:58.797858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6071,"log_dups_size":0,"ondisk_log_size":6071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4303,"num_write_kb":129626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1690","reported_seq":1728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.203628+0000","last_change":"2024-03-25T05:37:31.166281+0000","last_active":"2024-03-25T06:03:59.203628+0000","last_peered":"2024-03-25T06:03:59.203628+0000","last_clean":"2024-03-25T06:03:59.203628+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T06:03:59.203628+0000","last_undegraded":"2024-03-25T06:03:59.203628+0000","last_fullsized":"2024-03-25T06:03:59.203628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4483","reported_seq":4524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.551988+0000","last_change":"2024-03-25T05:37:30.427830+0000","last_active":"2024-03-25T06:03:59.551988+0000","last_peered":"2024-03-25T06:03:59.551988+0000","last_clean":"2024-03-25T06:03:59.551988+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T06:03:59.551988+0000","last_undegraded":"2024-03-25T06:03:59.551988+0000","last_fullsized":"2024-03-25T06:03:59.551988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7152,"num_write_kb":35867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'6341","reported_seq":6509,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.665875+0000","last_change":"2024-03-25T05:37:35.928399+0000","last_active":"2024-03-25T06:03:59.665875+0000","last_peered":"2024-03-25T06:03:59.665875+0000","last_clean":"2024-03-25T06:03:59.665875+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T06:03:59.665875+0000","last_undegraded":"2024-03-25T06:03:59.665875+0000","last_fullsized":"2024-03-25T06:03:59.665875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6341,"log_dups_size":0,"ondisk_log_size":6341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":33782,"num_write":4571,"num_write_kb":115403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1759","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.250376+0000","last_change":"2024-03-25T05:37:31.163194+0000","last_active":"2024-03-25T06:03:59.250376+0000","last_peered":"2024-03-25T06:03:59.250376+0000","last_clean":"2024-03-25T06:03:59.250376+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T06:03:59.250376+0000","last_undegraded":"2024-03-25T06:03:59.250376+0000","last_fullsized":"2024-03-25T06:03:59.250376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1759,"log_dups_size":0,"ondisk_log_size":1759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'5273","reported_seq":5313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.690625+0000","last_change":"2024-03-25T05:37:30.414478+0000","last_active":"2024-03-25T06:03:54.690625+0000","last_peered":"2024-03-25T06:03:54.690625+0000","last_clean":"2024-03-25T06:03:54.690625+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T06:03:54.690625+0000","last_undegraded":"2024-03-25T06:03:54.690625+0000","last_fullsized":"2024-03-25T06:03:54.690625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:31.837863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5274,"num_write_kb":36361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'6079","reported_seq":6318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.723053+0000","last_change":"2024-03-25T05:37:35.930329+0000","last_active":"2024-03-25T06:03:59.723053+0000","last_peered":"2024-03-25T06:03:59.723053+0000","last_clean":"2024-03-25T06:03:59.723053+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T06:03:59.723053+0000","last_undegraded":"2024-03-25T06:03:59.723053+0000","last_fullsized":"2024-03-25T06:03:59.723053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6079,"log_dups_size":0,"ondisk_log_size":6079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":52070,"num_write":4228,"num_write_kb":109752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1711","reported_seq":1734,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.246220+0000","last_change":"2024-03-25T05:38:20.806229+0000","last_active":"2024-03-25T06:03:59.246220+0000","last_peered":"2024-03-25T06:03:59.246220+0000","last_clean":"2024-03-25T06:03:59.246220+0000","last_became_active":"2024-03-25T05:38:20.805934+0000","last_became_peered":"2024-03-25T05:38:20.805934+0000","last_unstale":"2024-03-25T06:03:59.246220+0000","last_undegraded":"2024-03-25T06:03:59.246220+0000","last_fullsized":"2024-03-25T06:03:59.246220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'5138","reported_seq":5179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.744050+0000","last_change":"2024-03-25T05:37:30.423534+0000","last_active":"2024-03-25T06:03:54.744050+0000","last_peered":"2024-03-25T06:03:54.744050+0000","last_clean":"2024-03-25T06:03:54.744050+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T06:03:54.744050+0000","last_undegraded":"2024-03-25T06:03:54.744050+0000","last_fullsized":"2024-03-25T06:03:54.744050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5138,"log_dups_size":0,"ondisk_log_size":5138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5143,"num_write_kb":40167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'6967","reported_seq":7060,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.272404+0000","last_change":"2024-03-25T05:37:35.473423+0000","last_active":"2024-03-25T06:03:54.272404+0000","last_peered":"2024-03-25T06:03:54.272404+0000","last_clean":"2024-03-25T06:03:54.272404+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T06:03:54.272404+0000","last_undegraded":"2024-03-25T06:03:54.272404+0000","last_fullsized":"2024-03-25T06:03:54.272404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6967,"log_dups_size":0,"ondisk_log_size":6967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5199,"num_write_kb":132356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1725","reported_seq":1763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.176037+0000","last_change":"2024-03-25T05:37:31.164281+0000","last_active":"2024-03-25T06:03:59.176037+0000","last_peered":"2024-03-25T06:03:59.176037+0000","last_clean":"2024-03-25T06:03:59.176037+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T06:03:59.176037+0000","last_undegraded":"2024-03-25T06:03:59.176037+0000","last_fullsized":"2024-03-25T06:03:59.176037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:56.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7932","reported_seq":7972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731617+0000","last_change":"2024-03-25T05:37:30.421717+0000","last_active":"2024-03-25T06:03:54.731617+0000","last_peered":"2024-03-25T06:03:54.731617+0000","last_clean":"2024-03-25T06:03:54.731617+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T06:03:54.731617+0000","last_undegraded":"2024-03-25T06:03:54.731617+0000","last_fullsized":"2024-03-25T06:03:54.731617+0000","mapping_epoch":17,"log_start":"27'400","ondisk_log_start":"27'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7532,"log_dups_size":0,"ondisk_log_size":7532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:09:55.943367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":7940,"num_write_kb":54570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'6089","reported_seq":6195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.584408+0000","last_change":"2024-03-25T05:37:35.456867+0000","last_active":"2024-03-25T06:03:54.584408+0000","last_peered":"2024-03-25T06:03:54.584408+0000","last_clean":"2024-03-25T06:03:54.584408+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T06:03:54.584408+0000","last_undegraded":"2024-03-25T06:03:54.584408+0000","last_fullsized":"2024-03-25T06:03:54.584408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6089,"log_dups_size":0,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4263,"num_write_kb":125557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1743","reported_seq":1783,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.222385+0000","last_change":"2024-03-25T05:37:31.162835+0000","last_active":"2024-03-25T06:03:59.222385+0000","last_peered":"2024-03-25T06:03:59.222385+0000","last_clean":"2024-03-25T06:03:59.222385+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T06:03:59.222385+0000","last_undegraded":"2024-03-25T06:03:59.222385+0000","last_fullsized":"2024-03-25T06:03:59.222385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6068","reported_seq":7059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.060245+0000","last_change":"2024-03-25T05:37:30.429353+0000","last_active":"2024-03-25T06:03:59.060245+0000","last_peered":"2024-03-25T06:03:59.060245+0000","last_clean":"2024-03-25T06:03:59.060245+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T06:03:59.060245+0000","last_undegraded":"2024-03-25T06:03:59.060245+0000","last_fullsized":"2024-03-25T06:03:59.060245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6068,"log_dups_size":0,"ondisk_log_size":6068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":950,"num_read_kb":4728,"num_write":6067,"num_write_kb":44951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'6020","reported_seq":6493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.467303+0000","last_change":"2024-03-25T05:37:35.465181+0000","last_active":"2024-03-25T06:03:59.467303+0000","last_peered":"2024-03-25T06:03:59.467303+0000","last_clean":"2024-03-25T06:03:59.467303+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T06:03:59.467303+0000","last_undegraded":"2024-03-25T06:03:59.467303+0000","last_fullsized":"2024-03-25T06:03:59.467303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6020,"log_dups_size":0,"ondisk_log_size":6020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":111506,"num_write":4241,"num_write_kb":120921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1663","reported_seq":1709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.011481+0000","last_change":"2024-03-25T06:04:07.011544+0000","last_active":"2024-03-25T06:04:07.011481+0000","last_peered":"2024-03-25T06:04:07.011481+0000","last_clean":"2024-03-25T06:04:07.011481+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T06:04:07.011481+0000","last_undegraded":"2024-03-25T06:04:07.011481+0000","last_fullsized":"2024-03-25T06:04:07.011481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1663","last_scrub_stamp":"2024-03-25T06:04:07.011279+0000","last_deep_scrub":"27'1663","last_deep_scrub_stamp":"2024-03-25T06:04:07.011279+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.011279+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:23.054610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'6671","reported_seq":6712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.671195+0000","last_change":"2024-03-25T05:37:30.422649+0000","last_active":"2024-03-25T06:03:54.671195+0000","last_peered":"2024-03-25T06:03:54.671195+0000","last_clean":"2024-03-25T06:03:54.671195+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T06:03:54.671195+0000","last_undegraded":"2024-03-25T06:03:54.671195+0000","last_fullsized":"2024-03-25T06:03:54.671195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6671,"log_dups_size":0,"ondisk_log_size":6671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":45450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'6165","reported_seq":6359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.905339+0000","last_change":"2024-03-25T05:37:35.926628+0000","last_active":"2024-03-25T06:03:59.905339+0000","last_peered":"2024-03-25T06:03:59.905339+0000","last_clean":"2024-03-25T06:03:59.905339+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T06:03:59.905339+0000","last_undegraded":"2024-03-25T06:03:59.905339+0000","last_fullsized":"2024-03-25T06:03:59.905339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6165,"log_dups_size":0,"ondisk_log_size":6165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":40640,"num_write":4336,"num_write_kb":133390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1739","reported_seq":1777,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.201965+0000","last_change":"2024-03-25T05:37:31.165403+0000","last_active":"2024-03-25T06:03:59.201965+0000","last_peered":"2024-03-25T06:03:59.201965+0000","last_clean":"2024-03-25T06:03:59.201965+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T06:03:59.201965+0000","last_undegraded":"2024-03-25T06:03:59.201965+0000","last_fullsized":"2024-03-25T06:03:59.201965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4314","reported_seq":4354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:08.404605+0000","last_change":"2024-03-25T05:37:30.412932+0000","last_active":"2024-03-25T06:03:08.404605+0000","last_peered":"2024-03-25T06:03:08.404605+0000","last_clean":"2024-03-25T06:03:08.404605+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T06:03:08.404605+0000","last_undegraded":"2024-03-25T06:03:08.404605+0000","last_fullsized":"2024-03-25T06:03:08.404605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4314,"log_dups_size":0,"ondisk_log_size":4314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4311,"num_write_kb":35590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:01:30.046447+0000","last_change":"2024-03-25T05:37:27.084432+0000","last_active":"2024-03-25T06:01:30.046447+0000","last_peered":"2024-03-25T06:01:30.046447+0000","last_clean":"2024-03-25T06:01:30.046447+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T06:01:30.046447+0000","last_undegraded":"2024-03-25T06:01:30.046447+0000","last_fullsized":"2024-03-25T06:01:30.046447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:25.864676+0000","last_clean_scrub_stamp":"2024-03-25T05:37:25.864676+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:20:05.348200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'6163","reported_seq":6324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.891687+0000","last_change":"2024-03-25T05:37:35.926403+0000","last_active":"2024-03-25T06:03:58.891687+0000","last_peered":"2024-03-25T06:03:58.891687+0000","last_clean":"2024-03-25T06:03:58.891687+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T06:03:58.891687+0000","last_undegraded":"2024-03-25T06:03:58.891687+0000","last_fullsized":"2024-03-25T06:03:58.891687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6163,"log_dups_size":0,"ondisk_log_size":6163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:22.983326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":32512,"num_write":4376,"num_write_kb":123749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1732","reported_seq":1769,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.385878+0000","last_change":"2024-03-25T05:37:31.146827+0000","last_active":"2024-03-25T06:03:59.385878+0000","last_peered":"2024-03-25T06:03:59.385878+0000","last_clean":"2024-03-25T06:03:59.385878+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T06:03:59.385878+0000","last_undegraded":"2024-03-25T06:03:59.385878+0000","last_fullsized":"2024-03-25T06:03:59.385878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:11.782095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5042","reported_seq":5082,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.056789+0000","last_change":"2024-03-25T05:37:30.409601+0000","last_active":"2024-03-25T06:03:59.056789+0000","last_peered":"2024-03-25T06:03:59.056789+0000","last_clean":"2024-03-25T06:03:59.056789+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T06:03:59.056789+0000","last_undegraded":"2024-03-25T06:03:59.056789+0000","last_fullsized":"2024-03-25T06:03:59.056789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5042,"log_dups_size":0,"ondisk_log_size":5042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390173,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5033,"num_write_kb":40185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'6521","reported_seq":6842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.411627+0000","last_change":"2024-03-25T05:37:35.925431+0000","last_active":"2024-03-25T06:03:59.411627+0000","last_peered":"2024-03-25T06:03:59.411627+0000","last_clean":"2024-03-25T06:03:59.411627+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T06:03:59.411627+0000","last_undegraded":"2024-03-25T06:03:59.411627+0000","last_fullsized":"2024-03-25T06:03:59.411627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6521,"log_dups_size":0,"ondisk_log_size":6521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":73152,"num_write":4691,"num_write_kb":118239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1750","reported_seq":1792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.528255+0000","last_change":"2024-03-25T05:38:20.652252+0000","last_active":"2024-03-25T06:03:59.528255+0000","last_peered":"2024-03-25T06:03:59.528255+0000","last_clean":"2024-03-25T06:03:59.528255+0000","last_became_active":"2024-03-25T05:38:20.652010+0000","last_became_peered":"2024-03-25T05:38:20.652010+0000","last_unstale":"2024-03-25T06:03:59.528255+0000","last_undegraded":"2024-03-25T06:03:59.528255+0000","last_fullsized":"2024-03-25T06:03:59.528255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:35:19.423056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5678","reported_seq":5718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.731327+0000","last_change":"2024-03-25T05:37:30.425312+0000","last_active":"2024-03-25T06:03:54.731327+0000","last_peered":"2024-03-25T06:03:54.731327+0000","last_clean":"2024-03-25T06:03:54.731327+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T06:03:54.731327+0000","last_undegraded":"2024-03-25T06:03:54.731327+0000","last_fullsized":"2024-03-25T06:03:54.731327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5678,"log_dups_size":0,"ondisk_log_size":5678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5688,"num_write_kb":44802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'6240","reported_seq":6606,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.730041+0000","last_change":"2024-03-25T05:37:35.469405+0000","last_active":"2024-03-25T06:03:59.730041+0000","last_peered":"2024-03-25T06:03:59.730041+0000","last_clean":"2024-03-25T06:03:59.730041+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T06:03:59.730041+0000","last_undegraded":"2024-03-25T06:03:59.730041+0000","last_fullsized":"2024-03-25T06:03:59.730041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6240,"log_dups_size":0,"ondisk_log_size":6240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":84582,"num_write":4342,"num_write_kb":115405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1667","reported_seq":1704,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.217030+0000","last_change":"2024-03-25T05:37:31.147746+0000","last_active":"2024-03-25T06:03:59.217030+0000","last_peered":"2024-03-25T06:03:59.217030+0000","last_clean":"2024-03-25T06:03:59.217030+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T06:03:59.217030+0000","last_undegraded":"2024-03-25T06:03:59.217030+0000","last_fullsized":"2024-03-25T06:03:59.217030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1667,"log_dups_size":0,"ondisk_log_size":1667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:52:53.741551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5642","reported_seq":5682,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.655284+0000","last_change":"2024-03-25T05:37:30.431268+0000","last_active":"2024-03-25T06:03:54.655284+0000","last_peered":"2024-03-25T06:03:54.655284+0000","last_clean":"2024-03-25T06:03:54.655284+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T06:03:54.655284+0000","last_undegraded":"2024-03-25T06:03:54.655284+0000","last_fullsized":"2024-03-25T06:03:54.655284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5640,"num_write_kb":40587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'6755","reported_seq":7096,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.341601+0000","last_change":"2024-03-25T05:37:35.925782+0000","last_active":"2024-03-25T06:03:59.341601+0000","last_peered":"2024-03-25T06:03:59.341601+0000","last_clean":"2024-03-25T06:03:59.341601+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T06:03:59.341601+0000","last_undegraded":"2024-03-25T06:03:59.341601+0000","last_fullsized":"2024-03-25T06:03:59.341601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6755,"log_dups_size":0,"ondisk_log_size":6755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:19:43.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":78232,"num_write":4941,"num_write_kb":116659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1749","reported_seq":1786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.207801+0000","last_change":"2024-03-25T05:37:31.146491+0000","last_active":"2024-03-25T06:03:59.207801+0000","last_peered":"2024-03-25T06:03:59.207801+0000","last_clean":"2024-03-25T06:03:59.207801+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T06:03:59.207801+0000","last_undegraded":"2024-03-25T06:03:59.207801+0000","last_fullsized":"2024-03-25T06:03:59.207801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3454","reported_seq":3493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.684095+0000","last_change":"2024-03-25T05:37:30.419014+0000","last_active":"2024-03-25T06:03:54.684095+0000","last_peered":"2024-03-25T06:03:54.684095+0000","last_clean":"2024-03-25T06:03:54.684095+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T06:03:54.684095+0000","last_undegraded":"2024-03-25T06:03:54.684095+0000","last_fullsized":"2024-03-25T06:03:54.684095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:54.596720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3453,"num_write_kb":26898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'6088","reported_seq":6156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.607631+0000","last_change":"2024-03-25T05:37:35.460516+0000","last_active":"2024-03-25T06:03:59.607631+0000","last_peered":"2024-03-25T06:03:59.607631+0000","last_clean":"2024-03-25T06:03:59.607631+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T06:03:59.607631+0000","last_undegraded":"2024-03-25T06:03:59.607631+0000","last_fullsized":"2024-03-25T06:03:59.607631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6088,"log_dups_size":0,"ondisk_log_size":6088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:09:15.806647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":8890,"num_write":4238,"num_write_kb":109989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1751","reported_seq":1788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.158477+0000","last_change":"2024-03-25T05:37:31.145756+0000","last_active":"2024-03-25T06:03:59.158477+0000","last_peered":"2024-03-25T06:03:59.158477+0000","last_clean":"2024-03-25T06:03:59.158477+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T06:03:59.158477+0000","last_undegraded":"2024-03-25T06:03:59.158477+0000","last_fullsized":"2024-03-25T06:03:59.158477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'2586","reported_seq":2626,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.326101+0000","last_change":"2024-03-25T05:37:30.422904+0000","last_active":"2024-03-25T06:03:59.326101+0000","last_peered":"2024-03-25T06:03:59.326101+0000","last_clean":"2024-03-25T06:03:59.326101+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T06:03:59.326101+0000","last_undegraded":"2024-03-25T06:03:59.326101+0000","last_fullsized":"2024-03-25T06:03:59.326101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":2586,"log_dups_size":0,"ondisk_log_size":2586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2604,"num_write_kb":18105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'6139","reported_seq":6464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:03.896407+0000","last_change":"2024-03-25T05:37:35.460845+0000","last_active":"2024-03-25T06:04:03.896407+0000","last_peered":"2024-03-25T06:04:03.896407+0000","last_clean":"2024-03-25T06:04:03.896407+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T06:04:03.896407+0000","last_undegraded":"2024-03-25T06:04:03.896407+0000","last_fullsized":"2024-03-25T06:04:03.896407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6139,"log_dups_size":0,"ondisk_log_size":6139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":74168,"num_write":4312,"num_write_kb":103632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1674","reported_seq":1710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.173094+0000","last_change":"2024-03-25T05:37:31.191124+0000","last_active":"2024-03-25T06:03:59.173094+0000","last_peered":"2024-03-25T06:03:59.173094+0000","last_clean":"2024-03-25T06:03:59.173094+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T06:03:59.173094+0000","last_undegraded":"2024-03-25T06:03:59.173094+0000","last_fullsized":"2024-03-25T06:03:59.173094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:20:21.673851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3093","reported_seq":3131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.736192+0000","last_change":"2024-03-25T05:37:30.403987+0000","last_active":"2024-03-25T06:03:54.736192+0000","last_peered":"2024-03-25T06:03:54.736192+0000","last_clean":"2024-03-25T06:03:54.736192+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T06:03:54.736192+0000","last_undegraded":"2024-03-25T06:03:54.736192+0000","last_fullsized":"2024-03-25T06:03:54.736192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":3093,"log_dups_size":0,"ondisk_log_size":3093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195287,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3110,"num_write_kb":22545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'6007","reported_seq":6456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.510717+0000","last_change":"2024-03-25T05:37:35.926778+0000","last_active":"2024-03-25T06:03:59.510717+0000","last_peered":"2024-03-25T06:03:59.510717+0000","last_clean":"2024-03-25T06:03:59.510717+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T06:03:59.510717+0000","last_undegraded":"2024-03-25T06:03:59.510717+0000","last_fullsized":"2024-03-25T06:03:59.510717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6007,"log_dups_size":0,"ondisk_log_size":6007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":105918,"num_write":4139,"num_write_kb":116235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1748","reported_seq":1785,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.502802+0000","last_change":"2024-03-25T05:37:31.147750+0000","last_active":"2024-03-25T06:03:59.502802+0000","last_peered":"2024-03-25T06:03:59.502802+0000","last_clean":"2024-03-25T06:03:59.502802+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T06:03:59.502802+0000","last_undegraded":"2024-03-25T06:03:59.502802+0000","last_fullsized":"2024-03-25T06:03:59.502802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'848","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.742196+0000","last_change":"2024-03-25T05:37:30.428288+0000","last_active":"2024-03-25T06:03:54.742196+0000","last_peered":"2024-03-25T06:03:54.742196+0000","last_clean":"2024-03-25T06:03:54.742196+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T06:03:54.742196+0000","last_undegraded":"2024-03-25T06:03:54.742196+0000","last_fullsized":"2024-03-25T06:03:54.742196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":860,"num_write_kb":8739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5773","reported_seq":6004,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.680109+0000","last_change":"2024-03-25T05:37:35.929427+0000","last_active":"2024-03-25T06:03:59.680109+0000","last_peered":"2024-03-25T06:03:59.680109+0000","last_clean":"2024-03-25T06:03:59.680109+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T06:03:59.680109+0000","last_undegraded":"2024-03-25T06:03:59.680109+0000","last_fullsized":"2024-03-25T06:03:59.680109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5773,"log_dups_size":0,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":50292,"num_write":4009,"num_write_kb":127285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1742","reported_seq":1787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.005580+0000","last_change":"2024-03-25T06:04:08.005623+0000","last_active":"2024-03-25T06:04:08.005580+0000","last_peered":"2024-03-25T06:04:08.005580+0000","last_clean":"2024-03-25T06:04:08.005580+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T06:04:08.005580+0000","last_undegraded":"2024-03-25T06:04:08.005580+0000","last_fullsized":"2024-03-25T06:04:08.005580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1742","last_scrub_stamp":"2024-03-25T06:04:08.005451+0000","last_deep_scrub":"27'1742","last_deep_scrub_stamp":"2024-03-25T06:04:08.005451+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.005451+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:29:02.307473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'3801","reported_seq":3848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:05.061122+0000","last_change":"2024-03-25T06:04:05.061187+0000","last_active":"2024-03-25T06:04:05.061122+0000","last_peered":"2024-03-25T06:04:05.061122+0000","last_clean":"2024-03-25T06:04:05.061122+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T06:04:05.061122+0000","last_undegraded":"2024-03-25T06:04:05.061122+0000","last_fullsized":"2024-03-25T06:04:05.061122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3801","last_scrub_stamp":"2024-03-25T06:04:05.061020+0000","last_deep_scrub":"27'3801","last_deep_scrub_stamp":"2024-03-25T06:04:05.061020+0000","last_clean_scrub_stamp":"2024-03-25T06:04:05.061020+0000","objects_scrubbed":8,"log_size":3801,"log_dups_size":0,"ondisk_log_size":3801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:17:35.585741+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3799,"num_write_kb":31202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5794","reported_seq":5879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:58.856074+0000","last_change":"2024-03-25T05:37:35.926332+0000","last_active":"2024-03-25T06:03:58.856074+0000","last_peered":"2024-03-25T06:03:58.856074+0000","last_clean":"2024-03-25T06:03:58.856074+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T06:03:58.856074+0000","last_undegraded":"2024-03-25T06:03:58.856074+0000","last_fullsized":"2024-03-25T06:03:58.856074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5794,"log_dups_size":0,"ondisk_log_size":5794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:57:51.589702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":13716,"num_write":3987,"num_write_kb":98792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1662","reported_seq":1698,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.247601+0000","last_change":"2024-03-25T05:37:31.162701+0000","last_active":"2024-03-25T06:03:59.247601+0000","last_peered":"2024-03-25T06:03:59.247601+0000","last_clean":"2024-03-25T06:03:59.247601+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T06:03:59.247601+0000","last_undegraded":"2024-03-25T06:03:59.247601+0000","last_fullsized":"2024-03-25T06:03:59.247601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:06.637751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'6620","reported_seq":7260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.317626+0000","last_change":"2024-03-25T05:37:30.427840+0000","last_active":"2024-03-25T06:03:59.317626+0000","last_peered":"2024-03-25T06:03:59.317626+0000","last_clean":"2024-03-25T06:03:59.317626+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T06:03:59.317626+0000","last_undegraded":"2024-03-25T06:03:59.317626+0000","last_fullsized":"2024-03-25T06:03:59.317626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6620,"log_dups_size":0,"ondisk_log_size":6620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15940780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":602,"num_read_kb":3810,"num_write":6631,"num_write_kb":48807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'6000","reported_seq":6243,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.645977+0000","last_change":"2024-03-25T05:37:35.473385+0000","last_active":"2024-03-25T06:03:59.645977+0000","last_peered":"2024-03-25T06:03:59.645977+0000","last_clean":"2024-03-25T06:03:59.645977+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T06:03:59.645977+0000","last_undegraded":"2024-03-25T06:03:59.645977+0000","last_fullsized":"2024-03-25T06:03:59.645977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6000,"log_dups_size":0,"ondisk_log_size":6000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":4195,"num_write_kb":128137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1718","reported_seq":1755,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.441302+0000","last_change":"2024-03-25T05:37:31.144049+0000","last_active":"2024-03-25T06:03:59.441302+0000","last_peered":"2024-03-25T06:03:59.441302+0000","last_clean":"2024-03-25T06:03:59.441302+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T06:03:59.441302+0000","last_undegraded":"2024-03-25T06:03:59.441302+0000","last_fullsized":"2024-03-25T06:03:59.441302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:32:32.845414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5365","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:04.583697+0000","last_change":"2024-03-25T05:37:30.425553+0000","last_active":"2024-03-25T06:04:04.583697+0000","last_peered":"2024-03-25T06:04:04.583697+0000","last_clean":"2024-03-25T06:04:04.583697+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T06:04:04.583697+0000","last_undegraded":"2024-03-25T06:04:04.583697+0000","last_fullsized":"2024-03-25T06:04:04.583697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5365,"log_dups_size":0,"ondisk_log_size":5365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5368,"num_write_kb":32642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'6005","reported_seq":6092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.529143+0000","last_change":"2024-03-25T05:37:35.464138+0000","last_active":"2024-03-25T06:03:59.529143+0000","last_peered":"2024-03-25T06:03:59.529143+0000","last_clean":"2024-03-25T06:03:59.529143+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T06:03:59.529143+0000","last_undegraded":"2024-03-25T06:03:59.529143+0000","last_fullsized":"2024-03-25T06:03:59.529143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6005,"log_dups_size":0,"ondisk_log_size":6005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:15:31.500320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":13970,"num_write":4188,"num_write_kb":117446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1734","reported_seq":1775,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.505757+0000","last_change":"2024-03-25T05:38:20.652289+0000","last_active":"2024-03-25T06:03:59.505757+0000","last_peered":"2024-03-25T06:03:59.505757+0000","last_clean":"2024-03-25T06:03:59.505757+0000","last_became_active":"2024-03-25T05:38:20.652007+0000","last_became_peered":"2024-03-25T05:38:20.652007+0000","last_unstale":"2024-03-25T06:03:59.505757+0000","last_undegraded":"2024-03-25T06:03:59.505757+0000","last_fullsized":"2024-03-25T06:03:59.505757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1734,"log_dups_size":0,"ondisk_log_size":1734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5604","reported_seq":5643,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.703306+0000","last_change":"2024-03-25T05:37:30.409261+0000","last_active":"2024-03-25T06:03:54.703306+0000","last_peered":"2024-03-25T06:03:54.703306+0000","last_clean":"2024-03-25T06:03:54.703306+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T06:03:54.703306+0000","last_undegraded":"2024-03-25T06:03:54.703306+0000","last_fullsized":"2024-03-25T06:03:54.703306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:37:57.671734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5607,"num_write_kb":40642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5713","reported_seq":6165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.745423+0000","last_change":"2024-03-25T05:37:35.463879+0000","last_active":"2024-03-25T06:03:59.745423+0000","last_peered":"2024-03-25T06:03:59.745423+0000","last_clean":"2024-03-25T06:03:59.745423+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T06:03:59.745423+0000","last_undegraded":"2024-03-25T06:03:59.745423+0000","last_fullsized":"2024-03-25T06:03:59.745423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5713,"log_dups_size":0,"ondisk_log_size":5713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":106426,"num_write":4014,"num_write_kb":116763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1704","reported_seq":1740,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.799163+0000","last_change":"2024-03-25T05:37:31.146062+0000","last_active":"2024-03-25T06:03:59.799163+0000","last_peered":"2024-03-25T06:03:59.799163+0000","last_clean":"2024-03-25T06:03:59.799163+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T06:03:59.799163+0000","last_undegraded":"2024-03-25T06:03:59.799163+0000","last_fullsized":"2024-03-25T06:03:59.799163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1704,"log_dups_size":0,"ondisk_log_size":1704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4519","reported_seq":5358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.053590+0000","last_change":"2024-03-25T05:37:30.407743+0000","last_active":"2024-03-25T06:03:59.053590+0000","last_peered":"2024-03-25T06:03:59.053590+0000","last_clean":"2024-03-25T06:03:59.053590+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T06:03:59.053590+0000","last_undegraded":"2024-03-25T06:03:59.053590+0000","last_fullsized":"2024-03-25T06:03:59.053590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:25:22.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":802,"num_read_kb":4614,"num_write":4526,"num_write_kb":35760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6267","reported_seq":6663,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.783728+0000","last_change":"2024-03-25T05:37:35.926441+0000","last_active":"2024-03-25T06:03:59.783728+0000","last_peered":"2024-03-25T06:03:59.783728+0000","last_clean":"2024-03-25T06:03:59.783728+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T06:03:59.783728+0000","last_undegraded":"2024-03-25T06:03:59.783728+0000","last_fullsized":"2024-03-25T06:03:59.783728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6267,"log_dups_size":0,"ondisk_log_size":6267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":92202,"num_write":4370,"num_write_kb":119524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5994","reported_seq":6093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.818934+0000","last_change":"2024-03-25T05:37:35.929512+0000","last_active":"2024-03-25T06:03:59.818934+0000","last_peered":"2024-03-25T06:03:59.818934+0000","last_clean":"2024-03-25T06:03:59.818934+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T06:03:59.818934+0000","last_undegraded":"2024-03-25T06:03:59.818934+0000","last_fullsized":"2024-03-25T06:03:59.818934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":5994,"log_dups_size":0,"ondisk_log_size":5994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":4233,"num_write_kb":107763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1683","reported_seq":1720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.797233+0000","last_change":"2024-03-25T05:37:31.169203+0000","last_active":"2024-03-25T06:03:59.797233+0000","last_peered":"2024-03-25T06:03:59.797233+0000","last_clean":"2024-03-25T06:03:59.797233+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T06:03:59.797233+0000","last_undegraded":"2024-03-25T06:03:59.797233+0000","last_fullsized":"2024-03-25T06:03:59.797233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'8146","reported_seq":8185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.738573+0000","last_change":"2024-03-25T05:37:30.409896+0000","last_active":"2024-03-25T06:03:54.738573+0000","last_peered":"2024-03-25T06:03:54.738573+0000","last_clean":"2024-03-25T06:03:54.738573+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T06:03:54.738573+0000","last_undegraded":"2024-03-25T06:03:54.738573+0000","last_fullsized":"2024-03-25T06:03:54.738573+0000","mapping_epoch":17,"log_start":"27'600","ondisk_log_start":"27'600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7546,"log_dups_size":0,"ondisk_log_size":7546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:04.106249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8142,"num_write_kb":58721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'6008","reported_seq":6330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.380546+0000","last_change":"2024-03-25T05:37:35.454849+0000","last_active":"2024-03-25T06:03:59.380546+0000","last_peered":"2024-03-25T06:03:59.380546+0000","last_clean":"2024-03-25T06:03:59.380546+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T06:03:59.380546+0000","last_undegraded":"2024-03-25T06:03:59.380546+0000","last_fullsized":"2024-03-25T06:03:59.380546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6008,"log_dups_size":0,"ondisk_log_size":6008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:43.172229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":73406,"num_write":4233,"num_write_kb":113322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1753","reported_seq":1789,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.411345+0000","last_change":"2024-03-25T05:37:31.171613+0000","last_active":"2024-03-25T06:03:59.411345+0000","last_peered":"2024-03-25T06:03:59.411345+0000","last_clean":"2024-03-25T06:03:59.411345+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T06:03:59.411345+0000","last_undegraded":"2024-03-25T06:03:59.411345+0000","last_fullsized":"2024-03-25T06:03:59.411345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1753,"log_dups_size":0,"ondisk_log_size":1753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4099","reported_seq":4137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.687834+0000","last_change":"2024-03-25T05:37:30.420899+0000","last_active":"2024-03-25T06:03:54.687834+0000","last_peered":"2024-03-25T06:03:54.687834+0000","last_clean":"2024-03-25T06:03:54.687834+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T06:03:54.687834+0000","last_undegraded":"2024-03-25T06:03:54.687834+0000","last_fullsized":"2024-03-25T06:03:54.687834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":4099,"log_dups_size":0,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4095,"num_write_kb":35371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7947","reported_seq":7984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:54.659082+0000","last_change":"2024-03-25T05:37:30.404080+0000","last_active":"2024-03-25T06:03:54.659082+0000","last_peered":"2024-03-25T06:03:54.659082+0000","last_clean":"2024-03-25T06:03:54.659082+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T06:03:54.659082+0000","last_undegraded":"2024-03-25T06:03:54.659082+0000","last_fullsized":"2024-03-25T06:03:54.659082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":7947,"log_dups_size":0,"ondisk_log_size":7947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:53.004837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7943,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1690","reported_seq":1726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.517830+0000","last_change":"2024-03-25T05:37:31.158230+0000","last_active":"2024-03-25T06:03:59.517830+0000","last_peered":"2024-03-25T06:03:59.517830+0000","last_clean":"2024-03-25T06:03:59.517830+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T06:03:59.517830+0000","last_undegraded":"2024-03-25T06:03:59.517830+0000","last_fullsized":"2024-03-25T06:03:59.517830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'6118","reported_seq":6231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.531619+0000","last_change":"2024-03-25T05:37:35.466729+0000","last_active":"2024-03-25T06:03:59.531619+0000","last_peered":"2024-03-25T06:03:59.531619+0000","last_clean":"2024-03-25T06:03:59.531619+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T06:03:59.531619+0000","last_undegraded":"2024-03-25T06:03:59.531619+0000","last_fullsized":"2024-03-25T06:03:59.531619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6118,"log_dups_size":0,"ondisk_log_size":6118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":4277,"num_write_kb":113266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6309","reported_seq":6347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.060000+0000","last_change":"2024-03-25T05:37:30.428753+0000","last_active":"2024-03-25T06:03:59.060000+0000","last_peered":"2024-03-25T06:03:59.060000+0000","last_clean":"2024-03-25T06:03:59.060000+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T06:03:59.060000+0000","last_undegraded":"2024-03-25T06:03:59.060000+0000","last_fullsized":"2024-03-25T06:03:59.060000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:29.379498+0000","last_clean_scrub_stamp":"2024-03-25T05:37:29.379498+0000","objects_scrubbed":0,"log_size":6309,"log_dups_size":0,"ondisk_log_size":6309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166841,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6301,"num_write_kb":53214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1724","reported_seq":1760,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.330075+0000","last_change":"2024-03-25T05:37:31.160670+0000","last_active":"2024-03-25T06:03:59.330075+0000","last_peered":"2024-03-25T06:03:59.330075+0000","last_clean":"2024-03-25T06:03:59.330075+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T06:03:59.330075+0000","last_undegraded":"2024-03-25T06:03:59.330075+0000","last_fullsized":"2024-03-25T06:03:59.330075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:23:05.113800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'6483","reported_seq":6977,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.776121+0000","last_change":"2024-03-25T05:37:35.464884+0000","last_active":"2024-03-25T06:03:59.776121+0000","last_peered":"2024-03-25T06:03:59.776121+0000","last_clean":"2024-03-25T06:03:59.776121+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T06:03:59.776121+0000","last_undegraded":"2024-03-25T06:03:59.776121+0000","last_fullsized":"2024-03-25T06:03:59.776121+0000","mapping_epoch":22,"log_start":"27'200","ondisk_log_start":"27'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6283,"log_dups_size":0,"ondisk_log_size":6283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":117348,"num_write":4686,"num_write_kb":179694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1680","reported_seq":1717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.607676+0000","last_change":"2024-03-25T05:37:31.191636+0000","last_active":"2024-03-25T06:03:59.607676+0000","last_peered":"2024-03-25T06:03:59.607676+0000","last_clean":"2024-03-25T06:03:59.607676+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T06:03:59.607676+0000","last_undegraded":"2024-03-25T06:03:59.607676+0000","last_fullsized":"2024-03-25T06:03:59.607676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:01:43.409989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1763","reported_seq":1807,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.227947+0000","last_change":"2024-03-25T05:38:20.652638+0000","last_active":"2024-03-25T06:03:59.227947+0000","last_peered":"2024-03-25T06:03:59.227947+0000","last_clean":"2024-03-25T06:03:59.227947+0000","last_became_active":"2024-03-25T05:38:20.652189+0000","last_became_peered":"2024-03-25T05:38:20.652189+0000","last_unstale":"2024-03-25T06:03:59.227947+0000","last_undegraded":"2024-03-25T06:03:59.227947+0000","last_fullsized":"2024-03-25T06:03:59.227947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1678","reported_seq":1716,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.188794+0000","last_change":"2024-03-25T05:37:31.164190+0000","last_active":"2024-03-25T06:03:59.188794+0000","last_peered":"2024-03-25T06:03:59.188794+0000","last_clean":"2024-03-25T06:03:59.188794+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T06:03:59.188794+0000","last_undegraded":"2024-03-25T06:03:59.188794+0000","last_fullsized":"2024-03-25T06:03:59.188794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:03:43.924391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1791","reported_seq":1837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:03.973415+0000","last_change":"2024-03-25T06:04:03.973454+0000","last_active":"2024-03-25T06:04:03.973415+0000","last_peered":"2024-03-25T06:04:03.973415+0000","last_clean":"2024-03-25T06:04:03.973415+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T06:04:03.973415+0000","last_undegraded":"2024-03-25T06:04:03.973415+0000","last_fullsized":"2024-03-25T06:04:03.973415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1791","last_scrub_stamp":"2024-03-25T06:04:03.973299+0000","last_deep_scrub":"27'1791","last_deep_scrub_stamp":"2024-03-25T06:04:03.973299+0000","last_clean_scrub_stamp":"2024-03-25T06:04:03.973299+0000","objects_scrubbed":0,"log_size":1791,"log_dups_size":0,"ondisk_log_size":1791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:45:41.687046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1719","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.248015+0000","last_change":"2024-03-25T05:37:31.165312+0000","last_active":"2024-03-25T06:03:59.248015+0000","last_peered":"2024-03-25T06:03:59.248015+0000","last_clean":"2024-03-25T06:03:59.248015+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T06:03:59.248015+0000","last_undegraded":"2024-03-25T06:03:59.248015+0000","last_fullsized":"2024-03-25T06:03:59.248015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1678","reported_seq":1725,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:05.246842+0000","last_change":"2024-03-25T06:04:05.246883+0000","last_active":"2024-03-25T06:04:05.246842+0000","last_peered":"2024-03-25T06:04:05.246842+0000","last_clean":"2024-03-25T06:04:05.246842+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T06:04:05.246842+0000","last_undegraded":"2024-03-25T06:04:05.246842+0000","last_fullsized":"2024-03-25T06:04:05.246842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1678","last_scrub_stamp":"2024-03-25T06:04:05.246731+0000","last_deep_scrub":"27'1678","last_deep_scrub_stamp":"2024-03-25T06:04:05.246731+0000","last_clean_scrub_stamp":"2024-03-25T06:04:05.246731+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:50.340593+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1768","reported_seq":1805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.886277+0000","last_change":"2024-03-25T05:37:31.192741+0000","last_active":"2024-03-25T06:03:59.886277+0000","last_peered":"2024-03-25T06:03:59.886277+0000","last_clean":"2024-03-25T06:03:59.886277+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T06:03:59.886277+0000","last_undegraded":"2024-03-25T06:03:59.886277+0000","last_fullsized":"2024-03-25T06:03:59.886277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1715","reported_seq":1753,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.463969+0000","last_change":"2024-03-25T05:37:31.165075+0000","last_active":"2024-03-25T06:03:59.463969+0000","last_peered":"2024-03-25T06:03:59.463969+0000","last_clean":"2024-03-25T06:03:59.463969+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T06:03:59.463969+0000","last_undegraded":"2024-03-25T06:03:59.463969+0000","last_fullsized":"2024-03-25T06:03:59.463969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1695","reported_seq":1733,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.331318+0000","last_change":"2024-03-25T05:37:31.167101+0000","last_active":"2024-03-25T06:03:59.331318+0000","last_peered":"2024-03-25T06:03:59.331318+0000","last_clean":"2024-03-25T06:03:59.331318+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T06:03:59.331318+0000","last_undegraded":"2024-03-25T06:03:59.331318+0000","last_fullsized":"2024-03-25T06:03:59.331318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:48:55.939477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1732","reported_seq":1769,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.797630+0000","last_change":"2024-03-25T05:37:31.163266+0000","last_active":"2024-03-25T06:03:59.797630+0000","last_peered":"2024-03-25T06:03:59.797630+0000","last_clean":"2024-03-25T06:03:59.797630+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T06:03:59.797630+0000","last_undegraded":"2024-03-25T06:03:59.797630+0000","last_fullsized":"2024-03-25T06:03:59.797630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1733","reported_seq":1770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.391998+0000","last_change":"2024-03-25T05:37:31.144788+0000","last_active":"2024-03-25T06:03:59.391998+0000","last_peered":"2024-03-25T06:03:59.391998+0000","last_clean":"2024-03-25T06:03:59.391998+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T06:03:59.391998+0000","last_undegraded":"2024-03-25T06:03:59.391998+0000","last_fullsized":"2024-03-25T06:03:59.391998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:24:36.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1758","reported_seq":1795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.714749+0000","last_change":"2024-03-25T05:37:31.157566+0000","last_active":"2024-03-25T06:03:59.714749+0000","last_peered":"2024-03-25T06:03:59.714749+0000","last_clean":"2024-03-25T06:03:59.714749+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T06:03:59.714749+0000","last_undegraded":"2024-03-25T06:03:59.714749+0000","last_fullsized":"2024-03-25T06:03:59.714749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1731","reported_seq":1767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.521027+0000","last_change":"2024-03-25T05:37:31.191634+0000","last_active":"2024-03-25T06:03:59.521027+0000","last_peered":"2024-03-25T06:03:59.521027+0000","last_clean":"2024-03-25T06:03:59.521027+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T06:03:59.521027+0000","last_undegraded":"2024-03-25T06:03:59.521027+0000","last_fullsized":"2024-03-25T06:03:59.521027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:40:51.062010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1775","reported_seq":1812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.634570+0000","last_change":"2024-03-25T05:37:31.171882+0000","last_active":"2024-03-25T06:03:59.634570+0000","last_peered":"2024-03-25T06:03:59.634570+0000","last_clean":"2024-03-25T06:03:59.634570+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T06:03:59.634570+0000","last_undegraded":"2024-03-25T06:03:59.634570+0000","last_fullsized":"2024-03-25T06:03:59.634570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1775,"log_dups_size":0,"ondisk_log_size":1775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T05:46:44.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1682","reported_seq":1720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.439768+0000","last_change":"2024-03-25T05:37:31.197195+0000","last_active":"2024-03-25T06:03:59.439768+0000","last_peered":"2024-03-25T06:03:59.439768+0000","last_clean":"2024-03-25T06:03:59.439768+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T06:03:59.439768+0000","last_undegraded":"2024-03-25T06:03:59.439768+0000","last_fullsized":"2024-03-25T06:03:59.439768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1682,"log_dups_size":0,"ondisk_log_size":1682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1721","reported_seq":1758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.194809+0000","last_change":"2024-03-25T05:37:31.142301+0000","last_active":"2024-03-25T06:03:59.194809+0000","last_peered":"2024-03-25T06:03:59.194809+0000","last_clean":"2024-03-25T06:03:59.194809+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T06:03:59.194809+0000","last_undegraded":"2024-03-25T06:03:59.194809+0000","last_fullsized":"2024-03-25T06:03:59.194809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:39.147676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'1641","reported_seq":1678,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.193839+0000","last_change":"2024-03-25T05:37:31.155103+0000","last_active":"2024-03-25T06:03:59.193839+0000","last_peered":"2024-03-25T06:03:59.193839+0000","last_clean":"2024-03-25T06:03:59.193839+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T06:03:59.193839+0000","last_undegraded":"2024-03-25T06:03:59.193839+0000","last_fullsized":"2024-03-25T06:03:59.193839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1641,"log_dups_size":0,"ondisk_log_size":1641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'1764","reported_seq":1807,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.787167+0000","last_change":"2024-03-25T05:38:20.652965+0000","last_active":"2024-03-25T06:03:59.787167+0000","last_peered":"2024-03-25T06:03:59.787167+0000","last_clean":"2024-03-25T06:03:59.787167+0000","last_became_active":"2024-03-25T05:38:20.652582+0000","last_became_peered":"2024-03-25T05:38:20.652582+0000","last_unstale":"2024-03-25T06:03:59.787167+0000","last_undegraded":"2024-03-25T06:03:59.787167+0000","last_fullsized":"2024-03-25T06:03:59.787167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1705","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.666458+0000","last_change":"2024-03-25T05:37:31.163799+0000","last_active":"2024-03-25T06:03:59.666458+0000","last_peered":"2024-03-25T06:03:59.666458+0000","last_clean":"2024-03-25T06:03:59.666458+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T06:03:59.666458+0000","last_undegraded":"2024-03-25T06:03:59.666458+0000","last_fullsized":"2024-03-25T06:03:59.666458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1692","reported_seq":1729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.060726+0000","last_change":"2024-03-25T05:37:31.197550+0000","last_active":"2024-03-25T06:04:06.060726+0000","last_peered":"2024-03-25T06:04:06.060726+0000","last_clean":"2024-03-25T06:04:06.060726+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T06:04:06.060726+0000","last_undegraded":"2024-03-25T06:04:06.060726+0000","last_fullsized":"2024-03-25T06:04:06.060726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1623","reported_seq":1659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.174463+0000","last_change":"2024-03-25T05:37:31.191979+0000","last_active":"2024-03-25T06:03:59.174463+0000","last_peered":"2024-03-25T06:03:59.174463+0000","last_clean":"2024-03-25T06:03:59.174463+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T06:03:59.174463+0000","last_undegraded":"2024-03-25T06:03:59.174463+0000","last_fullsized":"2024-03-25T06:03:59.174463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1623,"log_dups_size":0,"ondisk_log_size":1623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:34:15.749700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1678","reported_seq":1713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.195629+0000","last_change":"2024-03-25T05:37:31.191330+0000","last_active":"2024-03-25T06:03:59.195629+0000","last_peered":"2024-03-25T06:03:59.195629+0000","last_clean":"2024-03-25T06:03:59.195629+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T06:03:59.195629+0000","last_undegraded":"2024-03-25T06:03:59.195629+0000","last_fullsized":"2024-03-25T06:03:59.195629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:38:31.884689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1750","reported_seq":1785,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.824400+0000","last_change":"2024-03-25T05:37:31.192943+0000","last_active":"2024-03-25T06:03:59.824400+0000","last_peered":"2024-03-25T06:03:59.824400+0000","last_clean":"2024-03-25T06:03:59.824400+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T06:03:59.824400+0000","last_undegraded":"2024-03-25T06:03:59.824400+0000","last_fullsized":"2024-03-25T06:03:59.824400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:26.166975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1767","reported_seq":1803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.474589+0000","last_change":"2024-03-25T05:37:31.147854+0000","last_active":"2024-03-25T06:03:59.474589+0000","last_peered":"2024-03-25T06:03:59.474589+0000","last_clean":"2024-03-25T06:03:59.474589+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T06:03:59.474589+0000","last_undegraded":"2024-03-25T06:03:59.474589+0000","last_fullsized":"2024-03-25T06:03:59.474589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1703","reported_seq":1739,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.404427+0000","last_change":"2024-03-25T05:37:31.167203+0000","last_active":"2024-03-25T06:03:59.404427+0000","last_peered":"2024-03-25T06:03:59.404427+0000","last_clean":"2024-03-25T06:03:59.404427+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T06:03:59.404427+0000","last_undegraded":"2024-03-25T06:03:59.404427+0000","last_fullsized":"2024-03-25T06:03:59.404427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1680","reported_seq":1701,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.771379+0000","last_change":"2024-03-25T05:38:20.655980+0000","last_active":"2024-03-25T06:03:59.771379+0000","last_peered":"2024-03-25T06:03:59.771379+0000","last_clean":"2024-03-25T06:03:59.771379+0000","last_became_active":"2024-03-25T05:38:20.655743+0000","last_became_peered":"2024-03-25T05:38:20.655743+0000","last_unstale":"2024-03-25T06:03:59.771379+0000","last_undegraded":"2024-03-25T06:03:59.771379+0000","last_fullsized":"2024-03-25T06:03:59.771379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1655","reported_seq":1691,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.197911+0000","last_change":"2024-03-25T05:37:31.155104+0000","last_active":"2024-03-25T06:03:59.197911+0000","last_peered":"2024-03-25T06:03:59.197911+0000","last_clean":"2024-03-25T06:03:59.197911+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T06:03:59.197911+0000","last_undegraded":"2024-03-25T06:03:59.197911+0000","last_fullsized":"2024-03-25T06:03:59.197911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:35:42.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1748","reported_seq":1784,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.174517+0000","last_change":"2024-03-25T05:37:31.172101+0000","last_active":"2024-03-25T06:03:59.174517+0000","last_peered":"2024-03-25T06:03:59.174517+0000","last_clean":"2024-03-25T06:03:59.174517+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T06:03:59.174517+0000","last_undegraded":"2024-03-25T06:03:59.174517+0000","last_fullsized":"2024-03-25T06:03:59.174517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:56:18.958773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1743","reported_seq":1782,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.237899+0000","last_change":"2024-03-25T05:37:31.167051+0000","last_active":"2024-03-25T06:03:59.237899+0000","last_peered":"2024-03-25T06:03:59.237899+0000","last_clean":"2024-03-25T06:03:59.237899+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T06:03:59.237899+0000","last_undegraded":"2024-03-25T06:03:59.237899+0000","last_fullsized":"2024-03-25T06:03:59.237899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:26:32.298571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1793","reported_seq":1831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.660348+0000","last_change":"2024-03-25T05:37:31.173417+0000","last_active":"2024-03-25T06:03:59.660348+0000","last_peered":"2024-03-25T06:03:59.660348+0000","last_clean":"2024-03-25T06:03:59.660348+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T06:03:59.660348+0000","last_undegraded":"2024-03-25T06:03:59.660348+0000","last_fullsized":"2024-03-25T06:03:59.660348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1658","reported_seq":1697,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.405144+0000","last_change":"2024-03-25T05:37:31.168400+0000","last_active":"2024-03-25T06:03:59.405144+0000","last_peered":"2024-03-25T06:03:59.405144+0000","last_clean":"2024-03-25T06:03:59.405144+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T06:03:59.405144+0000","last_undegraded":"2024-03-25T06:03:59.405144+0000","last_fullsized":"2024-03-25T06:03:59.405144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1658,"log_dups_size":0,"ondisk_log_size":1658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1640","reported_seq":1678,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.211848+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T06:03:59.211848+0000","last_peered":"2024-03-25T06:03:59.211848+0000","last_clean":"2024-03-25T06:03:59.211848+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T06:03:59.211848+0000","last_undegraded":"2024-03-25T06:03:59.211848+0000","last_fullsized":"2024-03-25T06:03:59.211848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:34:18.714911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5893,"num_read_kb":1496822,"num_write":138342,"num_write_kb":3815118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195984,"ondisk_log_size":195984,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110026,"ondisk_log_size":110026,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":234052195,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":2370,"num_read_kb":13152,"num_write":159060,"num_write_kb":1157060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":312401920,"data_stored":468104390,"data_compressed":49584516,"data_compressed_allocated":73408512,"data_compressed_original":229359616,"omap_allocated":0,"internal_metadata":0},"log_size":154485,"ondisk_log_size":154485,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575170,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":762648,"kb_used_data":37392,"kb_used_omap":1,"kb_used_meta":725246,"kb_avail":93609192,"statfs":{"total":96636764160,"available":95855812608,"internally_reserved":0,"allocated":38289408,"data_stored":59434799,"data_compressed":6535216,"data_compressed_allocated":9568256,"data_compressed_original":30920704,"omap_allocated":1590,"internal_metadata":742652362},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":832216,"kb_used_data":47376,"kb_used_omap":1,"kb_used_meta":784830,"kb_avail":93539624,"statfs":{"total":96636764160,"available":95784574976,"internally_reserved":0,"allocated":48513024,"data_stored":74783901,"data_compressed":8150968,"data_compressed_allocated":11956224,"data_compressed_original":38424576,"omap_allocated":1594,"internal_metadata":803666374},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":797816,"kb_used_data":40624,"kb_used_omap":1,"kb_used_meta":757182,"kb_avail":93574024,"statfs":{"total":96636764160,"available":95819800576,"internally_reserved":0,"allocated":41598976,"data_stored":58846263,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":1595,"internal_metadata":775354821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575170,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":721680,"kb_used_data":36680,"kb_used_omap":1,"kb_used_meta":684990,"kb_avail":93650160,"statfs":{"total":96636764160,"available":95897763840,"internally_reserved":0,"allocated":37560320,"data_stored":54649357,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":1595,"internal_metadata":701430213},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575168,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":850456,"kb_used_data":57360,"kb_used_omap":1,"kb_used_meta":793086,"kb_avail":93521384,"statfs":{"total":96636764160,"available":95765897216,"internally_reserved":0,"allocated":58736640,"data_stored":91561151,"data_compressed":9984239,"data_compressed_allocated":14540800,"data_compressed_original":47566848,"omap_allocated":1593,"internal_metadata":812120519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457036,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":428094,"kb_avail":93914804,"statfs":{"total":96636764160,"available":96168759296,"internally_reserved":0,"allocated":29626368,"data_stored":42066577,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":1595,"internal_metadata":438368709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575169,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":882164,"kb_used_data":30700,"kb_used_omap":1,"kb_used_meta":851454,"kb_avail":93489676,"statfs":{"total":96636764160,"available":95733428224,"internally_reserved":0,"allocated":31436800,"data_stored":46260556,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":1595,"internal_metadata":871889349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":573192,"kb_used_data":28416,"kb_used_omap":1,"kb_used_meta":544766,"kb_avail":93798648,"statfs":{"total":96636764160,"available":96049815552,"internally_reserved":0,"allocated":29097984,"data_stored":42655962,"data_compressed":4366242,"data_compressed_allocated":6533120,"data_compressed_original":20291584,"omap_allocated":1595,"internal_metadata":557840837},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28741632,"data_stored":41943914,"data_compressed":4333814,"data_compressed_allocated":6488064,"data_compressed_original":19718144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31145984,"data_stored":46138876,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29335552,"data_stored":41944897,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58445824,"data_stored":91439471,"data_compressed":9984239,"data_compressed_allocated":14540800,"data_compressed_original":47566848,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37269504,"data_stored":54527677,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41308160,"data_stored":58724583,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48222208,"data_stored":74662221,"data_compressed":8150968,"data_compressed_allocated":11956224,"data_compressed_original":38424576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37933056,"data_stored":58722751,"data_compressed":6502788,"data_compressed_allocated":9523200,"data_compressed_original":30347264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T06:04:09.840 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.840 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.840 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.841 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.842 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.843 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.844 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-25T05:37:25.864676+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=25, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.845 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.846 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.847 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.848 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.849 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-25T05:37:29.379498+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=29, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.850 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.851 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.852 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.853 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.853 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.853 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.853 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.853 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:09.853 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-25T06:04:29.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T06:04:30.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.033+0000 7fb385400640 1 Processor -- start 2024-03-25T06:04:30.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.033+0000 7fb385400640 1 -- start start 2024-03-25T06:04:30.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb385400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:30.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb385400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb3800c67e0 0x7fb3800cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:30.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb385400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3800cbbe0 con 0x7fb3800c6c10 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb385400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb380154500 con 0x7fb3800c67e0 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb385400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38006b250 con 0x7fb380154120 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb37fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb37f400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb3800c67e0 0x7fb3800cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb384a00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb3800c6c10 0x7fb3800c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:45760/0 (socket says 172.21.15.102:45760) 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb37fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:48148/0 (socket says 172.21.15.102:48148) 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.034+0000 7fb384a00640 1 -- 172.21.15.102:0/343652749 learned_addr learned my addr 172.21.15.102:0/343652749 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:30.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.035+0000 7fb37fe00640 1 -- 172.21.15.102:0/343652749 >> v2:172.21.15.187:3300/0 conn(0x7fb3800c67e0 msgr2=0x7fb3800cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:30.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.035+0000 7fb37fe00640 1 --2- 172.21.15.102:0/343652749 >> v2:172.21.15.187:3300/0 conn(0x7fb3800c67e0 0x7fb3800cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.035+0000 7fb37fe00640 1 -- 172.21.15.102:0/343652749 >> v1:172.21.15.187:6789/0 conn(0x7fb3800c6c10 legacy=0x7fb3800c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:30.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.035+0000 7fb37fe00640 1 -- 172.21.15.102:0/343652749 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800ca280 con 0x7fb380154120 2024-03-25T06:04:30.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.036+0000 7fb37fe00640 1 --2- 172.21.15.102:0/343652749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800cb000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3700097a0 tx=0x7fb37002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=723adc8f23e2abc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:30.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.036+0000 7fb37ea00640 1 -- 172.21.15.102:0/343652749 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37002d040 con 0x7fb380154120 2024-03-25T06:04:30.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb37ea00640 1 -- 172.21.15.102:0/343652749 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb370031810 con 0x7fb380154120 2024-03-25T06:04:30.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb37ea00640 1 -- 172.21.15.102:0/343652749 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370031ba0 con 0x7fb380154120 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb385400640 1 -- 172.21.15.102:0/343652749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 msgr2=0x7fb3800cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb385400640 1 --2- 172.21.15.102:0/343652749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800cb000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3700097a0 tx=0x7fb37002b8b0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb385400640 1 -- 172.21.15.102:0/343652749 shutdown_connections 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb385400640 1 --2- 172.21.15.102:0/343652749 >> v2:172.21.15.187:3300/0 conn(0x7fb3800c67e0 0x7fb3800cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb385400640 1 --2- 172.21.15.102:0/343652749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800cb000 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb385400640 1 -- 172.21.15.102:0/343652749 >> 172.21.15.102:0/343652749 conn(0x7fb3800cf3e0 msgr2=0x7fb3800cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.037+0000 7fb385400640 1 -- 172.21.15.102:0/343652749 shutdown_connections 2024-03-25T06:04:30.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.038+0000 7fb385400640 1 -- 172.21.15.102:0/343652749 wait complete. 2024-03-25T06:04:30.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.040+0000 7fb385400640 1 Processor -- start 2024-03-25T06:04:30.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.040+0000 7fb385400640 1 -- start start 2024-03-25T06:04:30.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb385400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3800c67e0 0x7fb3801efa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:30.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb385400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3800c6c10 0x7fb38014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb385400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb385400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3801e2150 con 0x7fb3800c6c10 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb385400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb380150110 con 0x7fb3800c67e0 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb385400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38014f1d0 con 0x7fb380154120 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3800c67e0 0x7fb3801efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3800c67e0 0x7fb3801efa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:51664/0 (socket says 172.21.15.102:51664) 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37fe00640 1 -- 172.21.15.102:0/4120854611 learned_addr learned my addr 172.21.15.102:0/4120854611 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb384a00640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37f400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3800c6c10 0x7fb38014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37fe00640 1 -- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 msgr2=0x7fb3800c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37fe00640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37fe00640 1 -- 172.21.15.102:0/4120854611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3800c6c10 msgr2=0x7fb38014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:30.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.042+0000 7fb37fe00640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3800c6c10 0x7fb38014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb37fe00640 1 -- 172.21.15.102:0/4120854611 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370009400 con 0x7fb3800c67e0 2024-03-25T06:04:30.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb384a00640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:30.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb37fe00640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3800c67e0 0x7fb3801efa00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb370000c00 tx=0x7fb3700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:30.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb377e00640 1 -- 172.21.15.102:0/4120854611 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370006e10 con 0x7fb3800c67e0 2024-03-25T06:04:30.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb377e00640 1 -- 172.21.15.102:0/4120854611 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37003ad60 con 0x7fb3800c67e0 2024-03-25T06:04:30.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb377e00640 1 -- 172.21.15.102:0/4120854611 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370044630 con 0x7fb3800c67e0 2024-03-25T06:04:30.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38014e650 con 0x7fb3800c67e0 2024-03-25T06:04:30.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.043+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38014ec10 con 0x7fb3800c67e0 2024-03-25T06:04:30.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.045+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3800ca770 con 0x7fb3800c67e0 2024-03-25T06:04:30.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.046+0000 7fb377e00640 1 -- 172.21.15.102:0/4120854611 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb37004d450 con 0x7fb3800c67e0 2024-03-25T06:04:30.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.048+0000 7fb377e00640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb36006b810 0x7fb36006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:30.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.048+0000 7fb377e00640 1 -- 172.21.15.102:0/4120854611 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb3700ac8c0 con 0x7fb3800c67e0 2024-03-25T06:04:30.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.048+0000 7fb37f400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb36006b810 0x7fb36006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:30.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.048+0000 7fb37f400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb36006b810 0x7fb36006dcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3801522b0 tx=0x7fb36c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:30.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.051+0000 7fb377e00640 1 -- 172.21.15.102:0/4120854611 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb370076e00 con 0x7fb3800c67e0 2024-03-25T06:04:30.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.239+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3800c9630 con 0x7fb36006b810 2024-03-25T06:04:30.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.248+0000 7fb377e00640 1 -- 172.21.15.102:0/4120854611 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336632 (secure 0 0 0) 0x7fb3800c9630 con 0x7fb36006b810 2024-03-25T06:04:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:30.247 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T06:04:30.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb36006b810 msgr2=0x7fb36006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:30.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb36006b810 0x7fb36006dcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3801522b0 tx=0x7fb36c008040 comp rx=0 tx=0).stop 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3800c67e0 msgr2=0x7fb3801efa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3800c67e0 0x7fb3801efa00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb370000c00 tx=0x7fb3700046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 shutdown_connections 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fb36006b810 0x7fb36006dcd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb380154120 0x7fb3800c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3800c6c10 0x7fb38014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 --2- 172.21.15.102:0/4120854611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3800c67e0 0x7fb3801efa00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 >> 172.21.15.102:0/4120854611 conn(0x7fb3800cf3e0 msgr2=0x7fb3800c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 shutdown_connections 2024-03-25T06:04:30.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:30.253+0000 7fb385400640 1 -- 172.21.15.102:0/4120854611 wait complete. 2024-03-25T06:04:30.267 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":833,"stamp":"2024-03-25T06:04:29.354686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":234647267,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":8379,"num_read_kb":1510074,"num_write":298685,"num_write_kb":4974601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33779,"num_omap_keys":66,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":460742,"ondisk_log_size":460742,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5877216,"kb_used_data":307488,"kb_used_omap":12,"kb_used_meta":5569651,"kb_avail":749097504,"statfs":{"total":773094113280,"available":767075844096,"internally_reserved":0,"allocated":314867712,"data_stored":470267974,"data_compressed":49649372,"data_compressed_allocated":73498624,"data_compressed_original":230506496,"omap_allocated":12752,"internal_metadata":5703323184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1651,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5049,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002633"},"pg_stats":[{"pgid":"2.1f","version":"27'1877","reported_seq":1926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.020346+0000","last_change":"2024-03-25T06:04:06.020346+0000","last_active":"2024-03-25T06:04:06.020346+0000","last_peered":"2024-03-25T06:04:06.020346+0000","last_clean":"2024-03-25T06:04:06.020346+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T06:04:06.020346+0000","last_undegraded":"2024-03-25T06:04:06.020346+0000","last_fullsized":"2024-03-25T06:04:06.020346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1877","last_scrub_stamp":"2024-03-25T06:04:06.020170+0000","last_deep_scrub":"27'1877","last_deep_scrub_stamp":"2024-03-25T06:04:06.020170+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.020170+0000","objects_scrubbed":6,"log_size":1877,"log_dups_size":0,"ondisk_log_size":1877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:04.258197+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1876,"num_write_kb":13587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1712","reported_seq":1759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.940123+0000","last_change":"2024-03-25T06:04:19.940163+0000","last_active":"2024-03-25T06:04:19.940123+0000","last_peered":"2024-03-25T06:04:19.940123+0000","last_clean":"2024-03-25T06:04:19.940123+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T06:04:19.940123+0000","last_undegraded":"2024-03-25T06:04:19.940123+0000","last_fullsized":"2024-03-25T06:04:19.940123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1712","last_scrub_stamp":"2024-03-25T06:04:19.940032+0000","last_deep_scrub":"27'1712","last_deep_scrub_stamp":"2024-03-25T06:04:19.940032+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.940032+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:38.027979+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'6044","reported_seq":6157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.060730+0000","last_change":"2024-03-25T05:37:35.930505+0000","last_active":"2024-03-25T06:04:06.060730+0000","last_peered":"2024-03-25T06:04:06.060730+0000","last_clean":"2024-03-25T06:04:06.060730+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T06:04:06.060730+0000","last_undegraded":"2024-03-25T06:04:06.060730+0000","last_fullsized":"2024-03-25T06:04:06.060730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:34.411602+0000","last_clean_scrub_stamp":"2024-03-25T05:37:34.411602+0000","objects_scrubbed":0,"log_size":6044,"log_dups_size":0,"ondisk_log_size":6044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":4304,"num_write_kb":115529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'5159","reported_seq":5208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.946793+0000","last_change":"2024-03-25T06:04:13.946829+0000","last_active":"2024-03-25T06:04:13.946793+0000","last_peered":"2024-03-25T06:04:13.946793+0000","last_clean":"2024-03-25T06:04:13.946793+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T06:04:13.946793+0000","last_undegraded":"2024-03-25T06:04:13.946793+0000","last_fullsized":"2024-03-25T06:04:13.946793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5159","last_scrub_stamp":"2024-03-25T06:04:13.946691+0000","last_deep_scrub":"27'5159","last_deep_scrub_stamp":"2024-03-25T06:04:13.946691+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.946691+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:15.896024+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5171,"num_write_kb":32292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1712","reported_seq":1758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.989585+0000","last_change":"2024-03-25T06:04:08.989608+0000","last_active":"2024-03-25T06:04:08.989585+0000","last_peered":"2024-03-25T06:04:08.989585+0000","last_clean":"2024-03-25T06:04:08.989585+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T06:04:08.989585+0000","last_undegraded":"2024-03-25T06:04:08.989585+0000","last_fullsized":"2024-03-25T06:04:08.989585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1712","last_scrub_stamp":"2024-03-25T06:04:08.989509+0000","last_deep_scrub":"27'1712","last_deep_scrub_stamp":"2024-03-25T06:04:08.989509+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.989509+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:17:26.592685+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5973","reported_seq":6084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.001414+0000","last_change":"2024-03-25T06:04:20.001452+0000","last_active":"2024-03-25T06:04:20.001414+0000","last_peered":"2024-03-25T06:04:20.001414+0000","last_clean":"2024-03-25T06:04:20.001414+0000","last_became_active":"2024-03-25T05:38:20.805843+0000","last_became_peered":"2024-03-25T05:38:20.805843+0000","last_unstale":"2024-03-25T06:04:20.001414+0000","last_undegraded":"2024-03-25T06:04:20.001414+0000","last_fullsized":"2024-03-25T06:04:20.001414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5973","last_scrub_stamp":"2024-03-25T06:04:20.001322+0000","last_deep_scrub":"27'5973","last_deep_scrub_stamp":"2024-03-25T06:04:20.001322+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.001322+0000","objects_scrubbed":0,"log_size":5973,"log_dups_size":0,"ondisk_log_size":5973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:40:40.030974+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":16002,"num_write":4134,"num_write_kb":115071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7861","reported_seq":7908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.651649+0000","last_change":"2024-03-25T06:04:12.651713+0000","last_active":"2024-03-25T06:04:12.651649+0000","last_peered":"2024-03-25T06:04:12.651649+0000","last_clean":"2024-03-25T06:04:12.651649+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T06:04:12.651649+0000","last_undegraded":"2024-03-25T06:04:12.651649+0000","last_fullsized":"2024-03-25T06:04:12.651649+0000","mapping_epoch":17,"log_start":"27'800","ondisk_log_start":"27'800","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7861","last_scrub_stamp":"2024-03-25T06:04:12.651554+0000","last_deep_scrub":"27'7861","last_deep_scrub_stamp":"2024-03-25T06:04:12.651554+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.651554+0000","objects_scrubbed":9,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:28.694885+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7854,"num_write_kb":54498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1772","reported_seq":1817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.551002+0000","last_change":"2024-03-25T06:04:16.551023+0000","last_active":"2024-03-25T06:04:16.551002+0000","last_peered":"2024-03-25T06:04:16.551002+0000","last_clean":"2024-03-25T06:04:16.551002+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T06:04:16.551002+0000","last_undegraded":"2024-03-25T06:04:16.551002+0000","last_fullsized":"2024-03-25T06:04:16.551002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1772","last_scrub_stamp":"2024-03-25T06:04:16.550935+0000","last_deep_scrub":"27'1772","last_deep_scrub_stamp":"2024-03-25T06:04:16.550935+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.550935+0000","objects_scrubbed":0,"log_size":1772,"log_dups_size":0,"ondisk_log_size":1772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:06.084397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5981","reported_seq":6145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.937207+0000","last_change":"2024-03-25T06:04:14.937251+0000","last_active":"2024-03-25T06:04:14.937207+0000","last_peered":"2024-03-25T06:04:14.937207+0000","last_clean":"2024-03-25T06:04:14.937207+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T06:04:14.937207+0000","last_undegraded":"2024-03-25T06:04:14.937207+0000","last_fullsized":"2024-03-25T06:04:14.937207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5981","last_scrub_stamp":"2024-03-25T06:04:14.937087+0000","last_deep_scrub":"27'5981","last_deep_scrub_stamp":"2024-03-25T06:04:14.937087+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.937087+0000","objects_scrubbed":0,"log_size":5981,"log_dups_size":0,"ondisk_log_size":5981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:04.470549+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":31496,"num_write":4151,"num_write_kb":107318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4418","reported_seq":4465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.627882+0000","last_change":"2024-03-25T06:04:11.627943+0000","last_active":"2024-03-25T06:04:11.627882+0000","last_peered":"2024-03-25T06:04:11.627882+0000","last_clean":"2024-03-25T06:04:11.627882+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T06:04:11.627882+0000","last_undegraded":"2024-03-25T06:04:11.627882+0000","last_fullsized":"2024-03-25T06:04:11.627882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4418","last_scrub_stamp":"2024-03-25T06:04:11.627777+0000","last_deep_scrub":"27'4418","last_deep_scrub_stamp":"2024-03-25T06:04:11.627777+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.627777+0000","objects_scrubbed":6,"log_size":4418,"log_dups_size":0,"ondisk_log_size":4418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:09.865803+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4409,"num_write_kb":35629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1703","reported_seq":1748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.549394+0000","last_change":"2024-03-25T06:04:15.549437+0000","last_active":"2024-03-25T06:04:15.549394+0000","last_peered":"2024-03-25T06:04:15.549394+0000","last_clean":"2024-03-25T06:04:15.549394+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T06:04:15.549394+0000","last_undegraded":"2024-03-25T06:04:15.549394+0000","last_fullsized":"2024-03-25T06:04:15.549394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1703","last_scrub_stamp":"2024-03-25T06:04:15.549294+0000","last_deep_scrub":"27'1703","last_deep_scrub_stamp":"2024-03-25T06:04:15.549294+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.549294+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:57.610244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5907","reported_seq":6014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.994442+0000","last_change":"2024-03-25T06:04:16.994486+0000","last_active":"2024-03-25T06:04:16.994442+0000","last_peered":"2024-03-25T06:04:16.994442+0000","last_clean":"2024-03-25T06:04:16.994442+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T06:04:16.994442+0000","last_undegraded":"2024-03-25T06:04:16.994442+0000","last_fullsized":"2024-03-25T06:04:16.994442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5907","last_scrub_stamp":"2024-03-25T06:04:16.994319+0000","last_deep_scrub":"27'5907","last_deep_scrub_stamp":"2024-03-25T06:04:16.994319+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.994319+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:13:44.476735+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":4127,"num_write_kb":118658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1739","reported_seq":1785,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.454530+0000","last_change":"2024-03-25T06:04:14.454569+0000","last_active":"2024-03-25T06:04:14.454530+0000","last_peered":"2024-03-25T06:04:14.454530+0000","last_clean":"2024-03-25T06:04:14.454530+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T06:04:14.454530+0000","last_undegraded":"2024-03-25T06:04:14.454530+0000","last_fullsized":"2024-03-25T06:04:14.454530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1739","last_scrub_stamp":"2024-03-25T06:04:14.454428+0000","last_deep_scrub":"27'1739","last_deep_scrub_stamp":"2024-03-25T06:04:14.454428+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.454428+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:59:14.322016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'5829","reported_seq":5877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.608800+0000","last_change":"2024-03-25T06:04:14.608846+0000","last_active":"2024-03-25T06:04:14.608800+0000","last_peered":"2024-03-25T06:04:14.608800+0000","last_clean":"2024-03-25T06:04:14.608800+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T06:04:14.608800+0000","last_undegraded":"2024-03-25T06:04:14.608800+0000","last_fullsized":"2024-03-25T06:04:14.608800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5829","last_scrub_stamp":"2024-03-25T06:04:14.608724+0000","last_deep_scrub":"27'5829","last_deep_scrub_stamp":"2024-03-25T06:04:14.608724+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.608724+0000","objects_scrubbed":3,"log_size":5829,"log_dups_size":0,"ondisk_log_size":5829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:58.254501+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5838,"num_write_kb":40868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":284,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'6422","reported_seq":6569,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.955080+0000","last_change":"2024-03-25T06:04:18.955104+0000","last_active":"2024-03-25T06:04:18.955080+0000","last_peered":"2024-03-25T06:04:18.955080+0000","last_clean":"2024-03-25T06:04:18.955080+0000","last_became_active":"2024-03-25T05:38:20.652530+0000","last_became_peered":"2024-03-25T05:38:20.652530+0000","last_unstale":"2024-03-25T06:04:18.955080+0000","last_undegraded":"2024-03-25T06:04:18.955080+0000","last_fullsized":"2024-03-25T06:04:18.955080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6422","last_scrub_stamp":"2024-03-25T06:04:18.955003+0000","last_deep_scrub":"27'6422","last_deep_scrub_stamp":"2024-03-25T06:04:18.955003+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.955003+0000","objects_scrubbed":0,"log_size":6422,"log_dups_size":0,"ondisk_log_size":6422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:42.209411+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":25146,"num_write":4573,"num_write_kb":128923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1760","reported_seq":1806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.807917+0000","last_change":"2024-03-25T06:04:06.807917+0000","last_active":"2024-03-25T06:04:06.807917+0000","last_peered":"2024-03-25T06:04:06.807917+0000","last_clean":"2024-03-25T06:04:06.807917+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T06:04:06.807917+0000","last_undegraded":"2024-03-25T06:04:06.807917+0000","last_fullsized":"2024-03-25T06:04:06.807917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1760","last_scrub_stamp":"2024-03-25T06:04:06.807768+0000","last_deep_scrub":"27'1760","last_deep_scrub_stamp":"2024-03-25T06:04:06.807768+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.807768+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:29:01.109791+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'5255","reported_seq":5304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.293856+0000","last_change":"2024-03-25T06:04:11.293887+0000","last_active":"2024-03-25T06:04:11.293856+0000","last_peered":"2024-03-25T06:04:11.293856+0000","last_clean":"2024-03-25T06:04:11.293856+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T06:04:11.293856+0000","last_undegraded":"2024-03-25T06:04:11.293856+0000","last_fullsized":"2024-03-25T06:04:11.293856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5255","last_scrub_stamp":"2024-03-25T06:04:11.293797+0000","last_deep_scrub":"27'5255","last_deep_scrub_stamp":"2024-03-25T06:04:11.293797+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.293797+0000","objects_scrubbed":4,"log_size":5255,"log_dups_size":0,"ondisk_log_size":5255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:18.698536+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":40419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'6245","reported_seq":6399,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.963116+0000","last_change":"2024-03-25T06:04:20.963144+0000","last_active":"2024-03-25T06:04:20.963116+0000","last_peered":"2024-03-25T06:04:20.963116+0000","last_clean":"2024-03-25T06:04:20.963116+0000","last_became_active":"2024-03-25T05:38:20.809544+0000","last_became_peered":"2024-03-25T05:38:20.809544+0000","last_unstale":"2024-03-25T06:04:20.963116+0000","last_undegraded":"2024-03-25T06:04:20.963116+0000","last_fullsized":"2024-03-25T06:04:20.963116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6245","last_scrub_stamp":"2024-03-25T06:04:20.963032+0000","last_deep_scrub":"27'6245","last_deep_scrub_stamp":"2024-03-25T06:04:20.963032+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.963032+0000","objects_scrubbed":0,"log_size":6245,"log_dups_size":0,"ondisk_log_size":6245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:39.050980+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":26924,"num_write":4477,"num_write_kb":122118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1773","reported_seq":1819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.892909+0000","last_change":"2024-03-25T06:04:10.892946+0000","last_active":"2024-03-25T06:04:10.892909+0000","last_peered":"2024-03-25T06:04:10.892909+0000","last_clean":"2024-03-25T06:04:10.892909+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T06:04:10.892909+0000","last_undegraded":"2024-03-25T06:04:10.892909+0000","last_fullsized":"2024-03-25T06:04:10.892909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1773","last_scrub_stamp":"2024-03-25T06:04:10.892812+0000","last_deep_scrub":"27'1773","last_deep_scrub_stamp":"2024-03-25T06:04:10.892812+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.892812+0000","objects_scrubbed":0,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:32.269864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2777","reported_seq":2826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.245615+0000","last_change":"2024-03-25T06:04:06.245663+0000","last_active":"2024-03-25T06:04:06.245615+0000","last_peered":"2024-03-25T06:04:06.245615+0000","last_clean":"2024-03-25T06:04:06.245615+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T06:04:06.245615+0000","last_undegraded":"2024-03-25T06:04:06.245615+0000","last_fullsized":"2024-03-25T06:04:06.245615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2777","last_scrub_stamp":"2024-03-25T06:04:06.245521+0000","last_deep_scrub":"27'2777","last_deep_scrub_stamp":"2024-03-25T06:04:06.245521+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.245521+0000","objects_scrubbed":4,"log_size":2777,"log_dups_size":0,"ondisk_log_size":2777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:25:43.873830+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2784,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5899","reported_seq":6126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.372027+0000","last_change":"2024-03-25T06:04:20.372076+0000","last_active":"2024-03-25T06:04:20.372027+0000","last_peered":"2024-03-25T06:04:20.372027+0000","last_clean":"2024-03-25T06:04:20.372027+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T06:04:20.372027+0000","last_undegraded":"2024-03-25T06:04:20.372027+0000","last_fullsized":"2024-03-25T06:04:20.372027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5899","last_scrub_stamp":"2024-03-25T06:04:20.371892+0000","last_deep_scrub":"27'5899","last_deep_scrub_stamp":"2024-03-25T06:04:20.371892+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.371892+0000","objects_scrubbed":0,"log_size":5899,"log_dups_size":0,"ondisk_log_size":5899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:21.254609+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":47244,"num_write":4145,"num_write_kb":109724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1772","reported_seq":1819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.018342+0000","last_change":"2024-03-25T06:04:11.018362+0000","last_active":"2024-03-25T06:04:11.018342+0000","last_peered":"2024-03-25T06:04:11.018342+0000","last_clean":"2024-03-25T06:04:11.018342+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T06:04:11.018342+0000","last_undegraded":"2024-03-25T06:04:11.018342+0000","last_fullsized":"2024-03-25T06:04:11.018342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1772","last_scrub_stamp":"2024-03-25T06:04:11.018276+0000","last_deep_scrub":"27'1772","last_deep_scrub_stamp":"2024-03-25T06:04:11.018276+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.018276+0000","objects_scrubbed":0,"log_size":1772,"log_dups_size":0,"ondisk_log_size":1772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:54.664053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1613","reported_seq":1662,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.629372+0000","last_change":"2024-03-25T06:04:13.629394+0000","last_active":"2024-03-25T06:04:13.629372+0000","last_peered":"2024-03-25T06:04:13.629372+0000","last_clean":"2024-03-25T06:04:13.629372+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T06:04:13.629372+0000","last_undegraded":"2024-03-25T06:04:13.629372+0000","last_fullsized":"2024-03-25T06:04:13.629372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1613","last_scrub_stamp":"2024-03-25T06:04:13.629305+0000","last_deep_scrub":"27'1613","last_deep_scrub_stamp":"2024-03-25T06:04:13.629305+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.629305+0000","objects_scrubbed":1,"log_size":1613,"log_dups_size":0,"ondisk_log_size":1613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:58.338102+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5913","reported_seq":6006,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.974533+0000","last_change":"2024-03-25T06:04:13.974557+0000","last_active":"2024-03-25T06:04:13.974533+0000","last_peered":"2024-03-25T06:04:13.974533+0000","last_clean":"2024-03-25T06:04:13.974533+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T06:04:13.974533+0000","last_undegraded":"2024-03-25T06:04:13.974533+0000","last_fullsized":"2024-03-25T06:04:13.974533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5913","last_scrub_stamp":"2024-03-25T06:04:13.974443+0000","last_deep_scrub":"27'5913","last_deep_scrub_stamp":"2024-03-25T06:04:13.974443+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.974443+0000","objects_scrubbed":0,"log_size":5913,"log_dups_size":0,"ondisk_log_size":5913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:56.035393+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4059,"num_write_kb":104872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1713","reported_seq":1759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.938702+0000","last_change":"2024-03-25T06:04:12.938741+0000","last_active":"2024-03-25T06:04:12.938702+0000","last_peered":"2024-03-25T06:04:12.938702+0000","last_clean":"2024-03-25T06:04:12.938702+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T06:04:12.938702+0000","last_undegraded":"2024-03-25T06:04:12.938702+0000","last_fullsized":"2024-03-25T06:04:12.938702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1713","last_scrub_stamp":"2024-03-25T06:04:12.938567+0000","last_deep_scrub":"27'1713","last_deep_scrub_stamp":"2024-03-25T06:04:12.938567+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.938567+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:08:29.795307+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'2891","reported_seq":2939,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.484158+0000","last_change":"2024-03-25T06:04:12.484209+0000","last_active":"2024-03-25T06:04:12.484158+0000","last_peered":"2024-03-25T06:04:12.484158+0000","last_clean":"2024-03-25T06:04:12.484158+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T06:04:12.484158+0000","last_undegraded":"2024-03-25T06:04:12.484158+0000","last_fullsized":"2024-03-25T06:04:12.484158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2891","last_scrub_stamp":"2024-03-25T06:04:12.484058+0000","last_deep_scrub":"27'2891","last_deep_scrub_stamp":"2024-03-25T06:04:12.484058+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.484058+0000","objects_scrubbed":5,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:25:50.112367+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2906,"num_write_kb":22398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'6071","reported_seq":6165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.990027+0000","last_change":"2024-03-25T06:04:17.990070+0000","last_active":"2024-03-25T06:04:17.990027+0000","last_peered":"2024-03-25T06:04:17.990027+0000","last_clean":"2024-03-25T06:04:17.990027+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T06:04:17.990027+0000","last_undegraded":"2024-03-25T06:04:17.990027+0000","last_fullsized":"2024-03-25T06:04:17.990027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6071","last_scrub_stamp":"2024-03-25T06:04:17.989902+0000","last_deep_scrub":"27'6071","last_deep_scrub_stamp":"2024-03-25T06:04:17.989902+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.989902+0000","objects_scrubbed":0,"log_size":6071,"log_dups_size":0,"ondisk_log_size":6071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:01:40.551201+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4303,"num_write_kb":129626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1690","reported_seq":1736,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.982114+0000","last_change":"2024-03-25T06:04:18.982154+0000","last_active":"2024-03-25T06:04:18.982114+0000","last_peered":"2024-03-25T06:04:18.982114+0000","last_clean":"2024-03-25T06:04:18.982114+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T06:04:18.982114+0000","last_undegraded":"2024-03-25T06:04:18.982114+0000","last_fullsized":"2024-03-25T06:04:18.982114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1690","last_scrub_stamp":"2024-03-25T06:04:18.981965+0000","last_deep_scrub":"27'1690","last_deep_scrub_stamp":"2024-03-25T06:04:18.981965+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.981965+0000","objects_scrubbed":0,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:19.864682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4487","reported_seq":4536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.358079+0000","last_change":"2024-03-25T06:04:10.358131+0000","last_active":"2024-03-25T06:04:10.358079+0000","last_peered":"2024-03-25T06:04:10.358079+0000","last_clean":"2024-03-25T06:04:10.358079+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T06:04:10.358079+0000","last_undegraded":"2024-03-25T06:04:10.358079+0000","last_fullsized":"2024-03-25T06:04:10.358079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4487","last_scrub_stamp":"2024-03-25T06:04:10.357976+0000","last_deep_scrub":"27'4487","last_deep_scrub_stamp":"2024-03-25T06:04:10.357976+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.357976+0000","objects_scrubbed":5,"log_size":4487,"log_dups_size":0,"ondisk_log_size":4487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:54.003753+0000","scrub_duration":111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7152,"num_write_kb":35867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'6341","reported_seq":6517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:24.894910+0000","last_change":"2024-03-25T06:04:24.894951+0000","last_active":"2024-03-25T06:04:24.894910+0000","last_peered":"2024-03-25T06:04:24.894910+0000","last_clean":"2024-03-25T06:04:24.894910+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T06:04:24.894910+0000","last_undegraded":"2024-03-25T06:04:24.894910+0000","last_fullsized":"2024-03-25T06:04:24.894910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6341","last_scrub_stamp":"2024-03-25T06:04:24.894787+0000","last_deep_scrub":"27'6341","last_deep_scrub_stamp":"2024-03-25T06:04:24.894787+0000","last_clean_scrub_stamp":"2024-03-25T06:04:24.894787+0000","objects_scrubbed":0,"log_size":6341,"log_dups_size":0,"ondisk_log_size":6341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:10:29.915504+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":33782,"num_write":4571,"num_write_kb":115403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1759","reported_seq":1806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.247244+0000","last_change":"2024-03-25T06:04:13.247282+0000","last_active":"2024-03-25T06:04:13.247244+0000","last_peered":"2024-03-25T06:04:13.247244+0000","last_clean":"2024-03-25T06:04:13.247244+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T06:04:13.247244+0000","last_undegraded":"2024-03-25T06:04:13.247244+0000","last_fullsized":"2024-03-25T06:04:13.247244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1759","last_scrub_stamp":"2024-03-25T06:04:13.247139+0000","last_deep_scrub":"27'1759","last_deep_scrub_stamp":"2024-03-25T06:04:13.247139+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.247139+0000","objects_scrubbed":0,"log_size":1759,"log_dups_size":0,"ondisk_log_size":1759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:55.308089+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'5278","reported_seq":5327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.621967+0000","last_change":"2024-03-25T06:04:15.622014+0000","last_active":"2024-03-25T06:04:15.621967+0000","last_peered":"2024-03-25T06:04:15.621967+0000","last_clean":"2024-03-25T06:04:15.621967+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T06:04:15.621967+0000","last_undegraded":"2024-03-25T06:04:15.621967+0000","last_fullsized":"2024-03-25T06:04:15.621967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5278","last_scrub_stamp":"2024-03-25T06:04:15.621880+0000","last_deep_scrub":"27'5278","last_deep_scrub_stamp":"2024-03-25T06:04:15.621880+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.621880+0000","objects_scrubbed":5,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:23.026619+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5274,"num_write_kb":36361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5049,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'6079","reported_seq":6326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.884931+0000","last_change":"2024-03-25T06:04:18.884969+0000","last_active":"2024-03-25T06:04:18.884931+0000","last_peered":"2024-03-25T06:04:18.884931+0000","last_clean":"2024-03-25T06:04:18.884931+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T06:04:18.884931+0000","last_undegraded":"2024-03-25T06:04:18.884931+0000","last_fullsized":"2024-03-25T06:04:18.884931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6079","last_scrub_stamp":"2024-03-25T06:04:18.884841+0000","last_deep_scrub":"27'6079","last_deep_scrub_stamp":"2024-03-25T06:04:18.884841+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.884841+0000","objects_scrubbed":0,"log_size":6079,"log_dups_size":0,"ondisk_log_size":6079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:19.767558+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":52070,"num_write":4228,"num_write_kb":109752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1711","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.208479+0000","last_change":"2024-03-25T06:04:14.208516+0000","last_active":"2024-03-25T06:04:14.208479+0000","last_peered":"2024-03-25T06:04:14.208479+0000","last_clean":"2024-03-25T06:04:14.208479+0000","last_became_active":"2024-03-25T05:38:20.805934+0000","last_became_peered":"2024-03-25T05:38:20.805934+0000","last_unstale":"2024-03-25T06:04:14.208479+0000","last_undegraded":"2024-03-25T06:04:14.208479+0000","last_fullsized":"2024-03-25T06:04:14.208479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1711","last_scrub_stamp":"2024-03-25T06:04:14.208377+0000","last_deep_scrub":"27'1711","last_deep_scrub_stamp":"2024-03-25T06:04:14.208377+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.208377+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:19:02.677819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'5142","reported_seq":5191,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.592574+0000","last_change":"2024-03-25T06:04:07.592630+0000","last_active":"2024-03-25T06:04:07.592574+0000","last_peered":"2024-03-25T06:04:07.592574+0000","last_clean":"2024-03-25T06:04:07.592574+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T06:04:07.592574+0000","last_undegraded":"2024-03-25T06:04:07.592574+0000","last_fullsized":"2024-03-25T06:04:07.592574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5142","last_scrub_stamp":"2024-03-25T06:04:07.592471+0000","last_deep_scrub":"27'5142","last_deep_scrub_stamp":"2024-03-25T06:04:07.592471+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.592471+0000","objects_scrubbed":4,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:19:05.650747+0000","scrub_duration":318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5143,"num_write_kb":40167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'6967","reported_seq":7068,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.365058+0000","last_change":"2024-03-25T06:04:19.365102+0000","last_active":"2024-03-25T06:04:19.365058+0000","last_peered":"2024-03-25T06:04:19.365058+0000","last_clean":"2024-03-25T06:04:19.365058+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T06:04:19.365058+0000","last_undegraded":"2024-03-25T06:04:19.365058+0000","last_fullsized":"2024-03-25T06:04:19.365058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6967","last_scrub_stamp":"2024-03-25T06:04:19.364941+0000","last_deep_scrub":"27'6967","last_deep_scrub_stamp":"2024-03-25T06:04:19.364941+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.364941+0000","objects_scrubbed":0,"log_size":6967,"log_dups_size":0,"ondisk_log_size":6967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:27.020102+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5199,"num_write_kb":132356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1725","reported_seq":1772,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.991700+0000","last_change":"2024-03-25T06:04:09.991735+0000","last_active":"2024-03-25T06:04:09.991700+0000","last_peered":"2024-03-25T06:04:09.991700+0000","last_clean":"2024-03-25T06:04:09.991700+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T06:04:09.991700+0000","last_undegraded":"2024-03-25T06:04:09.991700+0000","last_fullsized":"2024-03-25T06:04:09.991700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1725","last_scrub_stamp":"2024-03-25T06:04:09.991607+0000","last_deep_scrub":"27'1725","last_deep_scrub_stamp":"2024-03-25T06:04:09.991607+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.991607+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:54.700403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7935","reported_seq":7984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.581090+0000","last_change":"2024-03-25T06:04:13.581117+0000","last_active":"2024-03-25T06:04:13.581090+0000","last_peered":"2024-03-25T06:04:13.581090+0000","last_clean":"2024-03-25T06:04:13.581090+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T06:04:13.581090+0000","last_undegraded":"2024-03-25T06:04:13.581090+0000","last_fullsized":"2024-03-25T06:04:13.581090+0000","mapping_epoch":17,"log_start":"27'400","ondisk_log_start":"27'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7935","last_scrub_stamp":"2024-03-25T06:04:13.581031+0000","last_deep_scrub":"27'7935","last_deep_scrub_stamp":"2024-03-25T06:04:13.581031+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.581031+0000","objects_scrubbed":3,"log_size":7535,"log_dups_size":0,"ondisk_log_size":7535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:20.985770+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":7940,"num_write_kb":54570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'6089","reported_seq":6203,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.297503+0000","last_change":"2024-03-25T06:04:16.297546+0000","last_active":"2024-03-25T06:04:16.297503+0000","last_peered":"2024-03-25T06:04:16.297503+0000","last_clean":"2024-03-25T06:04:16.297503+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T06:04:16.297503+0000","last_undegraded":"2024-03-25T06:04:16.297503+0000","last_fullsized":"2024-03-25T06:04:16.297503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6089","last_scrub_stamp":"2024-03-25T06:04:16.297390+0000","last_deep_scrub":"27'6089","last_deep_scrub_stamp":"2024-03-25T06:04:16.297390+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.297390+0000","objects_scrubbed":0,"log_size":6089,"log_dups_size":0,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:13.368629+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4263,"num_write_kb":125557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1743","reported_seq":1791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.283261+0000","last_change":"2024-03-25T06:04:12.283298+0000","last_active":"2024-03-25T06:04:12.283261+0000","last_peered":"2024-03-25T06:04:12.283261+0000","last_clean":"2024-03-25T06:04:12.283261+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T06:04:12.283261+0000","last_undegraded":"2024-03-25T06:04:12.283261+0000","last_fullsized":"2024-03-25T06:04:12.283261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1743","last_scrub_stamp":"2024-03-25T06:04:12.283163+0000","last_deep_scrub":"27'1743","last_deep_scrub_stamp":"2024-03-25T06:04:12.283163+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.283163+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:33.660215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6073","reported_seq":7072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.326633+0000","last_change":"2024-03-25T06:04:08.326689+0000","last_active":"2024-03-25T06:04:08.326633+0000","last_peered":"2024-03-25T06:04:08.326633+0000","last_clean":"2024-03-25T06:04:08.326633+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T06:04:08.326633+0000","last_undegraded":"2024-03-25T06:04:08.326633+0000","last_fullsized":"2024-03-25T06:04:08.326633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6073","last_scrub_stamp":"2024-03-25T06:04:08.326534+0000","last_deep_scrub":"27'6073","last_deep_scrub_stamp":"2024-03-25T06:04:08.326534+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.326534+0000","objects_scrubbed":6,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:01:05.110985+0000","scrub_duration":96,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":950,"num_read_kb":4728,"num_write":6067,"num_write_kb":44951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'6020","reported_seq":6501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.325683+0000","last_change":"2024-03-25T06:04:17.325733+0000","last_active":"2024-03-25T06:04:17.325683+0000","last_peered":"2024-03-25T06:04:17.325683+0000","last_clean":"2024-03-25T06:04:17.325683+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T06:04:17.325683+0000","last_undegraded":"2024-03-25T06:04:17.325683+0000","last_fullsized":"2024-03-25T06:04:17.325683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6020","last_scrub_stamp":"2024-03-25T06:04:17.325552+0000","last_deep_scrub":"27'6020","last_deep_scrub_stamp":"2024-03-25T06:04:17.325552+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.325552+0000","objects_scrubbed":0,"log_size":6020,"log_dups_size":0,"ondisk_log_size":6020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:02.866214+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":111506,"num_write":4241,"num_write_kb":120921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1663","reported_seq":1709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.011481+0000","last_change":"2024-03-25T06:04:07.011544+0000","last_active":"2024-03-25T06:04:07.011481+0000","last_peered":"2024-03-25T06:04:07.011481+0000","last_clean":"2024-03-25T06:04:07.011481+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T06:04:07.011481+0000","last_undegraded":"2024-03-25T06:04:07.011481+0000","last_fullsized":"2024-03-25T06:04:07.011481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1663","last_scrub_stamp":"2024-03-25T06:04:07.011279+0000","last_deep_scrub":"27'1663","last_deep_scrub_stamp":"2024-03-25T06:04:07.011279+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.011279+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:23.054610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'6672","reported_seq":6722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.625566+0000","last_change":"2024-03-25T06:04:16.625606+0000","last_active":"2024-03-25T06:04:16.625566+0000","last_peered":"2024-03-25T06:04:16.625566+0000","last_clean":"2024-03-25T06:04:16.625566+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T06:04:16.625566+0000","last_undegraded":"2024-03-25T06:04:16.625566+0000","last_fullsized":"2024-03-25T06:04:16.625566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6672","last_scrub_stamp":"2024-03-25T06:04:16.625498+0000","last_deep_scrub":"27'6672","last_deep_scrub_stamp":"2024-03-25T06:04:16.625498+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.625498+0000","objects_scrubbed":1,"log_size":6672,"log_dups_size":0,"ondisk_log_size":6672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:38.002550+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":45450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'6165","reported_seq":6367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.871486+0000","last_change":"2024-03-25T06:04:16.871529+0000","last_active":"2024-03-25T06:04:16.871486+0000","last_peered":"2024-03-25T06:04:16.871486+0000","last_clean":"2024-03-25T06:04:16.871486+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T06:04:16.871486+0000","last_undegraded":"2024-03-25T06:04:16.871486+0000","last_fullsized":"2024-03-25T06:04:16.871486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6165","last_scrub_stamp":"2024-03-25T06:04:16.871359+0000","last_deep_scrub":"27'6165","last_deep_scrub_stamp":"2024-03-25T06:04:16.871359+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.871359+0000","objects_scrubbed":0,"log_size":6165,"log_dups_size":0,"ondisk_log_size":6165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:06.376290+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":40640,"num_write":4336,"num_write_kb":133390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1739","reported_seq":1785,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.957458+0000","last_change":"2024-03-25T06:04:17.957497+0000","last_active":"2024-03-25T06:04:17.957458+0000","last_peered":"2024-03-25T06:04:17.957458+0000","last_clean":"2024-03-25T06:04:17.957458+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T06:04:17.957458+0000","last_undegraded":"2024-03-25T06:04:17.957458+0000","last_fullsized":"2024-03-25T06:04:17.957458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1739","last_scrub_stamp":"2024-03-25T06:04:17.957336+0000","last_deep_scrub":"27'1739","last_deep_scrub_stamp":"2024-03-25T06:04:17.957336+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.957336+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:25.612498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4320","reported_seq":4369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.554451+0000","last_change":"2024-03-25T06:04:12.554480+0000","last_active":"2024-03-25T06:04:12.554451+0000","last_peered":"2024-03-25T06:04:12.554451+0000","last_clean":"2024-03-25T06:04:12.554451+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T06:04:12.554451+0000","last_undegraded":"2024-03-25T06:04:12.554451+0000","last_fullsized":"2024-03-25T06:04:12.554451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4320","last_scrub_stamp":"2024-03-25T06:04:12.554390+0000","last_deep_scrub":"27'4320","last_deep_scrub_stamp":"2024-03-25T06:04:12.554390+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.554390+0000","objects_scrubbed":6,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:56.200167+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4311,"num_write_kb":35590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.599498+0000","last_change":"2024-03-25T06:04:10.599527+0000","last_active":"2024-03-25T06:04:10.599498+0000","last_peered":"2024-03-25T06:04:10.599498+0000","last_clean":"2024-03-25T06:04:10.599498+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T06:04:10.599498+0000","last_undegraded":"2024-03-25T06:04:10.599498+0000","last_fullsized":"2024-03-25T06:04:10.599498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-25T06:04:10.599436+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-25T06:04:10.599436+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.599436+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:55.693297+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'6163","reported_seq":6333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.519426+0000","last_change":"2024-03-25T06:04:23.519470+0000","last_active":"2024-03-25T06:04:23.519426+0000","last_peered":"2024-03-25T06:04:23.519426+0000","last_clean":"2024-03-25T06:04:23.519426+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T06:04:23.519426+0000","last_undegraded":"2024-03-25T06:04:23.519426+0000","last_fullsized":"2024-03-25T06:04:23.519426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6163","last_scrub_stamp":"2024-03-25T06:04:23.519261+0000","last_deep_scrub":"27'6163","last_deep_scrub_stamp":"2024-03-25T06:04:23.519261+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.519261+0000","objects_scrubbed":0,"log_size":6163,"log_dups_size":0,"ondisk_log_size":6163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:01:46.080561+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":32512,"num_write":4376,"num_write_kb":123749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1732","reported_seq":1778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.605245+0000","last_change":"2024-03-25T06:04:18.605282+0000","last_active":"2024-03-25T06:04:18.605245+0000","last_peered":"2024-03-25T06:04:18.605245+0000","last_clean":"2024-03-25T06:04:18.605245+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T06:04:18.605245+0000","last_undegraded":"2024-03-25T06:04:18.605245+0000","last_fullsized":"2024-03-25T06:04:18.605245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1732","last_scrub_stamp":"2024-03-25T06:04:18.605176+0000","last_deep_scrub":"27'1732","last_deep_scrub_stamp":"2024-03-25T06:04:18.605176+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.605176+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:08.138639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5046","reported_seq":5094,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.189544+0000","last_change":"2024-03-25T06:04:06.189599+0000","last_active":"2024-03-25T06:04:06.189544+0000","last_peered":"2024-03-25T06:04:06.189544+0000","last_clean":"2024-03-25T06:04:06.189544+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T06:04:06.189544+0000","last_undegraded":"2024-03-25T06:04:06.189544+0000","last_fullsized":"2024-03-25T06:04:06.189544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5046","last_scrub_stamp":"2024-03-25T06:04:06.189452+0000","last_deep_scrub":"27'5046","last_deep_scrub_stamp":"2024-03-25T06:04:06.189452+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.189452+0000","objects_scrubbed":5,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:52:34.854918+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390173,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5033,"num_write_kb":40185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'6521","reported_seq":6851,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.544686+0000","last_change":"2024-03-25T06:04:22.544730+0000","last_active":"2024-03-25T06:04:22.544686+0000","last_peered":"2024-03-25T06:04:22.544686+0000","last_clean":"2024-03-25T06:04:22.544686+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T06:04:22.544686+0000","last_undegraded":"2024-03-25T06:04:22.544686+0000","last_fullsized":"2024-03-25T06:04:22.544686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6521","last_scrub_stamp":"2024-03-25T06:04:22.544575+0000","last_deep_scrub":"27'6521","last_deep_scrub_stamp":"2024-03-25T06:04:22.544575+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.544575+0000","objects_scrubbed":0,"log_size":6521,"log_dups_size":0,"ondisk_log_size":6521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:13:50.026992+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":73152,"num_write":4691,"num_write_kb":118239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1750","reported_seq":1793,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.664506+0000","last_change":"2024-03-25T05:38:20.652252+0000","last_active":"2024-03-25T06:03:59.664506+0000","last_peered":"2024-03-25T06:03:59.664506+0000","last_clean":"2024-03-25T06:03:59.664506+0000","last_became_active":"2024-03-25T05:38:20.652010+0000","last_became_peered":"2024-03-25T05:38:20.652010+0000","last_unstale":"2024-03-25T06:03:59.664506+0000","last_undegraded":"2024-03-25T06:03:59.664506+0000","last_fullsized":"2024-03-25T06:03:59.664506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5680","reported_seq":5728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.324694+0000","last_change":"2024-03-25T06:04:08.324744+0000","last_active":"2024-03-25T06:04:08.324694+0000","last_peered":"2024-03-25T06:04:08.324694+0000","last_clean":"2024-03-25T06:04:08.324694+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T06:04:08.324694+0000","last_undegraded":"2024-03-25T06:04:08.324694+0000","last_fullsized":"2024-03-25T06:04:08.324694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5680","last_scrub_stamp":"2024-03-25T06:04:08.324463+0000","last_deep_scrub":"27'5680","last_deep_scrub_stamp":"2024-03-25T06:04:08.324463+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.324463+0000","objects_scrubbed":2,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:59:08.192052+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5688,"num_write_kb":44802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'6240","reported_seq":6614,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.822370+0000","last_change":"2024-03-25T06:04:15.822397+0000","last_active":"2024-03-25T06:04:15.822370+0000","last_peered":"2024-03-25T06:04:15.822370+0000","last_clean":"2024-03-25T06:04:15.822370+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T06:04:15.822370+0000","last_undegraded":"2024-03-25T06:04:15.822370+0000","last_fullsized":"2024-03-25T06:04:15.822370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6240","last_scrub_stamp":"2024-03-25T06:04:15.822268+0000","last_deep_scrub":"27'6240","last_deep_scrub_stamp":"2024-03-25T06:04:15.822268+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.822268+0000","objects_scrubbed":0,"log_size":6240,"log_dups_size":0,"ondisk_log_size":6240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:43:53.565055+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":84582,"num_write":4342,"num_write_kb":115405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1667","reported_seq":1713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.545139+0000","last_change":"2024-03-25T06:04:20.545160+0000","last_active":"2024-03-25T06:04:20.545139+0000","last_peered":"2024-03-25T06:04:20.545139+0000","last_clean":"2024-03-25T06:04:20.545139+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T06:04:20.545139+0000","last_undegraded":"2024-03-25T06:04:20.545139+0000","last_fullsized":"2024-03-25T06:04:20.545139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1667","last_scrub_stamp":"2024-03-25T06:04:20.545076+0000","last_deep_scrub":"27'1667","last_deep_scrub_stamp":"2024-03-25T06:04:20.545076+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.545076+0000","objects_scrubbed":0,"log_size":1667,"log_dups_size":0,"ondisk_log_size":1667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:17.616315+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5648","reported_seq":5696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.379271+0000","last_change":"2024-03-25T06:04:09.379334+0000","last_active":"2024-03-25T06:04:09.379271+0000","last_peered":"2024-03-25T06:04:09.379271+0000","last_clean":"2024-03-25T06:04:09.379271+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T06:04:09.379271+0000","last_undegraded":"2024-03-25T06:04:09.379271+0000","last_fullsized":"2024-03-25T06:04:09.379271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5648","last_scrub_stamp":"2024-03-25T06:04:09.379177+0000","last_deep_scrub":"27'5648","last_deep_scrub_stamp":"2024-03-25T06:04:09.379177+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.379177+0000","objects_scrubbed":6,"log_size":5648,"log_dups_size":0,"ondisk_log_size":5648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:54:29.597330+0000","scrub_duration":141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5640,"num_write_kb":40587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'6755","reported_seq":7105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.687857+0000","last_change":"2024-03-25T06:04:23.687902+0000","last_active":"2024-03-25T06:04:23.687857+0000","last_peered":"2024-03-25T06:04:23.687857+0000","last_clean":"2024-03-25T06:04:23.687857+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T06:04:23.687857+0000","last_undegraded":"2024-03-25T06:04:23.687857+0000","last_fullsized":"2024-03-25T06:04:23.687857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6755","last_scrub_stamp":"2024-03-25T06:04:23.687735+0000","last_deep_scrub":"27'6755","last_deep_scrub_stamp":"2024-03-25T06:04:23.687735+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.687735+0000","objects_scrubbed":0,"log_size":6755,"log_dups_size":0,"ondisk_log_size":6755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:41.775683+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":78232,"num_write":4941,"num_write_kb":116659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1749","reported_seq":1795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.566856+0000","last_change":"2024-03-25T06:04:09.566877+0000","last_active":"2024-03-25T06:04:09.566856+0000","last_peered":"2024-03-25T06:04:09.566856+0000","last_clean":"2024-03-25T06:04:09.566856+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T06:04:09.566856+0000","last_undegraded":"2024-03-25T06:04:09.566856+0000","last_fullsized":"2024-03-25T06:04:09.566856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1749","last_scrub_stamp":"2024-03-25T06:04:09.566795+0000","last_deep_scrub":"27'1749","last_deep_scrub_stamp":"2024-03-25T06:04:09.566795+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.566795+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:47:21.328938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3459","reported_seq":3507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.057599+0000","last_change":"2024-03-25T06:04:07.057651+0000","last_active":"2024-03-25T06:04:07.057599+0000","last_peered":"2024-03-25T06:04:07.057599+0000","last_clean":"2024-03-25T06:04:07.057599+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T06:04:07.057599+0000","last_undegraded":"2024-03-25T06:04:07.057599+0000","last_fullsized":"2024-03-25T06:04:07.057599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3459","last_scrub_stamp":"2024-03-25T06:04:07.057499+0000","last_deep_scrub":"27'3459","last_deep_scrub_stamp":"2024-03-25T06:04:07.057499+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.057499+0000","objects_scrubbed":5,"log_size":3459,"log_dups_size":0,"ondisk_log_size":3459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:17:37.582221+0000","scrub_duration":69,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3453,"num_write_kb":26898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'6088","reported_seq":6165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.011290+0000","last_change":"2024-03-25T06:04:13.011334+0000","last_active":"2024-03-25T06:04:13.011290+0000","last_peered":"2024-03-25T06:04:13.011290+0000","last_clean":"2024-03-25T06:04:13.011290+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T06:04:13.011290+0000","last_undegraded":"2024-03-25T06:04:13.011290+0000","last_fullsized":"2024-03-25T06:04:13.011290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6088","last_scrub_stamp":"2024-03-25T06:04:13.011181+0000","last_deep_scrub":"27'6088","last_deep_scrub_stamp":"2024-03-25T06:04:13.011181+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.011181+0000","objects_scrubbed":0,"log_size":6088,"log_dups_size":0,"ondisk_log_size":6088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:34.388233+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":8890,"num_write":4238,"num_write_kb":109989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1751","reported_seq":1797,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.614144+0000","last_change":"2024-03-25T06:04:17.614183+0000","last_active":"2024-03-25T06:04:17.614144+0000","last_peered":"2024-03-25T06:04:17.614144+0000","last_clean":"2024-03-25T06:04:17.614144+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T06:04:17.614144+0000","last_undegraded":"2024-03-25T06:04:17.614144+0000","last_fullsized":"2024-03-25T06:04:17.614144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1751","last_scrub_stamp":"2024-03-25T06:04:17.614073+0000","last_deep_scrub":"27'1751","last_deep_scrub_stamp":"2024-03-25T06:04:17.614073+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.614073+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:59.675023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'2594","reported_seq":2642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.214300+0000","last_change":"2024-03-25T06:04:07.214374+0000","last_active":"2024-03-25T06:04:07.214300+0000","last_peered":"2024-03-25T06:04:07.214300+0000","last_clean":"2024-03-25T06:04:07.214300+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T06:04:07.214300+0000","last_undegraded":"2024-03-25T06:04:07.214300+0000","last_fullsized":"2024-03-25T06:04:07.214300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2594","last_scrub_stamp":"2024-03-25T06:04:07.214203+0000","last_deep_scrub":"27'2594","last_deep_scrub_stamp":"2024-03-25T06:04:07.214203+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.214203+0000","objects_scrubbed":8,"log_size":2594,"log_dups_size":0,"ondisk_log_size":2594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:39:06.151203+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2604,"num_write_kb":18105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'6139","reported_seq":6472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.878392+0000","last_change":"2024-03-25T06:04:14.878437+0000","last_active":"2024-03-25T06:04:14.878392+0000","last_peered":"2024-03-25T06:04:14.878392+0000","last_clean":"2024-03-25T06:04:14.878392+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T06:04:14.878392+0000","last_undegraded":"2024-03-25T06:04:14.878392+0000","last_fullsized":"2024-03-25T06:04:14.878392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6139","last_scrub_stamp":"2024-03-25T06:04:14.878256+0000","last_deep_scrub":"27'6139","last_deep_scrub_stamp":"2024-03-25T06:04:14.878256+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.878256+0000","objects_scrubbed":0,"log_size":6139,"log_dups_size":0,"ondisk_log_size":6139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:11.949495+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":74168,"num_write":4312,"num_write_kb":103632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1674","reported_seq":1719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.419386+0000","last_change":"2024-03-25T06:04:15.419409+0000","last_active":"2024-03-25T06:04:15.419386+0000","last_peered":"2024-03-25T06:04:15.419386+0000","last_clean":"2024-03-25T06:04:15.419386+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T06:04:15.419386+0000","last_undegraded":"2024-03-25T06:04:15.419386+0000","last_fullsized":"2024-03-25T06:04:15.419386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1674","last_scrub_stamp":"2024-03-25T06:04:15.419319+0000","last_deep_scrub":"27'1674","last_deep_scrub_stamp":"2024-03-25T06:04:15.419319+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.419319+0000","objects_scrubbed":0,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:12:00.128116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3096","reported_seq":3143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.466257+0000","last_change":"2024-03-25T06:04:09.466303+0000","last_active":"2024-03-25T06:04:09.466257+0000","last_peered":"2024-03-25T06:04:09.466257+0000","last_clean":"2024-03-25T06:04:09.466257+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T06:04:09.466257+0000","last_undegraded":"2024-03-25T06:04:09.466257+0000","last_fullsized":"2024-03-25T06:04:09.466257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3096","last_scrub_stamp":"2024-03-25T06:04:09.466167+0000","last_deep_scrub":"27'3096","last_deep_scrub_stamp":"2024-03-25T06:04:09.466167+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.466167+0000","objects_scrubbed":4,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:31:18.499780+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195287,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3110,"num_write_kb":22545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'6007","reported_seq":6465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.916378+0000","last_change":"2024-03-25T06:04:23.916423+0000","last_active":"2024-03-25T06:04:23.916378+0000","last_peered":"2024-03-25T06:04:23.916378+0000","last_clean":"2024-03-25T06:04:23.916378+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T06:04:23.916378+0000","last_undegraded":"2024-03-25T06:04:23.916378+0000","last_fullsized":"2024-03-25T06:04:23.916378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6007","last_scrub_stamp":"2024-03-25T06:04:23.916247+0000","last_deep_scrub":"27'6007","last_deep_scrub_stamp":"2024-03-25T06:04:23.916247+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.916247+0000","objects_scrubbed":0,"log_size":6007,"log_dups_size":0,"ondisk_log_size":6007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:27:01.314092+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":105918,"num_write":4139,"num_write_kb":116235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1748","reported_seq":1794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.574205+0000","last_change":"2024-03-25T06:04:19.574228+0000","last_active":"2024-03-25T06:04:19.574205+0000","last_peered":"2024-03-25T06:04:19.574205+0000","last_clean":"2024-03-25T06:04:19.574205+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T06:04:19.574205+0000","last_undegraded":"2024-03-25T06:04:19.574205+0000","last_fullsized":"2024-03-25T06:04:19.574205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1748","last_scrub_stamp":"2024-03-25T06:04:19.574133+0000","last_deep_scrub":"27'1748","last_deep_scrub_stamp":"2024-03-25T06:04:19.574133+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.574133+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:21.523465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'852","reported_seq":900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.597703+0000","last_change":"2024-03-25T06:04:14.597755+0000","last_active":"2024-03-25T06:04:14.597703+0000","last_peered":"2024-03-25T06:04:14.597703+0000","last_clean":"2024-03-25T06:04:14.597703+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T06:04:14.597703+0000","last_undegraded":"2024-03-25T06:04:14.597703+0000","last_fullsized":"2024-03-25T06:04:14.597703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'852","last_scrub_stamp":"2024-03-25T06:04:14.597601+0000","last_deep_scrub":"27'852","last_deep_scrub_stamp":"2024-03-25T06:04:14.597601+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.597601+0000","objects_scrubbed":4,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:35.974653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":860,"num_write_kb":8739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3446,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5773","reported_seq":6012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:25.930951+0000","last_change":"2024-03-25T06:04:25.930992+0000","last_active":"2024-03-25T06:04:25.930951+0000","last_peered":"2024-03-25T06:04:25.930951+0000","last_clean":"2024-03-25T06:04:25.930951+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T06:04:25.930951+0000","last_undegraded":"2024-03-25T06:04:25.930951+0000","last_fullsized":"2024-03-25T06:04:25.930951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5773","last_scrub_stamp":"2024-03-25T06:04:25.930824+0000","last_deep_scrub":"27'5773","last_deep_scrub_stamp":"2024-03-25T06:04:25.930824+0000","last_clean_scrub_stamp":"2024-03-25T06:04:25.930824+0000","objects_scrubbed":0,"log_size":5773,"log_dups_size":0,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:27:32.535925+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":50292,"num_write":4009,"num_write_kb":127285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1742","reported_seq":1787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.005580+0000","last_change":"2024-03-25T06:04:08.005623+0000","last_active":"2024-03-25T06:04:08.005580+0000","last_peered":"2024-03-25T06:04:08.005580+0000","last_clean":"2024-03-25T06:04:08.005580+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T06:04:08.005580+0000","last_undegraded":"2024-03-25T06:04:08.005580+0000","last_fullsized":"2024-03-25T06:04:08.005580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1742","last_scrub_stamp":"2024-03-25T06:04:08.005451+0000","last_deep_scrub":"27'1742","last_deep_scrub_stamp":"2024-03-25T06:04:08.005451+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.005451+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:29:02.307473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'3801","reported_seq":3848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:05.061122+0000","last_change":"2024-03-25T06:04:05.061187+0000","last_active":"2024-03-25T06:04:05.061122+0000","last_peered":"2024-03-25T06:04:05.061122+0000","last_clean":"2024-03-25T06:04:05.061122+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T06:04:05.061122+0000","last_undegraded":"2024-03-25T06:04:05.061122+0000","last_fullsized":"2024-03-25T06:04:05.061122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3801","last_scrub_stamp":"2024-03-25T06:04:05.061020+0000","last_deep_scrub":"27'3801","last_deep_scrub_stamp":"2024-03-25T06:04:05.061020+0000","last_clean_scrub_stamp":"2024-03-25T06:04:05.061020+0000","objects_scrubbed":8,"log_size":3801,"log_dups_size":0,"ondisk_log_size":3801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:17:35.585741+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3799,"num_write_kb":31202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5794","reported_seq":5889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:24.711547+0000","last_change":"2024-03-25T06:04:24.711572+0000","last_active":"2024-03-25T06:04:24.711547+0000","last_peered":"2024-03-25T06:04:24.711547+0000","last_clean":"2024-03-25T06:04:24.711547+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T06:04:24.711547+0000","last_undegraded":"2024-03-25T06:04:24.711547+0000","last_fullsized":"2024-03-25T06:04:24.711547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5794","last_scrub_stamp":"2024-03-25T06:04:24.711455+0000","last_deep_scrub":"27'5794","last_deep_scrub_stamp":"2024-03-25T06:04:24.711455+0000","last_clean_scrub_stamp":"2024-03-25T06:04:24.711455+0000","objects_scrubbed":0,"log_size":5794,"log_dups_size":0,"ondisk_log_size":5794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:37.101425+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":13716,"num_write":3987,"num_write_kb":98792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1662","reported_seq":1708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.581934+0000","last_change":"2024-03-25T06:04:22.581975+0000","last_active":"2024-03-25T06:04:22.581934+0000","last_peered":"2024-03-25T06:04:22.581934+0000","last_clean":"2024-03-25T06:04:22.581934+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T06:04:22.581934+0000","last_undegraded":"2024-03-25T06:04:22.581934+0000","last_fullsized":"2024-03-25T06:04:22.581934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1662","last_scrub_stamp":"2024-03-25T06:04:22.581838+0000","last_deep_scrub":"27'1662","last_deep_scrub_stamp":"2024-03-25T06:04:22.581838+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.581838+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:12.086769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'6630","reported_seq":7279,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.800201+0000","last_change":"2024-03-25T06:04:13.506767+0000","last_active":"2024-03-25T06:04:16.800201+0000","last_peered":"2024-03-25T06:04:16.800201+0000","last_clean":"2024-03-25T06:04:16.800201+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T06:04:16.800201+0000","last_undegraded":"2024-03-25T06:04:16.800201+0000","last_fullsized":"2024-03-25T06:04:16.800201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6628","last_scrub_stamp":"2024-03-25T06:04:13.506662+0000","last_deep_scrub":"27'6628","last_deep_scrub_stamp":"2024-03-25T06:04:13.506662+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.506662+0000","objects_scrubbed":9,"log_size":6630,"log_dups_size":0,"ondisk_log_size":6630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:19:11.564938+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15945484,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":602,"num_read_kb":3810,"num_write":6635,"num_write_kb":48814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'6000","reported_seq":6251,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.336786+0000","last_change":"2024-03-25T06:04:18.336827+0000","last_active":"2024-03-25T06:04:18.336786+0000","last_peered":"2024-03-25T06:04:18.336786+0000","last_clean":"2024-03-25T06:04:18.336786+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T06:04:18.336786+0000","last_undegraded":"2024-03-25T06:04:18.336786+0000","last_fullsized":"2024-03-25T06:04:18.336786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6000","last_scrub_stamp":"2024-03-25T06:04:18.336666+0000","last_deep_scrub":"27'6000","last_deep_scrub_stamp":"2024-03-25T06:04:18.336666+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.336666+0000","objects_scrubbed":0,"log_size":6000,"log_dups_size":0,"ondisk_log_size":6000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:07.841597+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":4195,"num_write_kb":128137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1718","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.003683+0000","last_change":"2024-03-25T06:04:08.003724+0000","last_active":"2024-03-25T06:04:08.003683+0000","last_peered":"2024-03-25T06:04:08.003683+0000","last_clean":"2024-03-25T06:04:08.003683+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T06:04:08.003683+0000","last_undegraded":"2024-03-25T06:04:08.003683+0000","last_fullsized":"2024-03-25T06:04:08.003683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1718","last_scrub_stamp":"2024-03-25T06:04:08.003578+0000","last_deep_scrub":"27'1718","last_deep_scrub_stamp":"2024-03-25T06:04:08.003578+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.003578+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:06.241604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5370","reported_seq":5418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.337303+0000","last_change":"2024-03-25T06:04:09.337368+0000","last_active":"2024-03-25T06:04:09.337303+0000","last_peered":"2024-03-25T06:04:09.337303+0000","last_clean":"2024-03-25T06:04:09.337303+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T06:04:09.337303+0000","last_undegraded":"2024-03-25T06:04:09.337303+0000","last_fullsized":"2024-03-25T06:04:09.337303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5370","last_scrub_stamp":"2024-03-25T06:04:09.337202+0000","last_deep_scrub":"27'5370","last_deep_scrub_stamp":"2024-03-25T06:04:09.337202+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.337202+0000","objects_scrubbed":6,"log_size":5370,"log_dups_size":0,"ondisk_log_size":5370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:54.045999+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5368,"num_write_kb":32642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'6005","reported_seq":6101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.972250+0000","last_change":"2024-03-25T06:04:15.972293+0000","last_active":"2024-03-25T06:04:15.972250+0000","last_peered":"2024-03-25T06:04:15.972250+0000","last_clean":"2024-03-25T06:04:15.972250+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T06:04:15.972250+0000","last_undegraded":"2024-03-25T06:04:15.972250+0000","last_fullsized":"2024-03-25T06:04:15.972250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6005","last_scrub_stamp":"2024-03-25T06:04:15.972129+0000","last_deep_scrub":"27'6005","last_deep_scrub_stamp":"2024-03-25T06:04:15.972129+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.972129+0000","objects_scrubbed":0,"log_size":6005,"log_dups_size":0,"ondisk_log_size":6005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:17.921461+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":13970,"num_write":4188,"num_write_kb":117446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1734","reported_seq":1784,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.842263+0000","last_change":"2024-03-25T06:04:19.842312+0000","last_active":"2024-03-25T06:04:19.842263+0000","last_peered":"2024-03-25T06:04:19.842263+0000","last_clean":"2024-03-25T06:04:19.842263+0000","last_became_active":"2024-03-25T05:38:20.652007+0000","last_became_peered":"2024-03-25T05:38:20.652007+0000","last_unstale":"2024-03-25T06:04:19.842263+0000","last_undegraded":"2024-03-25T06:04:19.842263+0000","last_fullsized":"2024-03-25T06:04:19.842263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1734","last_scrub_stamp":"2024-03-25T06:04:19.842157+0000","last_deep_scrub":"27'1734","last_deep_scrub_stamp":"2024-03-25T06:04:19.842157+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.842157+0000","objects_scrubbed":0,"log_size":1734,"log_dups_size":0,"ondisk_log_size":1734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:37.930105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5608","reported_seq":5656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.498800+0000","last_change":"2024-03-25T06:04:10.498853+0000","last_active":"2024-03-25T06:04:10.498800+0000","last_peered":"2024-03-25T06:04:10.498800+0000","last_clean":"2024-03-25T06:04:10.498800+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T06:04:10.498800+0000","last_undegraded":"2024-03-25T06:04:10.498800+0000","last_fullsized":"2024-03-25T06:04:10.498800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5608","last_scrub_stamp":"2024-03-25T06:04:10.498724+0000","last_deep_scrub":"27'5608","last_deep_scrub_stamp":"2024-03-25T06:04:10.498724+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.498724+0000","objects_scrubbed":4,"log_size":5608,"log_dups_size":0,"ondisk_log_size":5608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:26.542055+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5607,"num_write_kb":40642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5713","reported_seq":6173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.946720+0000","last_change":"2024-03-25T06:04:20.946761+0000","last_active":"2024-03-25T06:04:20.946720+0000","last_peered":"2024-03-25T06:04:20.946720+0000","last_clean":"2024-03-25T06:04:20.946720+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T06:04:20.946720+0000","last_undegraded":"2024-03-25T06:04:20.946720+0000","last_fullsized":"2024-03-25T06:04:20.946720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5713","last_scrub_stamp":"2024-03-25T06:04:20.946598+0000","last_deep_scrub":"27'5713","last_deep_scrub_stamp":"2024-03-25T06:04:20.946598+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.946598+0000","objects_scrubbed":0,"log_size":5713,"log_dups_size":0,"ondisk_log_size":5713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:13:26.707355+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":106426,"num_write":4014,"num_write_kb":116763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1704","reported_seq":1750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.470951+0000","last_change":"2024-03-25T06:04:08.470951+0000","last_active":"2024-03-25T06:04:08.470951+0000","last_peered":"2024-03-25T06:04:08.470951+0000","last_clean":"2024-03-25T06:04:08.470951+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T06:04:08.470951+0000","last_undegraded":"2024-03-25T06:04:08.470951+0000","last_fullsized":"2024-03-25T06:04:08.470951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1704","last_scrub_stamp":"2024-03-25T06:04:08.470859+0000","last_deep_scrub":"27'1704","last_deep_scrub_stamp":"2024-03-25T06:04:08.470859+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.470859+0000","objects_scrubbed":0,"log_size":1704,"log_dups_size":0,"ondisk_log_size":1704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:53.564721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4521","reported_seq":5369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.443357+0000","last_change":"2024-03-25T06:04:11.443405+0000","last_active":"2024-03-25T06:04:11.443357+0000","last_peered":"2024-03-25T06:04:11.443357+0000","last_clean":"2024-03-25T06:04:11.443357+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T06:04:11.443357+0000","last_undegraded":"2024-03-25T06:04:11.443357+0000","last_fullsized":"2024-03-25T06:04:11.443357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4521","last_scrub_stamp":"2024-03-25T06:04:11.443262+0000","last_deep_scrub":"27'4521","last_deep_scrub_stamp":"2024-03-25T06:04:11.443262+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.443262+0000","objects_scrubbed":4,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:56.537124+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":802,"num_read_kb":4614,"num_write":4526,"num_write_kb":35760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6267","reported_seq":6671,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.962852+0000","last_change":"2024-03-25T06:04:22.962900+0000","last_active":"2024-03-25T06:04:22.962852+0000","last_peered":"2024-03-25T06:04:22.962852+0000","last_clean":"2024-03-25T06:04:22.962852+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T06:04:22.962852+0000","last_undegraded":"2024-03-25T06:04:22.962852+0000","last_fullsized":"2024-03-25T06:04:22.962852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6267","last_scrub_stamp":"2024-03-25T06:04:22.962737+0000","last_deep_scrub":"27'6267","last_deep_scrub_stamp":"2024-03-25T06:04:22.962737+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.962737+0000","objects_scrubbed":0,"log_size":6267,"log_dups_size":0,"ondisk_log_size":6267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:30:08.243359+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":92202,"num_write":4370,"num_write_kb":119524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5994","reported_seq":6101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.904708+0000","last_change":"2024-03-25T06:04:17.904752+0000","last_active":"2024-03-25T06:04:17.904708+0000","last_peered":"2024-03-25T06:04:17.904708+0000","last_clean":"2024-03-25T06:04:17.904708+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T06:04:17.904708+0000","last_undegraded":"2024-03-25T06:04:17.904708+0000","last_fullsized":"2024-03-25T06:04:17.904708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5994","last_scrub_stamp":"2024-03-25T06:04:17.904584+0000","last_deep_scrub":"27'5994","last_deep_scrub_stamp":"2024-03-25T06:04:17.904584+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.904584+0000","objects_scrubbed":0,"log_size":5994,"log_dups_size":0,"ondisk_log_size":5994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:25.559745+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":4233,"num_write_kb":107763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1683","reported_seq":1729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.268918+0000","last_change":"2024-03-25T06:04:15.268918+0000","last_active":"2024-03-25T06:04:15.268918+0000","last_peered":"2024-03-25T06:04:15.268918+0000","last_clean":"2024-03-25T06:04:15.268918+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T06:04:15.268918+0000","last_undegraded":"2024-03-25T06:04:15.268918+0000","last_fullsized":"2024-03-25T06:04:15.268918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1683","last_scrub_stamp":"2024-03-25T06:04:15.268774+0000","last_deep_scrub":"27'1683","last_deep_scrub_stamp":"2024-03-25T06:04:15.268774+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.268774+0000","objects_scrubbed":0,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:17.218107+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'8149","reported_seq":8197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.522530+0000","last_change":"2024-03-25T06:04:11.522563+0000","last_active":"2024-03-25T06:04:11.522530+0000","last_peered":"2024-03-25T06:04:11.522530+0000","last_clean":"2024-03-25T06:04:11.522530+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T06:04:11.522530+0000","last_undegraded":"2024-03-25T06:04:11.522530+0000","last_fullsized":"2024-03-25T06:04:11.522530+0000","mapping_epoch":17,"log_start":"27'600","ondisk_log_start":"27'600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8149","last_scrub_stamp":"2024-03-25T06:04:11.522467+0000","last_deep_scrub":"27'8149","last_deep_scrub_stamp":"2024-03-25T06:04:11.522467+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.522467+0000","objects_scrubbed":3,"log_size":7549,"log_dups_size":0,"ondisk_log_size":7549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:56.231264+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8142,"num_write_kb":58721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'6008","reported_seq":6339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.522910+0000","last_change":"2024-03-25T06:04:21.522957+0000","last_active":"2024-03-25T06:04:21.522910+0000","last_peered":"2024-03-25T06:04:21.522910+0000","last_clean":"2024-03-25T06:04:21.522910+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T06:04:21.522910+0000","last_undegraded":"2024-03-25T06:04:21.522910+0000","last_fullsized":"2024-03-25T06:04:21.522910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6008","last_scrub_stamp":"2024-03-25T06:04:21.522790+0000","last_deep_scrub":"27'6008","last_deep_scrub_stamp":"2024-03-25T06:04:21.522790+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.522790+0000","objects_scrubbed":0,"log_size":6008,"log_dups_size":0,"ondisk_log_size":6008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:23.472123+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":73406,"num_write":4233,"num_write_kb":113322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1753","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.812578+0000","last_change":"2024-03-25T06:04:07.812578+0000","last_active":"2024-03-25T06:04:07.812578+0000","last_peered":"2024-03-25T06:04:07.812578+0000","last_clean":"2024-03-25T06:04:07.812578+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T06:04:07.812578+0000","last_undegraded":"2024-03-25T06:04:07.812578+0000","last_fullsized":"2024-03-25T06:04:07.812578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1753","last_scrub_stamp":"2024-03-25T06:04:07.812444+0000","last_deep_scrub":"27'1753","last_deep_scrub_stamp":"2024-03-25T06:04:07.812444+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.812444+0000","objects_scrubbed":0,"log_size":1753,"log_dups_size":0,"ondisk_log_size":1753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:31:10.477058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4104","reported_seq":4151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.997154+0000","last_change":"2024-03-25T06:04:11.997154+0000","last_active":"2024-03-25T06:04:11.997154+0000","last_peered":"2024-03-25T06:04:11.997154+0000","last_clean":"2024-03-25T06:04:11.997154+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T06:04:11.997154+0000","last_undegraded":"2024-03-25T06:04:11.997154+0000","last_fullsized":"2024-03-25T06:04:11.997154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4104","last_scrub_stamp":"2024-03-25T06:04:11.997032+0000","last_deep_scrub":"27'4104","last_deep_scrub_stamp":"2024-03-25T06:04:11.997032+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.997032+0000","objects_scrubbed":5,"log_size":4104,"log_dups_size":0,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:50:56.184732+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4095,"num_write_kb":35371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7953","reported_seq":7999,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.542522+0000","last_change":"2024-03-25T06:04:10.542585+0000","last_active":"2024-03-25T06:04:10.542522+0000","last_peered":"2024-03-25T06:04:10.542522+0000","last_clean":"2024-03-25T06:04:10.542522+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T06:04:10.542522+0000","last_undegraded":"2024-03-25T06:04:10.542522+0000","last_fullsized":"2024-03-25T06:04:10.542522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7953","last_scrub_stamp":"2024-03-25T06:04:10.542426+0000","last_deep_scrub":"27'7953","last_deep_scrub_stamp":"2024-03-25T06:04:10.542426+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.542426+0000","objects_scrubbed":6,"log_size":7953,"log_dups_size":0,"ondisk_log_size":7953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:47:22.304570+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7943,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1690","reported_seq":1734,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.002927+0000","last_change":"2024-03-25T06:04:11.002965+0000","last_active":"2024-03-25T06:04:11.002927+0000","last_peered":"2024-03-25T06:04:11.002927+0000","last_clean":"2024-03-25T06:04:11.002927+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T06:04:11.002927+0000","last_undegraded":"2024-03-25T06:04:11.002927+0000","last_fullsized":"2024-03-25T06:04:11.002927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1690","last_scrub_stamp":"2024-03-25T06:04:11.002835+0000","last_deep_scrub":"27'1690","last_deep_scrub_stamp":"2024-03-25T06:04:11.002835+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.002835+0000","objects_scrubbed":0,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:43:51.433042+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'6118","reported_seq":6239,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.228209+0000","last_change":"2024-03-25T06:04:11.228251+0000","last_active":"2024-03-25T06:04:11.228209+0000","last_peered":"2024-03-25T06:04:11.228209+0000","last_clean":"2024-03-25T06:04:11.228209+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T06:04:11.228209+0000","last_undegraded":"2024-03-25T06:04:11.228209+0000","last_fullsized":"2024-03-25T06:04:11.228209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6118","last_scrub_stamp":"2024-03-25T06:04:11.228094+0000","last_deep_scrub":"27'6118","last_deep_scrub_stamp":"2024-03-25T06:04:11.228094+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.228094+0000","objects_scrubbed":0,"log_size":6118,"log_dups_size":0,"ondisk_log_size":6118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:18.700607+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":4277,"num_write_kb":113266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6315","reported_seq":6361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.006484+0000","last_change":"2024-03-25T06:04:13.006548+0000","last_active":"2024-03-25T06:04:13.006484+0000","last_peered":"2024-03-25T06:04:13.006484+0000","last_clean":"2024-03-25T06:04:13.006484+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T06:04:13.006484+0000","last_undegraded":"2024-03-25T06:04:13.006484+0000","last_fullsized":"2024-03-25T06:04:13.006484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6315","last_scrub_stamp":"2024-03-25T06:04:13.006373+0000","last_deep_scrub":"27'6315","last_deep_scrub_stamp":"2024-03-25T06:04:13.006373+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.006373+0000","objects_scrubbed":8,"log_size":6315,"log_dups_size":0,"ondisk_log_size":6315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:02.539836+0000","scrub_duration":112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166841,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6301,"num_write_kb":53214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1724","reported_seq":1769,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.979444+0000","last_change":"2024-03-25T06:04:08.979482+0000","last_active":"2024-03-25T06:04:08.979444+0000","last_peered":"2024-03-25T06:04:08.979444+0000","last_clean":"2024-03-25T06:04:08.979444+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T06:04:08.979444+0000","last_undegraded":"2024-03-25T06:04:08.979444+0000","last_fullsized":"2024-03-25T06:04:08.979444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1724","last_scrub_stamp":"2024-03-25T06:04:08.979331+0000","last_deep_scrub":"27'1724","last_deep_scrub_stamp":"2024-03-25T06:04:08.979331+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.979331+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:25.022662+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'6483","reported_seq":6985,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.921349+0000","last_change":"2024-03-25T06:04:21.921375+0000","last_active":"2024-03-25T06:04:21.921349+0000","last_peered":"2024-03-25T06:04:21.921349+0000","last_clean":"2024-03-25T06:04:21.921349+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T06:04:21.921349+0000","last_undegraded":"2024-03-25T06:04:21.921349+0000","last_fullsized":"2024-03-25T06:04:21.921349+0000","mapping_epoch":22,"log_start":"27'200","ondisk_log_start":"27'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6483","last_scrub_stamp":"2024-03-25T06:04:21.921247+0000","last_deep_scrub":"27'6483","last_deep_scrub_stamp":"2024-03-25T06:04:21.921247+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.921247+0000","objects_scrubbed":0,"log_size":6283,"log_dups_size":0,"ondisk_log_size":6283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:40:30.346616+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":117348,"num_write":4686,"num_write_kb":179694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1680","reported_seq":1726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.518445+0000","last_change":"2024-03-25T06:04:18.518467+0000","last_active":"2024-03-25T06:04:18.518445+0000","last_peered":"2024-03-25T06:04:18.518445+0000","last_clean":"2024-03-25T06:04:18.518445+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T06:04:18.518445+0000","last_undegraded":"2024-03-25T06:04:18.518445+0000","last_fullsized":"2024-03-25T06:04:18.518445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1680","last_scrub_stamp":"2024-03-25T06:04:18.518382+0000","last_deep_scrub":"27'1680","last_deep_scrub_stamp":"2024-03-25T06:04:18.518382+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.518382+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:39.895434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1763","reported_seq":1815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.217786+0000","last_change":"2024-03-25T06:04:12.217823+0000","last_active":"2024-03-25T06:04:12.217786+0000","last_peered":"2024-03-25T06:04:12.217786+0000","last_clean":"2024-03-25T06:04:12.217786+0000","last_became_active":"2024-03-25T05:38:20.652189+0000","last_became_peered":"2024-03-25T05:38:20.652189+0000","last_unstale":"2024-03-25T06:04:12.217786+0000","last_undegraded":"2024-03-25T06:04:12.217786+0000","last_fullsized":"2024-03-25T06:04:12.217786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1763","last_scrub_stamp":"2024-03-25T06:04:12.217686+0000","last_deep_scrub":"27'1763","last_deep_scrub_stamp":"2024-03-25T06:04:12.217686+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.217686+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:23:57.310278+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1678","reported_seq":1725,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.594245+0000","last_change":"2024-03-25T06:04:20.594282+0000","last_active":"2024-03-25T06:04:20.594245+0000","last_peered":"2024-03-25T06:04:20.594245+0000","last_clean":"2024-03-25T06:04:20.594245+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T06:04:20.594245+0000","last_undegraded":"2024-03-25T06:04:20.594245+0000","last_fullsized":"2024-03-25T06:04:20.594245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1678","last_scrub_stamp":"2024-03-25T06:04:20.594148+0000","last_deep_scrub":"27'1678","last_deep_scrub_stamp":"2024-03-25T06:04:20.594148+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.594148+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:10.099079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1791","reported_seq":1837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:03.973415+0000","last_change":"2024-03-25T06:04:03.973454+0000","last_active":"2024-03-25T06:04:03.973415+0000","last_peered":"2024-03-25T06:04:03.973415+0000","last_clean":"2024-03-25T06:04:03.973415+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T06:04:03.973415+0000","last_undegraded":"2024-03-25T06:04:03.973415+0000","last_fullsized":"2024-03-25T06:04:03.973415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1791","last_scrub_stamp":"2024-03-25T06:04:03.973299+0000","last_deep_scrub":"27'1791","last_deep_scrub_stamp":"2024-03-25T06:04:03.973299+0000","last_clean_scrub_stamp":"2024-03-25T06:04:03.973299+0000","objects_scrubbed":0,"log_size":1791,"log_dups_size":0,"ondisk_log_size":1791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:45:41.687046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1719","reported_seq":1765,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.941375+0000","last_change":"2024-03-25T06:04:16.941413+0000","last_active":"2024-03-25T06:04:16.941375+0000","last_peered":"2024-03-25T06:04:16.941375+0000","last_clean":"2024-03-25T06:04:16.941375+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T06:04:16.941375+0000","last_undegraded":"2024-03-25T06:04:16.941375+0000","last_fullsized":"2024-03-25T06:04:16.941375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1719","last_scrub_stamp":"2024-03-25T06:04:16.941260+0000","last_deep_scrub":"27'1719","last_deep_scrub_stamp":"2024-03-25T06:04:16.941260+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.941260+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:06.446191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1678","reported_seq":1725,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:05.246842+0000","last_change":"2024-03-25T06:04:05.246883+0000","last_active":"2024-03-25T06:04:05.246842+0000","last_peered":"2024-03-25T06:04:05.246842+0000","last_clean":"2024-03-25T06:04:05.246842+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T06:04:05.246842+0000","last_undegraded":"2024-03-25T06:04:05.246842+0000","last_fullsized":"2024-03-25T06:04:05.246842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1678","last_scrub_stamp":"2024-03-25T06:04:05.246731+0000","last_deep_scrub":"27'1678","last_deep_scrub_stamp":"2024-03-25T06:04:05.246731+0000","last_clean_scrub_stamp":"2024-03-25T06:04:05.246731+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:50.340593+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1768","reported_seq":1814,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.561387+0000","last_change":"2024-03-25T06:04:19.561407+0000","last_active":"2024-03-25T06:04:19.561387+0000","last_peered":"2024-03-25T06:04:19.561387+0000","last_clean":"2024-03-25T06:04:19.561387+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T06:04:19.561387+0000","last_undegraded":"2024-03-25T06:04:19.561387+0000","last_fullsized":"2024-03-25T06:04:19.561387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1768","last_scrub_stamp":"2024-03-25T06:04:19.561323+0000","last_deep_scrub":"27'1768","last_deep_scrub_stamp":"2024-03-25T06:04:19.561323+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.561323+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:04:01.622273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1715","reported_seq":1761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.992301+0000","last_change":"2024-03-25T06:04:15.992351+0000","last_active":"2024-03-25T06:04:15.992301+0000","last_peered":"2024-03-25T06:04:15.992301+0000","last_clean":"2024-03-25T06:04:15.992301+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T06:04:15.992301+0000","last_undegraded":"2024-03-25T06:04:15.992301+0000","last_fullsized":"2024-03-25T06:04:15.992301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1715","last_scrub_stamp":"2024-03-25T06:04:15.992203+0000","last_deep_scrub":"27'1715","last_deep_scrub_stamp":"2024-03-25T06:04:15.992203+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.992203+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:01.532864+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1695","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.618815+0000","last_change":"2024-03-25T06:04:22.618853+0000","last_active":"2024-03-25T06:04:22.618815+0000","last_peered":"2024-03-25T06:04:22.618815+0000","last_clean":"2024-03-25T06:04:22.618815+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T06:04:22.618815+0000","last_undegraded":"2024-03-25T06:04:22.618815+0000","last_fullsized":"2024-03-25T06:04:22.618815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1695","last_scrub_stamp":"2024-03-25T06:04:22.618731+0000","last_deep_scrub":"27'1695","last_deep_scrub_stamp":"2024-03-25T06:04:22.618731+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.618731+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:23.501448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1732","reported_seq":1778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.964351+0000","last_change":"2024-03-25T06:04:14.964351+0000","last_active":"2024-03-25T06:04:14.964351+0000","last_peered":"2024-03-25T06:04:14.964351+0000","last_clean":"2024-03-25T06:04:14.964351+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T06:04:14.964351+0000","last_undegraded":"2024-03-25T06:04:14.964351+0000","last_fullsized":"2024-03-25T06:04:14.964351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1732","last_scrub_stamp":"2024-03-25T06:04:14.964214+0000","last_deep_scrub":"27'1732","last_deep_scrub_stamp":"2024-03-25T06:04:14.964214+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.964214+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:12.035453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1733","reported_seq":1779,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.431588+0000","last_change":"2024-03-25T06:04:09.431625+0000","last_active":"2024-03-25T06:04:09.431588+0000","last_peered":"2024-03-25T06:04:09.431588+0000","last_clean":"2024-03-25T06:04:09.431588+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T06:04:09.431588+0000","last_undegraded":"2024-03-25T06:04:09.431588+0000","last_fullsized":"2024-03-25T06:04:09.431588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1733","last_scrub_stamp":"2024-03-25T06:04:09.431499+0000","last_deep_scrub":"27'1733","last_deep_scrub_stamp":"2024-03-25T06:04:09.431499+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.431499+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:07.669526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1758","reported_seq":1803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.991199+0000","last_change":"2024-03-25T06:04:09.991237+0000","last_active":"2024-03-25T06:04:09.991199+0000","last_peered":"2024-03-25T06:04:09.991199+0000","last_clean":"2024-03-25T06:04:09.991199+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T06:04:09.991199+0000","last_undegraded":"2024-03-25T06:04:09.991199+0000","last_fullsized":"2024-03-25T06:04:09.991199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1758","last_scrub_stamp":"2024-03-25T06:04:09.991098+0000","last_deep_scrub":"27'1758","last_deep_scrub_stamp":"2024-03-25T06:04:09.991098+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.991098+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:57:02.606098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1731","reported_seq":1776,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.491029+0000","last_change":"2024-03-25T06:04:17.491067+0000","last_active":"2024-03-25T06:04:17.491029+0000","last_peered":"2024-03-25T06:04:17.491029+0000","last_clean":"2024-03-25T06:04:17.491029+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T06:04:17.491029+0000","last_undegraded":"2024-03-25T06:04:17.491029+0000","last_fullsized":"2024-03-25T06:04:17.491029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1731","last_scrub_stamp":"2024-03-25T06:04:17.490932+0000","last_deep_scrub":"27'1731","last_deep_scrub_stamp":"2024-03-25T06:04:17.490932+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.490932+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:24.895671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1775","reported_seq":1821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.605505+0000","last_change":"2024-03-25T06:04:23.605543+0000","last_active":"2024-03-25T06:04:23.605505+0000","last_peered":"2024-03-25T06:04:23.605505+0000","last_clean":"2024-03-25T06:04:23.605505+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T06:04:23.605505+0000","last_undegraded":"2024-03-25T06:04:23.605505+0000","last_fullsized":"2024-03-25T06:04:23.605505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1775","last_scrub_stamp":"2024-03-25T06:04:23.605412+0000","last_deep_scrub":"27'1775","last_deep_scrub_stamp":"2024-03-25T06:04:23.605412+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.605412+0000","objects_scrubbed":0,"log_size":1775,"log_dups_size":0,"ondisk_log_size":1775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:31.260573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1682","reported_seq":1728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.217643+0000","last_change":"2024-03-25T06:04:10.217679+0000","last_active":"2024-03-25T06:04:10.217643+0000","last_peered":"2024-03-25T06:04:10.217643+0000","last_clean":"2024-03-25T06:04:10.217643+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T06:04:10.217643+0000","last_undegraded":"2024-03-25T06:04:10.217643+0000","last_fullsized":"2024-03-25T06:04:10.217643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1682","last_scrub_stamp":"2024-03-25T06:04:10.217551+0000","last_deep_scrub":"27'1682","last_deep_scrub_stamp":"2024-03-25T06:04:10.217551+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.217551+0000","objects_scrubbed":0,"log_size":1682,"log_dups_size":0,"ondisk_log_size":1682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:43:33.028198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1721","reported_seq":1767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.562004+0000","last_change":"2024-03-25T06:04:17.562044+0000","last_active":"2024-03-25T06:04:17.562004+0000","last_peered":"2024-03-25T06:04:17.562004+0000","last_clean":"2024-03-25T06:04:17.562004+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T06:04:17.562004+0000","last_undegraded":"2024-03-25T06:04:17.562004+0000","last_fullsized":"2024-03-25T06:04:17.562004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1721","last_scrub_stamp":"2024-03-25T06:04:17.561879+0000","last_deep_scrub":"27'1721","last_deep_scrub_stamp":"2024-03-25T06:04:17.561879+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.561879+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:19.511212+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'1641","reported_seq":1687,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.631854+0000","last_change":"2024-03-25T06:04:19.631876+0000","last_active":"2024-03-25T06:04:19.631854+0000","last_peered":"2024-03-25T06:04:19.631854+0000","last_clean":"2024-03-25T06:04:19.631854+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T06:04:19.631854+0000","last_undegraded":"2024-03-25T06:04:19.631854+0000","last_fullsized":"2024-03-25T06:04:19.631854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1641","last_scrub_stamp":"2024-03-25T06:04:19.631796+0000","last_deep_scrub":"27'1641","last_deep_scrub_stamp":"2024-03-25T06:04:19.631796+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.631796+0000","objects_scrubbed":0,"log_size":1641,"log_dups_size":0,"ondisk_log_size":1641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:05.172457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'1764","reported_seq":1815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.392157+0000","last_change":"2024-03-25T06:04:21.392195+0000","last_active":"2024-03-25T06:04:21.392157+0000","last_peered":"2024-03-25T06:04:21.392157+0000","last_clean":"2024-03-25T06:04:21.392157+0000","last_became_active":"2024-03-25T05:38:20.652582+0000","last_became_peered":"2024-03-25T05:38:20.652582+0000","last_unstale":"2024-03-25T06:04:21.392157+0000","last_undegraded":"2024-03-25T06:04:21.392157+0000","last_fullsized":"2024-03-25T06:04:21.392157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1764","last_scrub_stamp":"2024-03-25T06:04:21.392019+0000","last_deep_scrub":"27'1764","last_deep_scrub_stamp":"2024-03-25T06:04:21.392019+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.392019+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:39.479967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1705","reported_seq":1750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.986938+0000","last_change":"2024-03-25T06:04:11.986978+0000","last_active":"2024-03-25T06:04:11.986938+0000","last_peered":"2024-03-25T06:04:11.986938+0000","last_clean":"2024-03-25T06:04:11.986938+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T06:04:11.986938+0000","last_undegraded":"2024-03-25T06:04:11.986938+0000","last_fullsized":"2024-03-25T06:04:11.986938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1705","last_scrub_stamp":"2024-03-25T06:04:11.986837+0000","last_deep_scrub":"27'1705","last_deep_scrub_stamp":"2024-03-25T06:04:11.986837+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.986837+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:47:39.609709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1692","reported_seq":1737,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.869433+0000","last_change":"2024-03-25T06:04:09.869471+0000","last_active":"2024-03-25T06:04:09.869433+0000","last_peered":"2024-03-25T06:04:09.869433+0000","last_clean":"2024-03-25T06:04:09.869433+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T06:04:09.869433+0000","last_undegraded":"2024-03-25T06:04:09.869433+0000","last_fullsized":"2024-03-25T06:04:09.869433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1692","last_scrub_stamp":"2024-03-25T06:04:09.869314+0000","last_deep_scrub":"27'1692","last_deep_scrub_stamp":"2024-03-25T06:04:09.869314+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.869314+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:17.274053+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1623","reported_seq":1669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.984590+0000","last_change":"2024-03-25T06:04:11.984611+0000","last_active":"2024-03-25T06:04:11.984590+0000","last_peered":"2024-03-25T06:04:11.984590+0000","last_clean":"2024-03-25T06:04:11.984590+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T06:04:11.984590+0000","last_undegraded":"2024-03-25T06:04:11.984590+0000","last_fullsized":"2024-03-25T06:04:11.984590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1623","last_scrub_stamp":"2024-03-25T06:04:11.984523+0000","last_deep_scrub":"27'1623","last_deep_scrub_stamp":"2024-03-25T06:04:11.984523+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.984523+0000","objects_scrubbed":0,"log_size":1623,"log_dups_size":0,"ondisk_log_size":1623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:19.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1678","reported_seq":1723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.470079+0000","last_change":"2024-03-25T06:04:16.470120+0000","last_active":"2024-03-25T06:04:16.470079+0000","last_peered":"2024-03-25T06:04:16.470079+0000","last_clean":"2024-03-25T06:04:16.470079+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T06:04:16.470079+0000","last_undegraded":"2024-03-25T06:04:16.470079+0000","last_fullsized":"2024-03-25T06:04:16.470079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1678","last_scrub_stamp":"2024-03-25T06:04:16.469981+0000","last_deep_scrub":"27'1678","last_deep_scrub_stamp":"2024-03-25T06:04:16.469981+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.469981+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:47:00.115758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1750","reported_seq":1795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.538013+0000","last_change":"2024-03-25T06:04:20.538049+0000","last_active":"2024-03-25T06:04:20.538013+0000","last_peered":"2024-03-25T06:04:20.538013+0000","last_clean":"2024-03-25T06:04:20.538013+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T06:04:20.538013+0000","last_undegraded":"2024-03-25T06:04:20.538013+0000","last_fullsized":"2024-03-25T06:04:20.538013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1750","last_scrub_stamp":"2024-03-25T06:04:20.537908+0000","last_deep_scrub":"27'1750","last_deep_scrub_stamp":"2024-03-25T06:04:20.537908+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.537908+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:10.071371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1767","reported_seq":1813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.578618+0000","last_change":"2024-03-25T06:04:21.578640+0000","last_active":"2024-03-25T06:04:21.578618+0000","last_peered":"2024-03-25T06:04:21.578618+0000","last_clean":"2024-03-25T06:04:21.578618+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T06:04:21.578618+0000","last_undegraded":"2024-03-25T06:04:21.578618+0000","last_fullsized":"2024-03-25T06:04:21.578618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1767","last_scrub_stamp":"2024-03-25T06:04:21.578556+0000","last_deep_scrub":"27'1767","last_deep_scrub_stamp":"2024-03-25T06:04:21.578556+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.578556+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:07.119218+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1703","reported_seq":1747,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.837337+0000","last_change":"2024-03-25T06:04:08.837378+0000","last_active":"2024-03-25T06:04:08.837337+0000","last_peered":"2024-03-25T06:04:08.837337+0000","last_clean":"2024-03-25T06:04:08.837337+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T06:04:08.837337+0000","last_undegraded":"2024-03-25T06:04:08.837337+0000","last_fullsized":"2024-03-25T06:04:08.837337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1703","last_scrub_stamp":"2024-03-25T06:04:08.837220+0000","last_deep_scrub":"27'1703","last_deep_scrub_stamp":"2024-03-25T06:04:08.837220+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.837220+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:52.482997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1680","reported_seq":1709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.254430+0000","last_change":"2024-03-25T06:04:13.254468+0000","last_active":"2024-03-25T06:04:13.254430+0000","last_peered":"2024-03-25T06:04:13.254430+0000","last_clean":"2024-03-25T06:04:13.254430+0000","last_became_active":"2024-03-25T05:38:20.655743+0000","last_became_peered":"2024-03-25T05:38:20.655743+0000","last_unstale":"2024-03-25T06:04:13.254430+0000","last_undegraded":"2024-03-25T06:04:13.254430+0000","last_fullsized":"2024-03-25T06:04:13.254430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1680","last_scrub_stamp":"2024-03-25T06:04:13.254338+0000","last_deep_scrub":"27'1680","last_deep_scrub_stamp":"2024-03-25T06:04:13.254338+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.254338+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:44:19.995014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1655","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.587030+0000","last_change":"2024-03-25T06:04:18.587075+0000","last_active":"2024-03-25T06:04:18.587030+0000","last_peered":"2024-03-25T06:04:18.587030+0000","last_clean":"2024-03-25T06:04:18.587030+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T06:04:18.587030+0000","last_undegraded":"2024-03-25T06:04:18.587030+0000","last_fullsized":"2024-03-25T06:04:18.587030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1655","last_scrub_stamp":"2024-03-25T06:04:18.586936+0000","last_deep_scrub":"27'1655","last_deep_scrub_stamp":"2024-03-25T06:04:18.586936+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.586936+0000","objects_scrubbed":0,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:15.658175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1748","reported_seq":1793,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:24.613191+0000","last_change":"2024-03-25T06:04:24.613212+0000","last_active":"2024-03-25T06:04:24.613191+0000","last_peered":"2024-03-25T06:04:24.613191+0000","last_clean":"2024-03-25T06:04:24.613191+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T06:04:24.613191+0000","last_undegraded":"2024-03-25T06:04:24.613191+0000","last_fullsized":"2024-03-25T06:04:24.613191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1748","last_scrub_stamp":"2024-03-25T06:04:24.613125+0000","last_deep_scrub":"27'1748","last_deep_scrub_stamp":"2024-03-25T06:04:24.613125+0000","last_clean_scrub_stamp":"2024-03-25T06:04:24.613125+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:25.495842+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1743","reported_seq":1791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.641150+0000","last_change":"2024-03-25T06:04:21.641191+0000","last_active":"2024-03-25T06:04:21.641150+0000","last_peered":"2024-03-25T06:04:21.641150+0000","last_clean":"2024-03-25T06:04:21.641150+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T06:04:21.641150+0000","last_undegraded":"2024-03-25T06:04:21.641150+0000","last_fullsized":"2024-03-25T06:04:21.641150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1743","last_scrub_stamp":"2024-03-25T06:04:21.641057+0000","last_deep_scrub":"27'1743","last_deep_scrub_stamp":"2024-03-25T06:04:21.641057+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.641057+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:29.296218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1793","reported_seq":1839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.896975+0000","last_change":"2024-03-25T06:04:13.897012+0000","last_active":"2024-03-25T06:04:13.896975+0000","last_peered":"2024-03-25T06:04:13.896975+0000","last_clean":"2024-03-25T06:04:13.896975+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T06:04:13.896975+0000","last_undegraded":"2024-03-25T06:04:13.896975+0000","last_fullsized":"2024-03-25T06:04:13.896975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1793","last_scrub_stamp":"2024-03-25T06:04:13.896866+0000","last_deep_scrub":"27'1793","last_deep_scrub_stamp":"2024-03-25T06:04:13.896866+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.896866+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:22:04.227428+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1658","reported_seq":1705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.288648+0000","last_change":"2024-03-25T06:04:14.288686+0000","last_active":"2024-03-25T06:04:14.288648+0000","last_peered":"2024-03-25T06:04:14.288648+0000","last_clean":"2024-03-25T06:04:14.288648+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T06:04:14.288648+0000","last_undegraded":"2024-03-25T06:04:14.288648+0000","last_fullsized":"2024-03-25T06:04:14.288648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1658","last_scrub_stamp":"2024-03-25T06:04:14.288555+0000","last_deep_scrub":"27'1658","last_deep_scrub_stamp":"2024-03-25T06:04:14.288555+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.288555+0000","objects_scrubbed":0,"log_size":1658,"log_dups_size":0,"ondisk_log_size":1658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:03.822017+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1640","reported_seq":1679,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:03:59.211996+0000","last_change":"2024-03-25T05:37:31.194054+0000","last_active":"2024-03-25T06:03:59.211996+0000","last_peered":"2024-03-25T06:03:59.211996+0000","last_clean":"2024-03-25T06:03:59.211996+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T06:03:59.211996+0000","last_undegraded":"2024-03-25T06:03:59.211996+0000","last_fullsized":"2024-03-25T06:03:59.211996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-25T05:37:30.387049+0000","last_clean_scrub_stamp":"2024-03-25T05:37:30.387049+0000","objects_scrubbed":0,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5893,"num_read_kb":1496822,"num_write":138342,"num_write_kb":3815118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195984,"ondisk_log_size":195984,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110026,"ondisk_log_size":110026,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":234056899,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":2370,"num_read_kb":13152,"num_write":159064,"num_write_kb":1157067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33779,"num_omap_keys":66,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":312410112,"data_stored":468113798,"data_compressed":49584516,"data_compressed_allocated":73408512,"data_compressed_original":229359616,"omap_allocated":0,"internal_metadata":0},"log_size":154613,"ondisk_log_size":154613,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575174,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":762648,"kb_used_data":37392,"kb_used_omap":1,"kb_used_meta":725246,"kb_avail":93609192,"statfs":{"total":96636764160,"available":95855812608,"internally_reserved":0,"allocated":38289408,"data_stored":59434799,"data_compressed":6535216,"data_compressed_allocated":9568256,"data_compressed_original":30920704,"omap_allocated":1590,"internal_metadata":742652362},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575175,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":832220,"kb_used_data":47380,"kb_used_omap":1,"kb_used_meta":784830,"kb_avail":93539620,"statfs":{"total":96636764160,"available":95784570880,"internally_reserved":0,"allocated":48517120,"data_stored":74788605,"data_compressed":8150968,"data_compressed_allocated":11956224,"data_compressed_original":38424576,"omap_allocated":1594,"internal_metadata":803666374},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575174,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":797816,"kb_used_data":40624,"kb_used_omap":1,"kb_used_meta":757182,"kb_avail":93574024,"statfs":{"total":96636764160,"available":95819800576,"internally_reserved":0,"allocated":41598976,"data_stored":58846263,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":1595,"internal_metadata":775354821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575174,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":721680,"kb_used_data":36680,"kb_used_omap":1,"kb_used_meta":684990,"kb_avail":93650160,"statfs":{"total":96636764160,"available":95897763840,"internally_reserved":0,"allocated":37560320,"data_stored":54649357,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":1595,"internal_metadata":701430213},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575172,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":850460,"kb_used_data":57364,"kb_used_omap":1,"kb_used_meta":793086,"kb_avail":93521380,"statfs":{"total":96636764160,"available":95765893120,"internally_reserved":0,"allocated":58740736,"data_stored":91565855,"data_compressed":9984239,"data_compressed_allocated":14540800,"data_compressed_original":47566848,"omap_allocated":1593,"internal_metadata":812120519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457036,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":428094,"kb_avail":93914804,"statfs":{"total":96636764160,"available":96168759296,"internally_reserved":0,"allocated":29626368,"data_stored":42066577,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":1595,"internal_metadata":438368709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575173,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":882164,"kb_used_data":30700,"kb_used_omap":1,"kb_used_meta":851454,"kb_avail":93489676,"statfs":{"total":96636764160,"available":95733428224,"internally_reserved":0,"allocated":31436800,"data_stored":46260556,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":1595,"internal_metadata":871889349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575174,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":573192,"kb_used_data":28416,"kb_used_omap":1,"kb_used_meta":544766,"kb_avail":93798648,"statfs":{"total":96636764160,"available":96049815552,"internally_reserved":0,"allocated":29097984,"data_stored":42655962,"data_compressed":4366242,"data_compressed_allocated":6533120,"data_compressed_original":20291584,"omap_allocated":1595,"internal_metadata":557840837},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28741632,"data_stored":41943914,"data_compressed":4333814,"data_compressed_allocated":6488064,"data_compressed_original":19718144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31145984,"data_stored":46138876,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29335552,"data_stored":41944897,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58449920,"data_stored":91444175,"data_compressed":9984239,"data_compressed_allocated":14540800,"data_compressed_original":47566848,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37269504,"data_stored":54527677,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41308160,"data_stored":58724583,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48226304,"data_stored":74666925,"data_compressed":8150968,"data_compressed_allocated":11956224,"data_compressed_original":38424576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37933056,"data_stored":58722751,"data_compressed":6502788,"data_compressed_allocated":9523200,"data_compressed_original":30347264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T06:04:30.272 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-25T05:37:34.411602+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=34, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:30.273 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:30.274 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-25T05:37:30.387049+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=30, tm_wday=0, tm_yday=85, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=25, tm_hour=6, tm_min=4, tm_sec=1, tm_wday=0, tm_yday=85, tm_isdst=0) 2024-03-25T06:04:30.274 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-25T06:04:50.275 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-25T06:04:50.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.453+0000 7f960be00640 1 Processor -- start 2024-03-25T06:04:50.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.453+0000 7f960be00640 1 -- start start 2024-03-25T06:04:50.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.454+0000 7f960be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:50.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.454+0000 7f960be00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f960c0c6c10 0x7f960c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.454+0000 7f960be00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c0cbbe0 con 0x7f960c154120 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.454+0000 7f960be00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c154500 con 0x7f960c0c6c10 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.454+0000 7f960be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c06b250 con 0x7f960c0c67e0 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960aa00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f960c154120 0x7f960c0cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:37360/0 (socket says 172.21.15.102:37360) 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960aa00640 1 -- 172.21.15.102:0/3835425436 learned_addr learned my addr 172.21.15.102:0/3835425436 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960b400640 1 --2- 172.21.15.102:0/3835425436 >> v2:172.21.15.102:3300/0 conn(0x7f960c0c6c10 0x7f960c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960a000640 1 --2- 172.21.15.102:0/3835425436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f9609600640 1 -- 172.21.15.102:0/3835425436 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577493263 0 0) 0x7f960c0cbbe0 con 0x7f960c154120 2024-03-25T06:04:50.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f9609600640 1 -- 172.21.15.102:0/3835425436 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f0003520 con 0x7f960c154120 2024-03-25T06:04:50.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960a000640 1 -- 172.21.15.102:0/3835425436 >> v2:172.21.15.102:3300/0 conn(0x7f960c0c6c10 msgr2=0x7f960c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:50.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960a000640 1 --2- 172.21.15.102:0/3835425436 >> v2:172.21.15.102:3300/0 conn(0x7f960c0c6c10 0x7f960c0c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960a000640 1 -- 172.21.15.102:0/3835425436 >> v1:172.21.15.187:6789/0 conn(0x7f960c154120 legacy=0x7f960c0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:50.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960a000640 1 -- 172.21.15.102:0/3835425436 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0ca280 con 0x7f960c0c67e0 2024-03-25T06:04:50.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.455+0000 7f960b400640 1 --2- 172.21.15.102:0/3835425436 >> v2:172.21.15.102:3300/0 conn(0x7f960c0c6c10 0x7f960c0c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:50.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.457+0000 7f960a000640 1 --2- 172.21.15.102:0/3835425436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c0c7d00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95f80097a0 tx=0x7f95f802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=783cd597e2e44984 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:50.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.457+0000 7f9609600640 1 -- 172.21.15.102:0/3835425436 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8031780 con 0x7f960c0c67e0 2024-03-25T06:04:50.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.457+0000 7f9609600640 1 -- 172.21.15.102:0/3835425436 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f80318e0 con 0x7f960c0c67e0 2024-03-25T06:04:50.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.457+0000 7f9609600640 1 -- 172.21.15.102:0/3835425436 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8031c70 con 0x7f960c0c67e0 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 -- 172.21.15.102:0/3835425436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 msgr2=0x7f960c0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 --2- 172.21.15.102:0/3835425436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c0c7d00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95f80097a0 tx=0x7f95f802b820 comp rx=0 tx=0).stop 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 -- 172.21.15.102:0/3835425436 shutdown_connections 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 --2- 172.21.15.102:0/3835425436 >> v2:172.21.15.102:3300/0 conn(0x7f960c0c6c10 0x7f960c0c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 --2- 172.21.15.102:0/3835425436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c0c7d00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 -- 172.21.15.102:0/3835425436 >> 172.21.15.102:0/3835425436 conn(0x7f960c0cf3e0 msgr2=0x7f960c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 -- 172.21.15.102:0/3835425436 shutdown_connections 2024-03-25T06:04:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.458+0000 7f960be00640 1 -- 172.21.15.102:0/3835425436 wait complete. 2024-03-25T06:04:50.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.460+0000 7f960be00640 1 Processor -- start 2024-03-25T06:04:50.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.461+0000 7f960be00640 1 -- start start 2024-03-25T06:04:50.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:50.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0c6c10 0x7f960c0c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:50.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f960c154120 0x7f960c14f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:50.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960be00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c150390 con 0x7f960c154120 2024-03-25T06:04:50.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960be00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c150f10 con 0x7f960c0c6c10 2024-03-25T06:04:50.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1513a0 con 0x7f960c0c67e0 2024-03-25T06:04:50.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:50.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0c6c10 0x7f960c0c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:50.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38428/0 (socket says 172.21.15.102:38428) 2024-03-25T06:04:50.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960aa00640 1 -- 172.21.15.102:0/1939573438 learned_addr learned my addr 172.21.15.102:0/1939573438 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:50.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.462+0000 7f960b400640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f960c154120 0x7f960c14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:50.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f960aa00640 1 -- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0c6c10 msgr2=0x7f960c0c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:50.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f960aa00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0c6c10 0x7f960c0c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f960aa00640 1 -- 172.21.15.102:0/1939573438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f960c154120 msgr2=0x7f960c14f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f960aa00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f960c154120 0x7f960c14f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f960aa00640 1 -- 172.21.15.102:0/1939573438 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604009a70 con 0x7f960c0c67e0 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f960aa00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c155fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c530 tx=0x7f95fc00c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f9602a00640 1 -- 172.21.15.102:0/1939573438 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0074e0 con 0x7f960c0c67e0 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f9602a00640 1 -- 172.21.15.102:0/1939573438 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc007640 con 0x7f960c0c67e0 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.463+0000 7f9602a00640 1 -- 172.21.15.102:0/1939573438 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0049e0 con 0x7f960c0c67e0 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.464+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f8009400 con 0x7f960c0c67e0 2024-03-25T06:04:50.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.464+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c1505e0 con 0x7f960c0c67e0 2024-03-25T06:04:50.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.465+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c04f2f0 con 0x7f960c0c67e0 2024-03-25T06:04:50.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.466+0000 7f9602a00640 1 -- 172.21.15.102:0/1939573438 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f95fc004b40 con 0x7f960c0c67e0 2024-03-25T06:04:50.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.467+0000 7f9602a00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f95ec06b810 0x7f95ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:50.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.467+0000 7f9602a00640 1 -- 172.21.15.102:0/1939573438 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f95fc0897d0 con 0x7f960c0c67e0 2024-03-25T06:04:50.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.468+0000 7f960a000640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f95ec06b810 0x7f95ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:50.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.468+0000 7f960a000640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f95ec06b810 0x7f95ec06dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95f8036000 tx=0x7f95f803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:50.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.471+0000 7f9602a00640 1 -- 172.21.15.102:0/1939573438 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f95fc053e50 con 0x7f960c0c67e0 2024-03-25T06:04:50.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.794+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 --> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f960c0ca4d0 con 0x7f95ec06b810 2024-03-25T06:04:50.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.802+0000 7f9602a00640 1 -- 172.21.15.102:0/1939573438 <== mgr.4100 v2:172.21.15.187:6832/864804910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336763 (secure 0 0 0) 0x7f95f8031a50 con 0x7f95ec06b810 2024-03-25T06:04:50.801 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:50.802 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f95ec06b810 msgr2=0x7f95ec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f95ec06b810 0x7f95ec06dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95f8036000 tx=0x7f95f803d040 comp rx=0 tx=0).stop 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 msgr2=0x7f960c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c155fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c530 tx=0x7f95fc00c930 comp rx=0 tx=0).stop 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 shutdown_connections 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f95ec06b810 0x7f95ec06dcd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f960c154120 0x7f960c14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0c6c10 0x7f960c0c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 --2- 172.21.15.102:0/1939573438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0c67e0 0x7f960c155fe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:50.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 >> 172.21.15.102:0/1939573438 conn(0x7f960c0cf3e0 msgr2=0x7f960c06b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:50.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 shutdown_connections 2024-03-25T06:04:50.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:50.808+0000 7f960be00640 1 -- 172.21.15.102:0/1939573438 wait complete. 2024-03-25T06:04:50.825 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":843,"stamp":"2024-03-25T06:04:49.358619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":234647267,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":8379,"num_read_kb":1510074,"num_write":298685,"num_write_kb":4974601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33779,"num_omap_keys":66,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":460742,"ondisk_log_size":460742,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5877216,"kb_used_data":307488,"kb_used_omap":12,"kb_used_meta":5569651,"kb_avail":749097504,"statfs":{"total":773094113280,"available":767075844096,"internally_reserved":0,"allocated":314867712,"data_stored":470267974,"data_compressed":49649372,"data_compressed_allocated":73498624,"data_compressed_original":230506496,"omap_allocated":12752,"internal_metadata":5703323184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002432"},"pg_stats":[{"pgid":"2.1f","version":"27'1877","reported_seq":1926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.020346+0000","last_change":"2024-03-25T06:04:06.020346+0000","last_active":"2024-03-25T06:04:06.020346+0000","last_peered":"2024-03-25T06:04:06.020346+0000","last_clean":"2024-03-25T06:04:06.020346+0000","last_became_active":"2024-03-25T05:37:30.421395+0000","last_became_peered":"2024-03-25T05:37:30.421395+0000","last_unstale":"2024-03-25T06:04:06.020346+0000","last_undegraded":"2024-03-25T06:04:06.020346+0000","last_fullsized":"2024-03-25T06:04:06.020346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1877","last_scrub_stamp":"2024-03-25T06:04:06.020170+0000","last_deep_scrub":"27'1877","last_deep_scrub_stamp":"2024-03-25T06:04:06.020170+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.020170+0000","objects_scrubbed":6,"log_size":1877,"log_dups_size":0,"ondisk_log_size":1877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:04.258197+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1876,"num_write_kb":13587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1712","reported_seq":1759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.940123+0000","last_change":"2024-03-25T06:04:19.940163+0000","last_active":"2024-03-25T06:04:19.940123+0000","last_peered":"2024-03-25T06:04:19.940123+0000","last_clean":"2024-03-25T06:04:19.940123+0000","last_became_active":"2024-03-25T05:37:31.196988+0000","last_became_peered":"2024-03-25T05:37:31.196988+0000","last_unstale":"2024-03-25T06:04:19.940123+0000","last_undegraded":"2024-03-25T06:04:19.940123+0000","last_fullsized":"2024-03-25T06:04:19.940123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1712","last_scrub_stamp":"2024-03-25T06:04:19.940032+0000","last_deep_scrub":"27'1712","last_deep_scrub_stamp":"2024-03-25T06:04:19.940032+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.940032+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:38.027979+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'6044","reported_seq":6165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:26.978183+0000","last_change":"2024-03-25T06:04:26.978213+0000","last_active":"2024-03-25T06:04:26.978183+0000","last_peered":"2024-03-25T06:04:26.978183+0000","last_clean":"2024-03-25T06:04:26.978183+0000","last_became_active":"2024-03-25T05:37:35.930009+0000","last_became_peered":"2024-03-25T05:37:35.930009+0000","last_unstale":"2024-03-25T06:04:26.978183+0000","last_undegraded":"2024-03-25T06:04:26.978183+0000","last_fullsized":"2024-03-25T06:04:26.978183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6044","last_scrub_stamp":"2024-03-25T06:04:26.978085+0000","last_deep_scrub":"27'6044","last_deep_scrub_stamp":"2024-03-25T06:04:26.978085+0000","last_clean_scrub_stamp":"2024-03-25T06:04:26.978085+0000","objects_scrubbed":0,"log_size":6044,"log_dups_size":0,"ondisk_log_size":6044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:24.283307+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":20320,"num_write":4304,"num_write_kb":115529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'5159","reported_seq":5208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.946793+0000","last_change":"2024-03-25T06:04:13.946829+0000","last_active":"2024-03-25T06:04:13.946793+0000","last_peered":"2024-03-25T06:04:13.946793+0000","last_clean":"2024-03-25T06:04:13.946793+0000","last_became_active":"2024-03-25T05:37:30.427966+0000","last_became_peered":"2024-03-25T05:37:30.427966+0000","last_unstale":"2024-03-25T06:04:13.946793+0000","last_undegraded":"2024-03-25T06:04:13.946793+0000","last_fullsized":"2024-03-25T06:04:13.946793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5159","last_scrub_stamp":"2024-03-25T06:04:13.946691+0000","last_deep_scrub":"27'5159","last_deep_scrub_stamp":"2024-03-25T06:04:13.946691+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.946691+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:15.896024+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5171,"num_write_kb":32292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1712","reported_seq":1759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.989608+0000","last_change":"2024-03-25T06:04:08.989608+0000","last_active":"2024-03-25T06:04:08.989608+0000","last_peered":"2024-03-25T06:04:08.989608+0000","last_clean":"2024-03-25T06:04:08.989608+0000","last_became_active":"2024-03-25T05:37:31.155333+0000","last_became_peered":"2024-03-25T05:37:31.155333+0000","last_unstale":"2024-03-25T06:04:08.989608+0000","last_undegraded":"2024-03-25T06:04:08.989608+0000","last_fullsized":"2024-03-25T06:04:08.989608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1712","last_scrub_stamp":"2024-03-25T06:04:08.989509+0000","last_deep_scrub":"27'1712","last_deep_scrub_stamp":"2024-03-25T06:04:08.989509+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.989509+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:17:26.592685+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5973","reported_seq":6084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.001414+0000","last_change":"2024-03-25T06:04:20.001452+0000","last_active":"2024-03-25T06:04:20.001414+0000","last_peered":"2024-03-25T06:04:20.001414+0000","last_clean":"2024-03-25T06:04:20.001414+0000","last_became_active":"2024-03-25T05:38:20.805843+0000","last_became_peered":"2024-03-25T05:38:20.805843+0000","last_unstale":"2024-03-25T06:04:20.001414+0000","last_undegraded":"2024-03-25T06:04:20.001414+0000","last_fullsized":"2024-03-25T06:04:20.001414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5973","last_scrub_stamp":"2024-03-25T06:04:20.001322+0000","last_deep_scrub":"27'5973","last_deep_scrub_stamp":"2024-03-25T06:04:20.001322+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.001322+0000","objects_scrubbed":0,"log_size":5973,"log_dups_size":0,"ondisk_log_size":5973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:40:40.030974+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":16002,"num_write":4134,"num_write_kb":115071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7861","reported_seq":7908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.651649+0000","last_change":"2024-03-25T06:04:12.651713+0000","last_active":"2024-03-25T06:04:12.651649+0000","last_peered":"2024-03-25T06:04:12.651649+0000","last_clean":"2024-03-25T06:04:12.651649+0000","last_became_active":"2024-03-25T05:37:30.409252+0000","last_became_peered":"2024-03-25T05:37:30.409252+0000","last_unstale":"2024-03-25T06:04:12.651649+0000","last_undegraded":"2024-03-25T06:04:12.651649+0000","last_fullsized":"2024-03-25T06:04:12.651649+0000","mapping_epoch":17,"log_start":"27'800","ondisk_log_start":"27'800","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7861","last_scrub_stamp":"2024-03-25T06:04:12.651554+0000","last_deep_scrub":"27'7861","last_deep_scrub_stamp":"2024-03-25T06:04:12.651554+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.651554+0000","objects_scrubbed":9,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:28.694885+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7854,"num_write_kb":54498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1772","reported_seq":1817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.551002+0000","last_change":"2024-03-25T06:04:16.551023+0000","last_active":"2024-03-25T06:04:16.551002+0000","last_peered":"2024-03-25T06:04:16.551002+0000","last_clean":"2024-03-25T06:04:16.551002+0000","last_became_active":"2024-03-25T05:37:31.137136+0000","last_became_peered":"2024-03-25T05:37:31.137136+0000","last_unstale":"2024-03-25T06:04:16.551002+0000","last_undegraded":"2024-03-25T06:04:16.551002+0000","last_fullsized":"2024-03-25T06:04:16.551002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1772","last_scrub_stamp":"2024-03-25T06:04:16.550935+0000","last_deep_scrub":"27'1772","last_deep_scrub_stamp":"2024-03-25T06:04:16.550935+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.550935+0000","objects_scrubbed":0,"log_size":1772,"log_dups_size":0,"ondisk_log_size":1772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:06.084397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5981","reported_seq":6145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.937207+0000","last_change":"2024-03-25T06:04:14.937251+0000","last_active":"2024-03-25T06:04:14.937207+0000","last_peered":"2024-03-25T06:04:14.937207+0000","last_clean":"2024-03-25T06:04:14.937207+0000","last_became_active":"2024-03-25T05:37:35.462262+0000","last_became_peered":"2024-03-25T05:37:35.462262+0000","last_unstale":"2024-03-25T06:04:14.937207+0000","last_undegraded":"2024-03-25T06:04:14.937207+0000","last_fullsized":"2024-03-25T06:04:14.937207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5981","last_scrub_stamp":"2024-03-25T06:04:14.937087+0000","last_deep_scrub":"27'5981","last_deep_scrub_stamp":"2024-03-25T06:04:14.937087+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.937087+0000","objects_scrubbed":0,"log_size":5981,"log_dups_size":0,"ondisk_log_size":5981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:04.470549+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":31496,"num_write":4151,"num_write_kb":107318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4418","reported_seq":4465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.627882+0000","last_change":"2024-03-25T06:04:11.627943+0000","last_active":"2024-03-25T06:04:11.627882+0000","last_peered":"2024-03-25T06:04:11.627882+0000","last_clean":"2024-03-25T06:04:11.627882+0000","last_became_active":"2024-03-25T05:37:30.407673+0000","last_became_peered":"2024-03-25T05:37:30.407673+0000","last_unstale":"2024-03-25T06:04:11.627882+0000","last_undegraded":"2024-03-25T06:04:11.627882+0000","last_fullsized":"2024-03-25T06:04:11.627882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4418","last_scrub_stamp":"2024-03-25T06:04:11.627777+0000","last_deep_scrub":"27'4418","last_deep_scrub_stamp":"2024-03-25T06:04:11.627777+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.627777+0000","objects_scrubbed":6,"log_size":4418,"log_dups_size":0,"ondisk_log_size":4418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:09.865803+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4409,"num_write_kb":35629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1703","reported_seq":1748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.549394+0000","last_change":"2024-03-25T06:04:15.549437+0000","last_active":"2024-03-25T06:04:15.549394+0000","last_peered":"2024-03-25T06:04:15.549394+0000","last_clean":"2024-03-25T06:04:15.549394+0000","last_became_active":"2024-03-25T05:37:31.137118+0000","last_became_peered":"2024-03-25T05:37:31.137118+0000","last_unstale":"2024-03-25T06:04:15.549394+0000","last_undegraded":"2024-03-25T06:04:15.549394+0000","last_fullsized":"2024-03-25T06:04:15.549394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1703","last_scrub_stamp":"2024-03-25T06:04:15.549294+0000","last_deep_scrub":"27'1703","last_deep_scrub_stamp":"2024-03-25T06:04:15.549294+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.549294+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:57.610244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5907","reported_seq":6014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.994442+0000","last_change":"2024-03-25T06:04:16.994486+0000","last_active":"2024-03-25T06:04:16.994442+0000","last_peered":"2024-03-25T06:04:16.994442+0000","last_clean":"2024-03-25T06:04:16.994442+0000","last_became_active":"2024-03-25T05:37:35.470922+0000","last_became_peered":"2024-03-25T05:37:35.470922+0000","last_unstale":"2024-03-25T06:04:16.994442+0000","last_undegraded":"2024-03-25T06:04:16.994442+0000","last_fullsized":"2024-03-25T06:04:16.994442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5907","last_scrub_stamp":"2024-03-25T06:04:16.994319+0000","last_deep_scrub":"27'5907","last_deep_scrub_stamp":"2024-03-25T06:04:16.994319+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.994319+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:13:44.476735+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":17018,"num_write":4127,"num_write_kb":118658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1739","reported_seq":1785,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.454530+0000","last_change":"2024-03-25T06:04:14.454569+0000","last_active":"2024-03-25T06:04:14.454530+0000","last_peered":"2024-03-25T06:04:14.454530+0000","last_clean":"2024-03-25T06:04:14.454530+0000","last_became_active":"2024-03-25T05:37:31.189772+0000","last_became_peered":"2024-03-25T05:37:31.189772+0000","last_unstale":"2024-03-25T06:04:14.454530+0000","last_undegraded":"2024-03-25T06:04:14.454530+0000","last_fullsized":"2024-03-25T06:04:14.454530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1739","last_scrub_stamp":"2024-03-25T06:04:14.454428+0000","last_deep_scrub":"27'1739","last_deep_scrub_stamp":"2024-03-25T06:04:14.454428+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.454428+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:59:14.322016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'5829","reported_seq":5878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.608846+0000","last_change":"2024-03-25T06:04:14.608846+0000","last_active":"2024-03-25T06:04:14.608846+0000","last_peered":"2024-03-25T06:04:14.608846+0000","last_clean":"2024-03-25T06:04:14.608846+0000","last_became_active":"2024-03-25T05:37:30.413796+0000","last_became_peered":"2024-03-25T05:37:30.413796+0000","last_unstale":"2024-03-25T06:04:14.608846+0000","last_undegraded":"2024-03-25T06:04:14.608846+0000","last_fullsized":"2024-03-25T06:04:14.608846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5829","last_scrub_stamp":"2024-03-25T06:04:14.608724+0000","last_deep_scrub":"27'5829","last_deep_scrub_stamp":"2024-03-25T06:04:14.608724+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.608724+0000","objects_scrubbed":3,"log_size":5829,"log_dups_size":0,"ondisk_log_size":5829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:58.254501+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5838,"num_write_kb":40868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":284,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'6422","reported_seq":6570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.955104+0000","last_change":"2024-03-25T06:04:18.955104+0000","last_active":"2024-03-25T06:04:18.955104+0000","last_peered":"2024-03-25T06:04:18.955104+0000","last_clean":"2024-03-25T06:04:18.955104+0000","last_became_active":"2024-03-25T05:38:20.652530+0000","last_became_peered":"2024-03-25T05:38:20.652530+0000","last_unstale":"2024-03-25T06:04:18.955104+0000","last_undegraded":"2024-03-25T06:04:18.955104+0000","last_fullsized":"2024-03-25T06:04:18.955104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6422","last_scrub_stamp":"2024-03-25T06:04:18.955003+0000","last_deep_scrub":"27'6422","last_deep_scrub_stamp":"2024-03-25T06:04:18.955003+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.955003+0000","objects_scrubbed":0,"log_size":6422,"log_dups_size":0,"ondisk_log_size":6422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:58:42.209411+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":25146,"num_write":4573,"num_write_kb":128923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1760","reported_seq":1806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.807917+0000","last_change":"2024-03-25T06:04:06.807917+0000","last_active":"2024-03-25T06:04:06.807917+0000","last_peered":"2024-03-25T06:04:06.807917+0000","last_clean":"2024-03-25T06:04:06.807917+0000","last_became_active":"2024-03-25T05:37:31.170151+0000","last_became_peered":"2024-03-25T05:37:31.170151+0000","last_unstale":"2024-03-25T06:04:06.807917+0000","last_undegraded":"2024-03-25T06:04:06.807917+0000","last_fullsized":"2024-03-25T06:04:06.807917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1760","last_scrub_stamp":"2024-03-25T06:04:06.807768+0000","last_deep_scrub":"27'1760","last_deep_scrub_stamp":"2024-03-25T06:04:06.807768+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.807768+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:29:01.109791+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'5255","reported_seq":5304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.293856+0000","last_change":"2024-03-25T06:04:11.293887+0000","last_active":"2024-03-25T06:04:11.293856+0000","last_peered":"2024-03-25T06:04:11.293856+0000","last_clean":"2024-03-25T06:04:11.293856+0000","last_became_active":"2024-03-25T05:37:30.429568+0000","last_became_peered":"2024-03-25T05:37:30.429568+0000","last_unstale":"2024-03-25T06:04:11.293856+0000","last_undegraded":"2024-03-25T06:04:11.293856+0000","last_fullsized":"2024-03-25T06:04:11.293856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5255","last_scrub_stamp":"2024-03-25T06:04:11.293797+0000","last_deep_scrub":"27'5255","last_deep_scrub_stamp":"2024-03-25T06:04:11.293797+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.293797+0000","objects_scrubbed":4,"log_size":5255,"log_dups_size":0,"ondisk_log_size":5255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:18.698536+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":40419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'6245","reported_seq":6400,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.963144+0000","last_change":"2024-03-25T06:04:20.963144+0000","last_active":"2024-03-25T06:04:20.963144+0000","last_peered":"2024-03-25T06:04:20.963144+0000","last_clean":"2024-03-25T06:04:20.963144+0000","last_became_active":"2024-03-25T05:38:20.809544+0000","last_became_peered":"2024-03-25T05:38:20.809544+0000","last_unstale":"2024-03-25T06:04:20.963144+0000","last_undegraded":"2024-03-25T06:04:20.963144+0000","last_fullsized":"2024-03-25T06:04:20.963144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6245","last_scrub_stamp":"2024-03-25T06:04:20.963032+0000","last_deep_scrub":"27'6245","last_deep_scrub_stamp":"2024-03-25T06:04:20.963032+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.963032+0000","objects_scrubbed":0,"log_size":6245,"log_dups_size":0,"ondisk_log_size":6245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:39.050980+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":26924,"num_write":4477,"num_write_kb":122118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1773","reported_seq":1819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.892909+0000","last_change":"2024-03-25T06:04:10.892946+0000","last_active":"2024-03-25T06:04:10.892909+0000","last_peered":"2024-03-25T06:04:10.892909+0000","last_clean":"2024-03-25T06:04:10.892909+0000","last_became_active":"2024-03-25T05:37:31.165659+0000","last_became_peered":"2024-03-25T05:37:31.165659+0000","last_unstale":"2024-03-25T06:04:10.892909+0000","last_undegraded":"2024-03-25T06:04:10.892909+0000","last_fullsized":"2024-03-25T06:04:10.892909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1773","last_scrub_stamp":"2024-03-25T06:04:10.892812+0000","last_deep_scrub":"27'1773","last_deep_scrub_stamp":"2024-03-25T06:04:10.892812+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.892812+0000","objects_scrubbed":0,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:32.269864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2777","reported_seq":2826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.245615+0000","last_change":"2024-03-25T06:04:06.245663+0000","last_active":"2024-03-25T06:04:06.245615+0000","last_peered":"2024-03-25T06:04:06.245615+0000","last_clean":"2024-03-25T06:04:06.245615+0000","last_became_active":"2024-03-25T05:37:30.422299+0000","last_became_peered":"2024-03-25T05:37:30.422299+0000","last_unstale":"2024-03-25T06:04:06.245615+0000","last_undegraded":"2024-03-25T06:04:06.245615+0000","last_fullsized":"2024-03-25T06:04:06.245615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2777","last_scrub_stamp":"2024-03-25T06:04:06.245521+0000","last_deep_scrub":"27'2777","last_deep_scrub_stamp":"2024-03-25T06:04:06.245521+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.245521+0000","objects_scrubbed":4,"log_size":2777,"log_dups_size":0,"ondisk_log_size":2777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:25:43.873830+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2784,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5899","reported_seq":6127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.372076+0000","last_change":"2024-03-25T06:04:20.372076+0000","last_active":"2024-03-25T06:04:20.372076+0000","last_peered":"2024-03-25T06:04:20.372076+0000","last_clean":"2024-03-25T06:04:20.372076+0000","last_became_active":"2024-03-25T05:37:35.925774+0000","last_became_peered":"2024-03-25T05:37:35.925774+0000","last_unstale":"2024-03-25T06:04:20.372076+0000","last_undegraded":"2024-03-25T06:04:20.372076+0000","last_fullsized":"2024-03-25T06:04:20.372076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5899","last_scrub_stamp":"2024-03-25T06:04:20.371892+0000","last_deep_scrub":"27'5899","last_deep_scrub_stamp":"2024-03-25T06:04:20.371892+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.371892+0000","objects_scrubbed":0,"log_size":5899,"log_dups_size":0,"ondisk_log_size":5899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:21.254609+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":47244,"num_write":4145,"num_write_kb":109724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1772","reported_seq":1819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.018342+0000","last_change":"2024-03-25T06:04:11.018362+0000","last_active":"2024-03-25T06:04:11.018342+0000","last_peered":"2024-03-25T06:04:11.018342+0000","last_clean":"2024-03-25T06:04:11.018342+0000","last_became_active":"2024-03-25T05:37:31.172143+0000","last_became_peered":"2024-03-25T05:37:31.172143+0000","last_unstale":"2024-03-25T06:04:11.018342+0000","last_undegraded":"2024-03-25T06:04:11.018342+0000","last_fullsized":"2024-03-25T06:04:11.018342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1772","last_scrub_stamp":"2024-03-25T06:04:11.018276+0000","last_deep_scrub":"27'1772","last_deep_scrub_stamp":"2024-03-25T06:04:11.018276+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.018276+0000","objects_scrubbed":0,"log_size":1772,"log_dups_size":0,"ondisk_log_size":1772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:54.664053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1613","reported_seq":1662,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.629372+0000","last_change":"2024-03-25T06:04:13.629394+0000","last_active":"2024-03-25T06:04:13.629372+0000","last_peered":"2024-03-25T06:04:13.629372+0000","last_clean":"2024-03-25T06:04:13.629372+0000","last_became_active":"2024-03-25T05:37:30.410754+0000","last_became_peered":"2024-03-25T05:37:30.410754+0000","last_unstale":"2024-03-25T06:04:13.629372+0000","last_undegraded":"2024-03-25T06:04:13.629372+0000","last_fullsized":"2024-03-25T06:04:13.629372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1613","last_scrub_stamp":"2024-03-25T06:04:13.629305+0000","last_deep_scrub":"27'1613","last_deep_scrub_stamp":"2024-03-25T06:04:13.629305+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.629305+0000","objects_scrubbed":1,"log_size":1613,"log_dups_size":0,"ondisk_log_size":1613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:58.338102+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":13363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5913","reported_seq":6007,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.974557+0000","last_change":"2024-03-25T06:04:13.974557+0000","last_active":"2024-03-25T06:04:13.974557+0000","last_peered":"2024-03-25T06:04:13.974557+0000","last_clean":"2024-03-25T06:04:13.974557+0000","last_became_active":"2024-03-25T05:37:35.462002+0000","last_became_peered":"2024-03-25T05:37:35.462002+0000","last_unstale":"2024-03-25T06:04:13.974557+0000","last_undegraded":"2024-03-25T06:04:13.974557+0000","last_fullsized":"2024-03-25T06:04:13.974557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5913","last_scrub_stamp":"2024-03-25T06:04:13.974443+0000","last_deep_scrub":"27'5913","last_deep_scrub_stamp":"2024-03-25T06:04:13.974443+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.974443+0000","objects_scrubbed":0,"log_size":5913,"log_dups_size":0,"ondisk_log_size":5913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:56.035393+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4059,"num_write_kb":104872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1713","reported_seq":1759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.938702+0000","last_change":"2024-03-25T06:04:12.938741+0000","last_active":"2024-03-25T06:04:12.938702+0000","last_peered":"2024-03-25T06:04:12.938702+0000","last_clean":"2024-03-25T06:04:12.938702+0000","last_became_active":"2024-03-25T05:37:31.163798+0000","last_became_peered":"2024-03-25T05:37:31.163798+0000","last_unstale":"2024-03-25T06:04:12.938702+0000","last_undegraded":"2024-03-25T06:04:12.938702+0000","last_fullsized":"2024-03-25T06:04:12.938702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1713","last_scrub_stamp":"2024-03-25T06:04:12.938567+0000","last_deep_scrub":"27'1713","last_deep_scrub_stamp":"2024-03-25T06:04:12.938567+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.938567+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:08:29.795307+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'2891","reported_seq":2939,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.484158+0000","last_change":"2024-03-25T06:04:12.484209+0000","last_active":"2024-03-25T06:04:12.484158+0000","last_peered":"2024-03-25T06:04:12.484158+0000","last_clean":"2024-03-25T06:04:12.484158+0000","last_became_active":"2024-03-25T05:37:30.407656+0000","last_became_peered":"2024-03-25T05:37:30.407656+0000","last_unstale":"2024-03-25T06:04:12.484158+0000","last_undegraded":"2024-03-25T06:04:12.484158+0000","last_fullsized":"2024-03-25T06:04:12.484158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2891","last_scrub_stamp":"2024-03-25T06:04:12.484058+0000","last_deep_scrub":"27'2891","last_deep_scrub_stamp":"2024-03-25T06:04:12.484058+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.484058+0000","objects_scrubbed":5,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:25:50.112367+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2906,"num_write_kb":22398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'6071","reported_seq":6166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.990070+0000","last_change":"2024-03-25T06:04:17.990070+0000","last_active":"2024-03-25T06:04:17.990070+0000","last_peered":"2024-03-25T06:04:17.990070+0000","last_clean":"2024-03-25T06:04:17.990070+0000","last_became_active":"2024-03-25T05:37:35.925334+0000","last_became_peered":"2024-03-25T05:37:35.925334+0000","last_unstale":"2024-03-25T06:04:17.990070+0000","last_undegraded":"2024-03-25T06:04:17.990070+0000","last_fullsized":"2024-03-25T06:04:17.990070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6071","last_scrub_stamp":"2024-03-25T06:04:17.989902+0000","last_deep_scrub":"27'6071","last_deep_scrub_stamp":"2024-03-25T06:04:17.989902+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.989902+0000","objects_scrubbed":0,"log_size":6071,"log_dups_size":0,"ondisk_log_size":6071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:01:40.551201+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":13208,"num_write":4303,"num_write_kb":129626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1690","reported_seq":1736,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.982114+0000","last_change":"2024-03-25T06:04:18.982154+0000","last_active":"2024-03-25T06:04:18.982114+0000","last_peered":"2024-03-25T06:04:18.982114+0000","last_clean":"2024-03-25T06:04:18.982114+0000","last_became_active":"2024-03-25T05:37:31.161847+0000","last_became_peered":"2024-03-25T05:37:31.161847+0000","last_unstale":"2024-03-25T06:04:18.982114+0000","last_undegraded":"2024-03-25T06:04:18.982114+0000","last_fullsized":"2024-03-25T06:04:18.982114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1690","last_scrub_stamp":"2024-03-25T06:04:18.981965+0000","last_deep_scrub":"27'1690","last_deep_scrub_stamp":"2024-03-25T06:04:18.981965+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.981965+0000","objects_scrubbed":0,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:19.864682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4487","reported_seq":4536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.358079+0000","last_change":"2024-03-25T06:04:10.358131+0000","last_active":"2024-03-25T06:04:10.358079+0000","last_peered":"2024-03-25T06:04:10.358079+0000","last_clean":"2024-03-25T06:04:10.358079+0000","last_became_active":"2024-03-25T05:37:30.427542+0000","last_became_peered":"2024-03-25T05:37:30.427542+0000","last_unstale":"2024-03-25T06:04:10.358079+0000","last_undegraded":"2024-03-25T06:04:10.358079+0000","last_fullsized":"2024-03-25T06:04:10.358079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4487","last_scrub_stamp":"2024-03-25T06:04:10.357976+0000","last_deep_scrub":"27'4487","last_deep_scrub_stamp":"2024-03-25T06:04:10.357976+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.357976+0000","objects_scrubbed":5,"log_size":4487,"log_dups_size":0,"ondisk_log_size":4487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:54.003753+0000","scrub_duration":111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7152,"num_write_kb":35867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'6341","reported_seq":6517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:24.894910+0000","last_change":"2024-03-25T06:04:24.894951+0000","last_active":"2024-03-25T06:04:24.894910+0000","last_peered":"2024-03-25T06:04:24.894910+0000","last_clean":"2024-03-25T06:04:24.894910+0000","last_became_active":"2024-03-25T05:37:35.927990+0000","last_became_peered":"2024-03-25T05:37:35.927990+0000","last_unstale":"2024-03-25T06:04:24.894910+0000","last_undegraded":"2024-03-25T06:04:24.894910+0000","last_fullsized":"2024-03-25T06:04:24.894910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6341","last_scrub_stamp":"2024-03-25T06:04:24.894787+0000","last_deep_scrub":"27'6341","last_deep_scrub_stamp":"2024-03-25T06:04:24.894787+0000","last_clean_scrub_stamp":"2024-03-25T06:04:24.894787+0000","objects_scrubbed":0,"log_size":6341,"log_dups_size":0,"ondisk_log_size":6341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:10:29.915504+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":33782,"num_write":4571,"num_write_kb":115403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1759","reported_seq":1807,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.247282+0000","last_change":"2024-03-25T06:04:13.247282+0000","last_active":"2024-03-25T06:04:13.247282+0000","last_peered":"2024-03-25T06:04:13.247282+0000","last_clean":"2024-03-25T06:04:13.247282+0000","last_became_active":"2024-03-25T05:37:31.162829+0000","last_became_peered":"2024-03-25T05:37:31.162829+0000","last_unstale":"2024-03-25T06:04:13.247282+0000","last_undegraded":"2024-03-25T06:04:13.247282+0000","last_fullsized":"2024-03-25T06:04:13.247282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1759","last_scrub_stamp":"2024-03-25T06:04:13.247139+0000","last_deep_scrub":"27'1759","last_deep_scrub_stamp":"2024-03-25T06:04:13.247139+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.247139+0000","objects_scrubbed":0,"log_size":1759,"log_dups_size":0,"ondisk_log_size":1759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:55.308089+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'5278","reported_seq":5328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.622014+0000","last_change":"2024-03-25T06:04:15.622014+0000","last_active":"2024-03-25T06:04:15.622014+0000","last_peered":"2024-03-25T06:04:15.622014+0000","last_clean":"2024-03-25T06:04:15.622014+0000","last_became_active":"2024-03-25T05:37:30.414248+0000","last_became_peered":"2024-03-25T05:37:30.414248+0000","last_unstale":"2024-03-25T06:04:15.622014+0000","last_undegraded":"2024-03-25T06:04:15.622014+0000","last_fullsized":"2024-03-25T06:04:15.622014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5278","last_scrub_stamp":"2024-03-25T06:04:15.621880+0000","last_deep_scrub":"27'5278","last_deep_scrub_stamp":"2024-03-25T06:04:15.621880+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.621880+0000","objects_scrubbed":5,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:23.026619+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5274,"num_write_kb":36361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5049,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'6079","reported_seq":6327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.884969+0000","last_change":"2024-03-25T06:04:18.884969+0000","last_active":"2024-03-25T06:04:18.884969+0000","last_peered":"2024-03-25T06:04:18.884969+0000","last_clean":"2024-03-25T06:04:18.884969+0000","last_became_active":"2024-03-25T05:37:35.925214+0000","last_became_peered":"2024-03-25T05:37:35.925214+0000","last_unstale":"2024-03-25T06:04:18.884969+0000","last_undegraded":"2024-03-25T06:04:18.884969+0000","last_fullsized":"2024-03-25T06:04:18.884969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6079","last_scrub_stamp":"2024-03-25T06:04:18.884841+0000","last_deep_scrub":"27'6079","last_deep_scrub_stamp":"2024-03-25T06:04:18.884841+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.884841+0000","objects_scrubbed":0,"log_size":6079,"log_dups_size":0,"ondisk_log_size":6079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:19.767558+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":52070,"num_write":4228,"num_write_kb":109752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1711","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.208479+0000","last_change":"2024-03-25T06:04:14.208516+0000","last_active":"2024-03-25T06:04:14.208479+0000","last_peered":"2024-03-25T06:04:14.208479+0000","last_clean":"2024-03-25T06:04:14.208479+0000","last_became_active":"2024-03-25T05:38:20.805934+0000","last_became_peered":"2024-03-25T05:38:20.805934+0000","last_unstale":"2024-03-25T06:04:14.208479+0000","last_undegraded":"2024-03-25T06:04:14.208479+0000","last_fullsized":"2024-03-25T06:04:14.208479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1711","last_scrub_stamp":"2024-03-25T06:04:14.208377+0000","last_deep_scrub":"27'1711","last_deep_scrub_stamp":"2024-03-25T06:04:14.208377+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.208377+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:19:02.677819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'5142","reported_seq":5192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.592630+0000","last_change":"2024-03-25T06:04:07.592630+0000","last_active":"2024-03-25T06:04:07.592630+0000","last_peered":"2024-03-25T06:04:07.592630+0000","last_clean":"2024-03-25T06:04:07.592630+0000","last_became_active":"2024-03-25T05:37:30.422990+0000","last_became_peered":"2024-03-25T05:37:30.422990+0000","last_unstale":"2024-03-25T06:04:07.592630+0000","last_undegraded":"2024-03-25T06:04:07.592630+0000","last_fullsized":"2024-03-25T06:04:07.592630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5142","last_scrub_stamp":"2024-03-25T06:04:07.592471+0000","last_deep_scrub":"27'5142","last_deep_scrub_stamp":"2024-03-25T06:04:07.592471+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.592471+0000","objects_scrubbed":4,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:19:05.650747+0000","scrub_duration":318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5143,"num_write_kb":40167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'6967","reported_seq":7069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.365102+0000","last_change":"2024-03-25T06:04:19.365102+0000","last_active":"2024-03-25T06:04:19.365102+0000","last_peered":"2024-03-25T06:04:19.365102+0000","last_clean":"2024-03-25T06:04:19.365102+0000","last_became_active":"2024-03-25T05:37:35.473076+0000","last_became_peered":"2024-03-25T05:37:35.473076+0000","last_unstale":"2024-03-25T06:04:19.365102+0000","last_undegraded":"2024-03-25T06:04:19.365102+0000","last_fullsized":"2024-03-25T06:04:19.365102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6967","last_scrub_stamp":"2024-03-25T06:04:19.364941+0000","last_deep_scrub":"27'6967","last_deep_scrub_stamp":"2024-03-25T06:04:19.364941+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.364941+0000","objects_scrubbed":0,"log_size":6967,"log_dups_size":0,"ondisk_log_size":6967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:27.020102+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5199,"num_write_kb":132356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1725","reported_seq":1773,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.991735+0000","last_change":"2024-03-25T06:04:09.991735+0000","last_active":"2024-03-25T06:04:09.991735+0000","last_peered":"2024-03-25T06:04:09.991735+0000","last_clean":"2024-03-25T06:04:09.991735+0000","last_became_active":"2024-03-25T05:37:31.163979+0000","last_became_peered":"2024-03-25T05:37:31.163979+0000","last_unstale":"2024-03-25T06:04:09.991735+0000","last_undegraded":"2024-03-25T06:04:09.991735+0000","last_fullsized":"2024-03-25T06:04:09.991735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1725","last_scrub_stamp":"2024-03-25T06:04:09.991607+0000","last_deep_scrub":"27'1725","last_deep_scrub_stamp":"2024-03-25T06:04:09.991607+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.991607+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:54.700403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7935","reported_seq":7985,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.581117+0000","last_change":"2024-03-25T06:04:13.581117+0000","last_active":"2024-03-25T06:04:13.581117+0000","last_peered":"2024-03-25T06:04:13.581117+0000","last_clean":"2024-03-25T06:04:13.581117+0000","last_became_active":"2024-03-25T05:37:30.421462+0000","last_became_peered":"2024-03-25T05:37:30.421462+0000","last_unstale":"2024-03-25T06:04:13.581117+0000","last_undegraded":"2024-03-25T06:04:13.581117+0000","last_fullsized":"2024-03-25T06:04:13.581117+0000","mapping_epoch":17,"log_start":"27'400","ondisk_log_start":"27'400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7935","last_scrub_stamp":"2024-03-25T06:04:13.581031+0000","last_deep_scrub":"27'7935","last_deep_scrub_stamp":"2024-03-25T06:04:13.581031+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.581031+0000","objects_scrubbed":3,"log_size":7535,"log_dups_size":0,"ondisk_log_size":7535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:20.985770+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":7940,"num_write_kb":54570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'6089","reported_seq":6204,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.297546+0000","last_change":"2024-03-25T06:04:16.297546+0000","last_active":"2024-03-25T06:04:16.297546+0000","last_peered":"2024-03-25T06:04:16.297546+0000","last_clean":"2024-03-25T06:04:16.297546+0000","last_became_active":"2024-03-25T05:37:35.456463+0000","last_became_peered":"2024-03-25T05:37:35.456463+0000","last_unstale":"2024-03-25T06:04:16.297546+0000","last_undegraded":"2024-03-25T06:04:16.297546+0000","last_fullsized":"2024-03-25T06:04:16.297546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6089","last_scrub_stamp":"2024-03-25T06:04:16.297390+0000","last_deep_scrub":"27'6089","last_deep_scrub_stamp":"2024-03-25T06:04:16.297390+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.297390+0000","objects_scrubbed":0,"log_size":6089,"log_dups_size":0,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:13.368629+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4263,"num_write_kb":125557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1743","reported_seq":1791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.283261+0000","last_change":"2024-03-25T06:04:12.283298+0000","last_active":"2024-03-25T06:04:12.283261+0000","last_peered":"2024-03-25T06:04:12.283261+0000","last_clean":"2024-03-25T06:04:12.283261+0000","last_became_active":"2024-03-25T05:37:31.162525+0000","last_became_peered":"2024-03-25T05:37:31.162525+0000","last_unstale":"2024-03-25T06:04:12.283261+0000","last_undegraded":"2024-03-25T06:04:12.283261+0000","last_fullsized":"2024-03-25T06:04:12.283261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1743","last_scrub_stamp":"2024-03-25T06:04:12.283163+0000","last_deep_scrub":"27'1743","last_deep_scrub_stamp":"2024-03-25T06:04:12.283163+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.283163+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:33.660215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6073","reported_seq":7073,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.326689+0000","last_change":"2024-03-25T06:04:08.326689+0000","last_active":"2024-03-25T06:04:08.326689+0000","last_peered":"2024-03-25T06:04:08.326689+0000","last_clean":"2024-03-25T06:04:08.326689+0000","last_became_active":"2024-03-25T05:37:30.429000+0000","last_became_peered":"2024-03-25T05:37:30.429000+0000","last_unstale":"2024-03-25T06:04:08.326689+0000","last_undegraded":"2024-03-25T06:04:08.326689+0000","last_fullsized":"2024-03-25T06:04:08.326689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6073","last_scrub_stamp":"2024-03-25T06:04:08.326534+0000","last_deep_scrub":"27'6073","last_deep_scrub_stamp":"2024-03-25T06:04:08.326534+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.326534+0000","objects_scrubbed":6,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:01:05.110985+0000","scrub_duration":96,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":950,"num_read_kb":4728,"num_write":6067,"num_write_kb":44951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'6020","reported_seq":6501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.325683+0000","last_change":"2024-03-25T06:04:17.325733+0000","last_active":"2024-03-25T06:04:17.325683+0000","last_peered":"2024-03-25T06:04:17.325683+0000","last_clean":"2024-03-25T06:04:17.325683+0000","last_became_active":"2024-03-25T05:37:35.464888+0000","last_became_peered":"2024-03-25T05:37:35.464888+0000","last_unstale":"2024-03-25T06:04:17.325683+0000","last_undegraded":"2024-03-25T06:04:17.325683+0000","last_fullsized":"2024-03-25T06:04:17.325683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6020","last_scrub_stamp":"2024-03-25T06:04:17.325552+0000","last_deep_scrub":"27'6020","last_deep_scrub_stamp":"2024-03-25T06:04:17.325552+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.325552+0000","objects_scrubbed":0,"log_size":6020,"log_dups_size":0,"ondisk_log_size":6020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:02.866214+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":111506,"num_write":4241,"num_write_kb":120921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1663","reported_seq":1710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.011544+0000","last_change":"2024-03-25T06:04:07.011544+0000","last_active":"2024-03-25T06:04:07.011544+0000","last_peered":"2024-03-25T06:04:07.011544+0000","last_clean":"2024-03-25T06:04:07.011544+0000","last_became_active":"2024-03-25T05:37:31.147665+0000","last_became_peered":"2024-03-25T05:37:31.147665+0000","last_unstale":"2024-03-25T06:04:07.011544+0000","last_undegraded":"2024-03-25T06:04:07.011544+0000","last_fullsized":"2024-03-25T06:04:07.011544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1663","last_scrub_stamp":"2024-03-25T06:04:07.011279+0000","last_deep_scrub":"27'1663","last_deep_scrub_stamp":"2024-03-25T06:04:07.011279+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.011279+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:23.054610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'6672","reported_seq":6722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.625566+0000","last_change":"2024-03-25T06:04:16.625606+0000","last_active":"2024-03-25T06:04:16.625566+0000","last_peered":"2024-03-25T06:04:16.625566+0000","last_clean":"2024-03-25T06:04:16.625566+0000","last_became_active":"2024-03-25T05:37:30.422366+0000","last_became_peered":"2024-03-25T05:37:30.422366+0000","last_unstale":"2024-03-25T06:04:16.625566+0000","last_undegraded":"2024-03-25T06:04:16.625566+0000","last_fullsized":"2024-03-25T06:04:16.625566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6672","last_scrub_stamp":"2024-03-25T06:04:16.625498+0000","last_deep_scrub":"27'6672","last_deep_scrub_stamp":"2024-03-25T06:04:16.625498+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.625498+0000","objects_scrubbed":1,"log_size":6672,"log_dups_size":0,"ondisk_log_size":6672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:38.002550+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":45450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'6165","reported_seq":6367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.871486+0000","last_change":"2024-03-25T06:04:16.871529+0000","last_active":"2024-03-25T06:04:16.871486+0000","last_peered":"2024-03-25T06:04:16.871486+0000","last_clean":"2024-03-25T06:04:16.871486+0000","last_became_active":"2024-03-25T05:37:35.925263+0000","last_became_peered":"2024-03-25T05:37:35.925263+0000","last_unstale":"2024-03-25T06:04:16.871486+0000","last_undegraded":"2024-03-25T06:04:16.871486+0000","last_fullsized":"2024-03-25T06:04:16.871486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6165","last_scrub_stamp":"2024-03-25T06:04:16.871359+0000","last_deep_scrub":"27'6165","last_deep_scrub_stamp":"2024-03-25T06:04:16.871359+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.871359+0000","objects_scrubbed":0,"log_size":6165,"log_dups_size":0,"ondisk_log_size":6165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:06.376290+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":40640,"num_write":4336,"num_write_kb":133390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1739","reported_seq":1786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.957497+0000","last_change":"2024-03-25T06:04:17.957497+0000","last_active":"2024-03-25T06:04:17.957497+0000","last_peered":"2024-03-25T06:04:17.957497+0000","last_clean":"2024-03-25T06:04:17.957497+0000","last_became_active":"2024-03-25T05:37:31.162371+0000","last_became_peered":"2024-03-25T05:37:31.162371+0000","last_unstale":"2024-03-25T06:04:17.957497+0000","last_undegraded":"2024-03-25T06:04:17.957497+0000","last_fullsized":"2024-03-25T06:04:17.957497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1739","last_scrub_stamp":"2024-03-25T06:04:17.957336+0000","last_deep_scrub":"27'1739","last_deep_scrub_stamp":"2024-03-25T06:04:17.957336+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.957336+0000","objects_scrubbed":0,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:25.612498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4320","reported_seq":4370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.554480+0000","last_change":"2024-03-25T06:04:12.554480+0000","last_active":"2024-03-25T06:04:12.554480+0000","last_peered":"2024-03-25T06:04:12.554480+0000","last_clean":"2024-03-25T06:04:12.554480+0000","last_became_active":"2024-03-25T05:37:30.412592+0000","last_became_peered":"2024-03-25T05:37:30.412592+0000","last_unstale":"2024-03-25T06:04:12.554480+0000","last_undegraded":"2024-03-25T06:04:12.554480+0000","last_fullsized":"2024-03-25T06:04:12.554480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4320","last_scrub_stamp":"2024-03-25T06:04:12.554390+0000","last_deep_scrub":"27'4320","last_deep_scrub_stamp":"2024-03-25T06:04:12.554390+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.554390+0000","objects_scrubbed":6,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:56.200167+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4311,"num_write_kb":35590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.599498+0000","last_change":"2024-03-25T06:04:10.599527+0000","last_active":"2024-03-25T06:04:10.599498+0000","last_peered":"2024-03-25T06:04:10.599498+0000","last_clean":"2024-03-25T06:04:10.599498+0000","last_became_active":"2024-03-25T05:37:27.083514+0000","last_became_peered":"2024-03-25T05:37:27.083514+0000","last_unstale":"2024-03-25T06:04:10.599498+0000","last_undegraded":"2024-03-25T06:04:10.599498+0000","last_fullsized":"2024-03-25T06:04:10.599498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-25T06:04:10.599436+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-25T06:04:10.599436+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.599436+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:55.693297+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'6163","reported_seq":6334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.519470+0000","last_change":"2024-03-25T06:04:23.519470+0000","last_active":"2024-03-25T06:04:23.519470+0000","last_peered":"2024-03-25T06:04:23.519470+0000","last_clean":"2024-03-25T06:04:23.519470+0000","last_became_active":"2024-03-25T05:37:35.925335+0000","last_became_peered":"2024-03-25T05:37:35.925335+0000","last_unstale":"2024-03-25T06:04:23.519470+0000","last_undegraded":"2024-03-25T06:04:23.519470+0000","last_fullsized":"2024-03-25T06:04:23.519470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6163","last_scrub_stamp":"2024-03-25T06:04:23.519261+0000","last_deep_scrub":"27'6163","last_deep_scrub_stamp":"2024-03-25T06:04:23.519261+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.519261+0000","objects_scrubbed":0,"log_size":6163,"log_dups_size":0,"ondisk_log_size":6163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:01:46.080561+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":32512,"num_write":4376,"num_write_kb":123749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1732","reported_seq":1779,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.605282+0000","last_change":"2024-03-25T06:04:18.605282+0000","last_active":"2024-03-25T06:04:18.605282+0000","last_peered":"2024-03-25T06:04:18.605282+0000","last_clean":"2024-03-25T06:04:18.605282+0000","last_became_active":"2024-03-25T05:37:31.146396+0000","last_became_peered":"2024-03-25T05:37:31.146396+0000","last_unstale":"2024-03-25T06:04:18.605282+0000","last_undegraded":"2024-03-25T06:04:18.605282+0000","last_fullsized":"2024-03-25T06:04:18.605282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1732","last_scrub_stamp":"2024-03-25T06:04:18.605176+0000","last_deep_scrub":"27'1732","last_deep_scrub_stamp":"2024-03-25T06:04:18.605176+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.605176+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:08.138639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5046","reported_seq":5095,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:06.189599+0000","last_change":"2024-03-25T06:04:06.189599+0000","last_active":"2024-03-25T06:04:06.189599+0000","last_peered":"2024-03-25T06:04:06.189599+0000","last_clean":"2024-03-25T06:04:06.189599+0000","last_became_active":"2024-03-25T05:37:30.408439+0000","last_became_peered":"2024-03-25T05:37:30.408439+0000","last_unstale":"2024-03-25T06:04:06.189599+0000","last_undegraded":"2024-03-25T06:04:06.189599+0000","last_fullsized":"2024-03-25T06:04:06.189599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5046","last_scrub_stamp":"2024-03-25T06:04:06.189452+0000","last_deep_scrub":"27'5046","last_deep_scrub_stamp":"2024-03-25T06:04:06.189452+0000","last_clean_scrub_stamp":"2024-03-25T06:04:06.189452+0000","objects_scrubbed":5,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:52:34.854918+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390173,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5033,"num_write_kb":40185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'6521","reported_seq":6851,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.544686+0000","last_change":"2024-03-25T06:04:22.544730+0000","last_active":"2024-03-25T06:04:22.544686+0000","last_peered":"2024-03-25T06:04:22.544686+0000","last_clean":"2024-03-25T06:04:22.544686+0000","last_became_active":"2024-03-25T05:37:35.924998+0000","last_became_peered":"2024-03-25T05:37:35.924998+0000","last_unstale":"2024-03-25T06:04:22.544686+0000","last_undegraded":"2024-03-25T06:04:22.544686+0000","last_fullsized":"2024-03-25T06:04:22.544686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6521","last_scrub_stamp":"2024-03-25T06:04:22.544575+0000","last_deep_scrub":"27'6521","last_deep_scrub_stamp":"2024-03-25T06:04:22.544575+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.544575+0000","objects_scrubbed":0,"log_size":6521,"log_dups_size":0,"ondisk_log_size":6521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:13:50.026992+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":73152,"num_write":4691,"num_write_kb":118239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1750","reported_seq":1802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:25.649600+0000","last_change":"2024-03-25T06:04:25.649600+0000","last_active":"2024-03-25T06:04:25.649600+0000","last_peered":"2024-03-25T06:04:25.649600+0000","last_clean":"2024-03-25T06:04:25.649600+0000","last_became_active":"2024-03-25T05:38:20.652010+0000","last_became_peered":"2024-03-25T05:38:20.652010+0000","last_unstale":"2024-03-25T06:04:25.649600+0000","last_undegraded":"2024-03-25T06:04:25.649600+0000","last_fullsized":"2024-03-25T06:04:25.649600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1750","last_scrub_stamp":"2024-03-25T06:04:25.649469+0000","last_deep_scrub":"27'1750","last_deep_scrub_stamp":"2024-03-25T06:04:25.649469+0000","last_clean_scrub_stamp":"2024-03-25T06:04:25.649469+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:40:34.074838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5680","reported_seq":5729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.324744+0000","last_change":"2024-03-25T06:04:08.324744+0000","last_active":"2024-03-25T06:04:08.324744+0000","last_peered":"2024-03-25T06:04:08.324744+0000","last_clean":"2024-03-25T06:04:08.324744+0000","last_became_active":"2024-03-25T05:37:30.423416+0000","last_became_peered":"2024-03-25T05:37:30.423416+0000","last_unstale":"2024-03-25T06:04:08.324744+0000","last_undegraded":"2024-03-25T06:04:08.324744+0000","last_fullsized":"2024-03-25T06:04:08.324744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5680","last_scrub_stamp":"2024-03-25T06:04:08.324463+0000","last_deep_scrub":"27'5680","last_deep_scrub_stamp":"2024-03-25T06:04:08.324463+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.324463+0000","objects_scrubbed":2,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T12:59:08.192052+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5688,"num_write_kb":44802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'6240","reported_seq":6615,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.822397+0000","last_change":"2024-03-25T06:04:15.822397+0000","last_active":"2024-03-25T06:04:15.822397+0000","last_peered":"2024-03-25T06:04:15.822397+0000","last_clean":"2024-03-25T06:04:15.822397+0000","last_became_active":"2024-03-25T05:37:35.463104+0000","last_became_peered":"2024-03-25T05:37:35.463104+0000","last_unstale":"2024-03-25T06:04:15.822397+0000","last_undegraded":"2024-03-25T06:04:15.822397+0000","last_fullsized":"2024-03-25T06:04:15.822397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6240","last_scrub_stamp":"2024-03-25T06:04:15.822268+0000","last_deep_scrub":"27'6240","last_deep_scrub_stamp":"2024-03-25T06:04:15.822268+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.822268+0000","objects_scrubbed":0,"log_size":6240,"log_dups_size":0,"ondisk_log_size":6240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:43:53.565055+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":84582,"num_write":4342,"num_write_kb":115405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1667","reported_seq":1714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.545160+0000","last_change":"2024-03-25T06:04:20.545160+0000","last_active":"2024-03-25T06:04:20.545160+0000","last_peered":"2024-03-25T06:04:20.545160+0000","last_clean":"2024-03-25T06:04:20.545160+0000","last_became_active":"2024-03-25T05:37:31.147381+0000","last_became_peered":"2024-03-25T05:37:31.147381+0000","last_unstale":"2024-03-25T06:04:20.545160+0000","last_undegraded":"2024-03-25T06:04:20.545160+0000","last_fullsized":"2024-03-25T06:04:20.545160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1667","last_scrub_stamp":"2024-03-25T06:04:20.545076+0000","last_deep_scrub":"27'1667","last_deep_scrub_stamp":"2024-03-25T06:04:20.545076+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.545076+0000","objects_scrubbed":0,"log_size":1667,"log_dups_size":0,"ondisk_log_size":1667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:17.616315+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5648","reported_seq":5697,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.379334+0000","last_change":"2024-03-25T06:04:09.379334+0000","last_active":"2024-03-25T06:04:09.379334+0000","last_peered":"2024-03-25T06:04:09.379334+0000","last_clean":"2024-03-25T06:04:09.379334+0000","last_became_active":"2024-03-25T05:37:30.430827+0000","last_became_peered":"2024-03-25T05:37:30.430827+0000","last_unstale":"2024-03-25T06:04:09.379334+0000","last_undegraded":"2024-03-25T06:04:09.379334+0000","last_fullsized":"2024-03-25T06:04:09.379334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5648","last_scrub_stamp":"2024-03-25T06:04:09.379177+0000","last_deep_scrub":"27'5648","last_deep_scrub_stamp":"2024-03-25T06:04:09.379177+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.379177+0000","objects_scrubbed":6,"log_size":5648,"log_dups_size":0,"ondisk_log_size":5648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:54:29.597330+0000","scrub_duration":141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5640,"num_write_kb":40587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'6755","reported_seq":7105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.687857+0000","last_change":"2024-03-25T06:04:23.687902+0000","last_active":"2024-03-25T06:04:23.687857+0000","last_peered":"2024-03-25T06:04:23.687857+0000","last_clean":"2024-03-25T06:04:23.687857+0000","last_became_active":"2024-03-25T05:37:35.925297+0000","last_became_peered":"2024-03-25T05:37:35.925297+0000","last_unstale":"2024-03-25T06:04:23.687857+0000","last_undegraded":"2024-03-25T06:04:23.687857+0000","last_fullsized":"2024-03-25T06:04:23.687857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6755","last_scrub_stamp":"2024-03-25T06:04:23.687735+0000","last_deep_scrub":"27'6755","last_deep_scrub_stamp":"2024-03-25T06:04:23.687735+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.687735+0000","objects_scrubbed":0,"log_size":6755,"log_dups_size":0,"ondisk_log_size":6755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:41.775683+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":308,"num_read_kb":78232,"num_write":4941,"num_write_kb":116659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1749","reported_seq":1796,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.566877+0000","last_change":"2024-03-25T06:04:09.566877+0000","last_active":"2024-03-25T06:04:09.566877+0000","last_peered":"2024-03-25T06:04:09.566877+0000","last_clean":"2024-03-25T06:04:09.566877+0000","last_became_active":"2024-03-25T05:37:31.146174+0000","last_became_peered":"2024-03-25T05:37:31.146174+0000","last_unstale":"2024-03-25T06:04:09.566877+0000","last_undegraded":"2024-03-25T06:04:09.566877+0000","last_fullsized":"2024-03-25T06:04:09.566877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1749","last_scrub_stamp":"2024-03-25T06:04:09.566795+0000","last_deep_scrub":"27'1749","last_deep_scrub_stamp":"2024-03-25T06:04:09.566795+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.566795+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:47:21.328938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3459","reported_seq":3508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.057651+0000","last_change":"2024-03-25T06:04:07.057651+0000","last_active":"2024-03-25T06:04:07.057651+0000","last_peered":"2024-03-25T06:04:07.057651+0000","last_clean":"2024-03-25T06:04:07.057651+0000","last_became_active":"2024-03-25T05:37:30.418682+0000","last_became_peered":"2024-03-25T05:37:30.418682+0000","last_unstale":"2024-03-25T06:04:07.057651+0000","last_undegraded":"2024-03-25T06:04:07.057651+0000","last_fullsized":"2024-03-25T06:04:07.057651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3459","last_scrub_stamp":"2024-03-25T06:04:07.057499+0000","last_deep_scrub":"27'3459","last_deep_scrub_stamp":"2024-03-25T06:04:07.057499+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.057499+0000","objects_scrubbed":5,"log_size":3459,"log_dups_size":0,"ondisk_log_size":3459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:17:37.582221+0000","scrub_duration":69,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3453,"num_write_kb":26898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'6088","reported_seq":6165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.011290+0000","last_change":"2024-03-25T06:04:13.011334+0000","last_active":"2024-03-25T06:04:13.011290+0000","last_peered":"2024-03-25T06:04:13.011290+0000","last_clean":"2024-03-25T06:04:13.011290+0000","last_became_active":"2024-03-25T05:37:35.460131+0000","last_became_peered":"2024-03-25T05:37:35.460131+0000","last_unstale":"2024-03-25T06:04:13.011290+0000","last_undegraded":"2024-03-25T06:04:13.011290+0000","last_fullsized":"2024-03-25T06:04:13.011290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6088","last_scrub_stamp":"2024-03-25T06:04:13.011181+0000","last_deep_scrub":"27'6088","last_deep_scrub_stamp":"2024-03-25T06:04:13.011181+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.011181+0000","objects_scrubbed":0,"log_size":6088,"log_dups_size":0,"ondisk_log_size":6088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:34.388233+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":8890,"num_write":4238,"num_write_kb":109989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1751","reported_seq":1797,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.614144+0000","last_change":"2024-03-25T06:04:17.614183+0000","last_active":"2024-03-25T06:04:17.614144+0000","last_peered":"2024-03-25T06:04:17.614144+0000","last_clean":"2024-03-25T06:04:17.614144+0000","last_became_active":"2024-03-25T05:37:31.145481+0000","last_became_peered":"2024-03-25T05:37:31.145481+0000","last_unstale":"2024-03-25T06:04:17.614144+0000","last_undegraded":"2024-03-25T06:04:17.614144+0000","last_fullsized":"2024-03-25T06:04:17.614144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1751","last_scrub_stamp":"2024-03-25T06:04:17.614073+0000","last_deep_scrub":"27'1751","last_deep_scrub_stamp":"2024-03-25T06:04:17.614073+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.614073+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:03:59.675023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'2594","reported_seq":2642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.214300+0000","last_change":"2024-03-25T06:04:07.214374+0000","last_active":"2024-03-25T06:04:07.214300+0000","last_peered":"2024-03-25T06:04:07.214300+0000","last_clean":"2024-03-25T06:04:07.214300+0000","last_became_active":"2024-03-25T05:37:30.422583+0000","last_became_peered":"2024-03-25T05:37:30.422583+0000","last_unstale":"2024-03-25T06:04:07.214300+0000","last_undegraded":"2024-03-25T06:04:07.214300+0000","last_fullsized":"2024-03-25T06:04:07.214300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2594","last_scrub_stamp":"2024-03-25T06:04:07.214203+0000","last_deep_scrub":"27'2594","last_deep_scrub_stamp":"2024-03-25T06:04:07.214203+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.214203+0000","objects_scrubbed":8,"log_size":2594,"log_dups_size":0,"ondisk_log_size":2594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:39:06.151203+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2604,"num_write_kb":18105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'6139","reported_seq":6472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.878392+0000","last_change":"2024-03-25T06:04:14.878437+0000","last_active":"2024-03-25T06:04:14.878392+0000","last_peered":"2024-03-25T06:04:14.878392+0000","last_clean":"2024-03-25T06:04:14.878392+0000","last_became_active":"2024-03-25T05:37:35.460475+0000","last_became_peered":"2024-03-25T05:37:35.460475+0000","last_unstale":"2024-03-25T06:04:14.878392+0000","last_undegraded":"2024-03-25T06:04:14.878392+0000","last_fullsized":"2024-03-25T06:04:14.878392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6139","last_scrub_stamp":"2024-03-25T06:04:14.878256+0000","last_deep_scrub":"27'6139","last_deep_scrub_stamp":"2024-03-25T06:04:14.878256+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.878256+0000","objects_scrubbed":0,"log_size":6139,"log_dups_size":0,"ondisk_log_size":6139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:11.949495+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":74168,"num_write":4312,"num_write_kb":103632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1674","reported_seq":1719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.419386+0000","last_change":"2024-03-25T06:04:15.419409+0000","last_active":"2024-03-25T06:04:15.419386+0000","last_peered":"2024-03-25T06:04:15.419386+0000","last_clean":"2024-03-25T06:04:15.419386+0000","last_became_active":"2024-03-25T05:37:31.190841+0000","last_became_peered":"2024-03-25T05:37:31.190841+0000","last_unstale":"2024-03-25T06:04:15.419386+0000","last_undegraded":"2024-03-25T06:04:15.419386+0000","last_fullsized":"2024-03-25T06:04:15.419386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1674","last_scrub_stamp":"2024-03-25T06:04:15.419319+0000","last_deep_scrub":"27'1674","last_deep_scrub_stamp":"2024-03-25T06:04:15.419319+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.419319+0000","objects_scrubbed":0,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:12:00.128116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3096","reported_seq":3143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.466257+0000","last_change":"2024-03-25T06:04:09.466303+0000","last_active":"2024-03-25T06:04:09.466257+0000","last_peered":"2024-03-25T06:04:09.466257+0000","last_clean":"2024-03-25T06:04:09.466257+0000","last_became_active":"2024-03-25T05:37:30.403677+0000","last_became_peered":"2024-03-25T05:37:30.403677+0000","last_unstale":"2024-03-25T06:04:09.466257+0000","last_undegraded":"2024-03-25T06:04:09.466257+0000","last_fullsized":"2024-03-25T06:04:09.466257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3096","last_scrub_stamp":"2024-03-25T06:04:09.466167+0000","last_deep_scrub":"27'3096","last_deep_scrub_stamp":"2024-03-25T06:04:09.466167+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.466167+0000","objects_scrubbed":4,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:31:18.499780+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195287,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3110,"num_write_kb":22545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'6007","reported_seq":6465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.916378+0000","last_change":"2024-03-25T06:04:23.916423+0000","last_active":"2024-03-25T06:04:23.916378+0000","last_peered":"2024-03-25T06:04:23.916378+0000","last_clean":"2024-03-25T06:04:23.916378+0000","last_became_active":"2024-03-25T05:37:35.925742+0000","last_became_peered":"2024-03-25T05:37:35.925742+0000","last_unstale":"2024-03-25T06:04:23.916378+0000","last_undegraded":"2024-03-25T06:04:23.916378+0000","last_fullsized":"2024-03-25T06:04:23.916378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6007","last_scrub_stamp":"2024-03-25T06:04:23.916247+0000","last_deep_scrub":"27'6007","last_deep_scrub_stamp":"2024-03-25T06:04:23.916247+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.916247+0000","objects_scrubbed":0,"log_size":6007,"log_dups_size":0,"ondisk_log_size":6007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:27:01.314092+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":105918,"num_write":4139,"num_write_kb":116235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1748","reported_seq":1794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.574205+0000","last_change":"2024-03-25T06:04:19.574228+0000","last_active":"2024-03-25T06:04:19.574205+0000","last_peered":"2024-03-25T06:04:19.574205+0000","last_clean":"2024-03-25T06:04:19.574205+0000","last_became_active":"2024-03-25T05:37:31.147434+0000","last_became_peered":"2024-03-25T05:37:31.147434+0000","last_unstale":"2024-03-25T06:04:19.574205+0000","last_undegraded":"2024-03-25T06:04:19.574205+0000","last_fullsized":"2024-03-25T06:04:19.574205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1748","last_scrub_stamp":"2024-03-25T06:04:19.574133+0000","last_deep_scrub":"27'1748","last_deep_scrub_stamp":"2024-03-25T06:04:19.574133+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.574133+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:21.523465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'852","reported_seq":900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.597703+0000","last_change":"2024-03-25T06:04:14.597755+0000","last_active":"2024-03-25T06:04:14.597703+0000","last_peered":"2024-03-25T06:04:14.597703+0000","last_clean":"2024-03-25T06:04:14.597703+0000","last_became_active":"2024-03-25T05:37:30.428007+0000","last_became_peered":"2024-03-25T05:37:30.428007+0000","last_unstale":"2024-03-25T06:04:14.597703+0000","last_undegraded":"2024-03-25T06:04:14.597703+0000","last_fullsized":"2024-03-25T06:04:14.597703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'852","last_scrub_stamp":"2024-03-25T06:04:14.597601+0000","last_deep_scrub":"27'852","last_deep_scrub_stamp":"2024-03-25T06:04:14.597601+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.597601+0000","objects_scrubbed":4,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:35.974653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":860,"num_write_kb":8739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3446,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5773","reported_seq":6012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:25.930951+0000","last_change":"2024-03-25T06:04:25.930992+0000","last_active":"2024-03-25T06:04:25.930951+0000","last_peered":"2024-03-25T06:04:25.930951+0000","last_clean":"2024-03-25T06:04:25.930951+0000","last_became_active":"2024-03-25T05:37:35.928714+0000","last_became_peered":"2024-03-25T05:37:35.928714+0000","last_unstale":"2024-03-25T06:04:25.930951+0000","last_undegraded":"2024-03-25T06:04:25.930951+0000","last_fullsized":"2024-03-25T06:04:25.930951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5773","last_scrub_stamp":"2024-03-25T06:04:25.930824+0000","last_deep_scrub":"27'5773","last_deep_scrub_stamp":"2024-03-25T06:04:25.930824+0000","last_clean_scrub_stamp":"2024-03-25T06:04:25.930824+0000","objects_scrubbed":0,"log_size":5773,"log_dups_size":0,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:27:32.535925+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":50292,"num_write":4009,"num_write_kb":127285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1742","reported_seq":1787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.005580+0000","last_change":"2024-03-25T06:04:08.005623+0000","last_active":"2024-03-25T06:04:08.005580+0000","last_peered":"2024-03-25T06:04:08.005580+0000","last_clean":"2024-03-25T06:04:08.005580+0000","last_became_active":"2024-03-25T05:37:31.149458+0000","last_became_peered":"2024-03-25T05:37:31.149458+0000","last_unstale":"2024-03-25T06:04:08.005580+0000","last_undegraded":"2024-03-25T06:04:08.005580+0000","last_fullsized":"2024-03-25T06:04:08.005580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1742","last_scrub_stamp":"2024-03-25T06:04:08.005451+0000","last_deep_scrub":"27'1742","last_deep_scrub_stamp":"2024-03-25T06:04:08.005451+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.005451+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:29:02.307473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'3801","reported_seq":3848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:05.061122+0000","last_change":"2024-03-25T06:04:05.061187+0000","last_active":"2024-03-25T06:04:05.061122+0000","last_peered":"2024-03-25T06:04:05.061122+0000","last_clean":"2024-03-25T06:04:05.061122+0000","last_became_active":"2024-03-25T05:37:30.418798+0000","last_became_peered":"2024-03-25T05:37:30.418798+0000","last_unstale":"2024-03-25T06:04:05.061122+0000","last_undegraded":"2024-03-25T06:04:05.061122+0000","last_fullsized":"2024-03-25T06:04:05.061122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3801","last_scrub_stamp":"2024-03-25T06:04:05.061020+0000","last_deep_scrub":"27'3801","last_deep_scrub_stamp":"2024-03-25T06:04:05.061020+0000","last_clean_scrub_stamp":"2024-03-25T06:04:05.061020+0000","objects_scrubbed":8,"log_size":3801,"log_dups_size":0,"ondisk_log_size":3801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:17:35.585741+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3799,"num_write_kb":31202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5794","reported_seq":5889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:24.711547+0000","last_change":"2024-03-25T06:04:24.711572+0000","last_active":"2024-03-25T06:04:24.711547+0000","last_peered":"2024-03-25T06:04:24.711547+0000","last_clean":"2024-03-25T06:04:24.711547+0000","last_became_active":"2024-03-25T05:37:35.925937+0000","last_became_peered":"2024-03-25T05:37:35.925937+0000","last_unstale":"2024-03-25T06:04:24.711547+0000","last_undegraded":"2024-03-25T06:04:24.711547+0000","last_fullsized":"2024-03-25T06:04:24.711547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5794","last_scrub_stamp":"2024-03-25T06:04:24.711455+0000","last_deep_scrub":"27'5794","last_deep_scrub_stamp":"2024-03-25T06:04:24.711455+0000","last_clean_scrub_stamp":"2024-03-25T06:04:24.711455+0000","objects_scrubbed":0,"log_size":5794,"log_dups_size":0,"ondisk_log_size":5794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:20:37.101425+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":13716,"num_write":3987,"num_write_kb":98792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1662","reported_seq":1708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.581934+0000","last_change":"2024-03-25T06:04:22.581975+0000","last_active":"2024-03-25T06:04:22.581934+0000","last_peered":"2024-03-25T06:04:22.581934+0000","last_clean":"2024-03-25T06:04:22.581934+0000","last_became_active":"2024-03-25T05:37:31.162470+0000","last_became_peered":"2024-03-25T05:37:31.162470+0000","last_unstale":"2024-03-25T06:04:22.581934+0000","last_undegraded":"2024-03-25T06:04:22.581934+0000","last_fullsized":"2024-03-25T06:04:22.581934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1662","last_scrub_stamp":"2024-03-25T06:04:22.581838+0000","last_deep_scrub":"27'1662","last_deep_scrub_stamp":"2024-03-25T06:04:22.581838+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.581838+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:12.086769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'6630","reported_seq":7279,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.800201+0000","last_change":"2024-03-25T06:04:13.506767+0000","last_active":"2024-03-25T06:04:16.800201+0000","last_peered":"2024-03-25T06:04:16.800201+0000","last_clean":"2024-03-25T06:04:16.800201+0000","last_became_active":"2024-03-25T05:37:30.427558+0000","last_became_peered":"2024-03-25T05:37:30.427558+0000","last_unstale":"2024-03-25T06:04:16.800201+0000","last_undegraded":"2024-03-25T06:04:16.800201+0000","last_fullsized":"2024-03-25T06:04:16.800201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6628","last_scrub_stamp":"2024-03-25T06:04:13.506662+0000","last_deep_scrub":"27'6628","last_deep_scrub_stamp":"2024-03-25T06:04:13.506662+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.506662+0000","objects_scrubbed":9,"log_size":6630,"log_dups_size":0,"ondisk_log_size":6630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:19:11.564938+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15945484,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":602,"num_read_kb":3810,"num_write":6635,"num_write_kb":48814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'6000","reported_seq":6251,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.336786+0000","last_change":"2024-03-25T06:04:18.336827+0000","last_active":"2024-03-25T06:04:18.336786+0000","last_peered":"2024-03-25T06:04:18.336786+0000","last_clean":"2024-03-25T06:04:18.336786+0000","last_became_active":"2024-03-25T05:37:35.473007+0000","last_became_peered":"2024-03-25T05:37:35.473007+0000","last_unstale":"2024-03-25T06:04:18.336786+0000","last_undegraded":"2024-03-25T06:04:18.336786+0000","last_fullsized":"2024-03-25T06:04:18.336786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6000","last_scrub_stamp":"2024-03-25T06:04:18.336666+0000","last_deep_scrub":"27'6000","last_deep_scrub_stamp":"2024-03-25T06:04:18.336666+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.336666+0000","objects_scrubbed":0,"log_size":6000,"log_dups_size":0,"ondisk_log_size":6000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:07.841597+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":4195,"num_write_kb":128137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1718","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.003683+0000","last_change":"2024-03-25T06:04:08.003724+0000","last_active":"2024-03-25T06:04:08.003683+0000","last_peered":"2024-03-25T06:04:08.003683+0000","last_clean":"2024-03-25T06:04:08.003683+0000","last_became_active":"2024-03-25T05:37:31.143780+0000","last_became_peered":"2024-03-25T05:37:31.143780+0000","last_unstale":"2024-03-25T06:04:08.003683+0000","last_undegraded":"2024-03-25T06:04:08.003683+0000","last_fullsized":"2024-03-25T06:04:08.003683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1718","last_scrub_stamp":"2024-03-25T06:04:08.003578+0000","last_deep_scrub":"27'1718","last_deep_scrub_stamp":"2024-03-25T06:04:08.003578+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.003578+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:06.241604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5370","reported_seq":5418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.337303+0000","last_change":"2024-03-25T06:04:09.337368+0000","last_active":"2024-03-25T06:04:09.337303+0000","last_peered":"2024-03-25T06:04:09.337303+0000","last_clean":"2024-03-25T06:04:09.337303+0000","last_became_active":"2024-03-25T05:37:30.424929+0000","last_became_peered":"2024-03-25T05:37:30.424929+0000","last_unstale":"2024-03-25T06:04:09.337303+0000","last_undegraded":"2024-03-25T06:04:09.337303+0000","last_fullsized":"2024-03-25T06:04:09.337303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5370","last_scrub_stamp":"2024-03-25T06:04:09.337202+0000","last_deep_scrub":"27'5370","last_deep_scrub_stamp":"2024-03-25T06:04:09.337202+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.337202+0000","objects_scrubbed":6,"log_size":5370,"log_dups_size":0,"ondisk_log_size":5370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:54.045999+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5368,"num_write_kb":32642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'6005","reported_seq":6101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.972250+0000","last_change":"2024-03-25T06:04:15.972293+0000","last_active":"2024-03-25T06:04:15.972250+0000","last_peered":"2024-03-25T06:04:15.972250+0000","last_clean":"2024-03-25T06:04:15.972250+0000","last_became_active":"2024-03-25T05:37:35.463052+0000","last_became_peered":"2024-03-25T05:37:35.463052+0000","last_unstale":"2024-03-25T06:04:15.972250+0000","last_undegraded":"2024-03-25T06:04:15.972250+0000","last_fullsized":"2024-03-25T06:04:15.972250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6005","last_scrub_stamp":"2024-03-25T06:04:15.972129+0000","last_deep_scrub":"27'6005","last_deep_scrub_stamp":"2024-03-25T06:04:15.972129+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.972129+0000","objects_scrubbed":0,"log_size":6005,"log_dups_size":0,"ondisk_log_size":6005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:17.921461+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":13970,"num_write":4188,"num_write_kb":117446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1734","reported_seq":1784,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.842263+0000","last_change":"2024-03-25T06:04:19.842312+0000","last_active":"2024-03-25T06:04:19.842263+0000","last_peered":"2024-03-25T06:04:19.842263+0000","last_clean":"2024-03-25T06:04:19.842263+0000","last_became_active":"2024-03-25T05:38:20.652007+0000","last_became_peered":"2024-03-25T05:38:20.652007+0000","last_unstale":"2024-03-25T06:04:19.842263+0000","last_undegraded":"2024-03-25T06:04:19.842263+0000","last_fullsized":"2024-03-25T06:04:19.842263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1734","last_scrub_stamp":"2024-03-25T06:04:19.842157+0000","last_deep_scrub":"27'1734","last_deep_scrub_stamp":"2024-03-25T06:04:19.842157+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.842157+0000","objects_scrubbed":0,"log_size":1734,"log_dups_size":0,"ondisk_log_size":1734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:37.930105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5608","reported_seq":5656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.498800+0000","last_change":"2024-03-25T06:04:10.498853+0000","last_active":"2024-03-25T06:04:10.498800+0000","last_peered":"2024-03-25T06:04:10.498800+0000","last_clean":"2024-03-25T06:04:10.498800+0000","last_became_active":"2024-03-25T05:37:30.408973+0000","last_became_peered":"2024-03-25T05:37:30.408973+0000","last_unstale":"2024-03-25T06:04:10.498800+0000","last_undegraded":"2024-03-25T06:04:10.498800+0000","last_fullsized":"2024-03-25T06:04:10.498800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5608","last_scrub_stamp":"2024-03-25T06:04:10.498724+0000","last_deep_scrub":"27'5608","last_deep_scrub_stamp":"2024-03-25T06:04:10.498724+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.498724+0000","objects_scrubbed":4,"log_size":5608,"log_dups_size":0,"ondisk_log_size":5608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:26.542055+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5607,"num_write_kb":40642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5713","reported_seq":6173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.946720+0000","last_change":"2024-03-25T06:04:20.946761+0000","last_active":"2024-03-25T06:04:20.946720+0000","last_peered":"2024-03-25T06:04:20.946720+0000","last_clean":"2024-03-25T06:04:20.946720+0000","last_became_active":"2024-03-25T05:37:35.463414+0000","last_became_peered":"2024-03-25T05:37:35.463414+0000","last_unstale":"2024-03-25T06:04:20.946720+0000","last_undegraded":"2024-03-25T06:04:20.946720+0000","last_fullsized":"2024-03-25T06:04:20.946720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5713","last_scrub_stamp":"2024-03-25T06:04:20.946598+0000","last_deep_scrub":"27'5713","last_deep_scrub_stamp":"2024-03-25T06:04:20.946598+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.946598+0000","objects_scrubbed":0,"log_size":5713,"log_dups_size":0,"ondisk_log_size":5713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:13:26.707355+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":106426,"num_write":4014,"num_write_kb":116763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1704","reported_seq":1750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.470951+0000","last_change":"2024-03-25T06:04:08.470951+0000","last_active":"2024-03-25T06:04:08.470951+0000","last_peered":"2024-03-25T06:04:08.470951+0000","last_clean":"2024-03-25T06:04:08.470951+0000","last_became_active":"2024-03-25T05:37:31.145054+0000","last_became_peered":"2024-03-25T05:37:31.145054+0000","last_unstale":"2024-03-25T06:04:08.470951+0000","last_undegraded":"2024-03-25T06:04:08.470951+0000","last_fullsized":"2024-03-25T06:04:08.470951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1704","last_scrub_stamp":"2024-03-25T06:04:08.470859+0000","last_deep_scrub":"27'1704","last_deep_scrub_stamp":"2024-03-25T06:04:08.470859+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.470859+0000","objects_scrubbed":0,"log_size":1704,"log_dups_size":0,"ondisk_log_size":1704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:53.564721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4521","reported_seq":5369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.443357+0000","last_change":"2024-03-25T06:04:11.443405+0000","last_active":"2024-03-25T06:04:11.443357+0000","last_peered":"2024-03-25T06:04:11.443357+0000","last_clean":"2024-03-25T06:04:11.443357+0000","last_became_active":"2024-03-25T05:37:30.407458+0000","last_became_peered":"2024-03-25T05:37:30.407458+0000","last_unstale":"2024-03-25T06:04:11.443357+0000","last_undegraded":"2024-03-25T06:04:11.443357+0000","last_fullsized":"2024-03-25T06:04:11.443357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4521","last_scrub_stamp":"2024-03-25T06:04:11.443262+0000","last_deep_scrub":"27'4521","last_deep_scrub_stamp":"2024-03-25T06:04:11.443262+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.443262+0000","objects_scrubbed":4,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:56.537124+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":802,"num_read_kb":4614,"num_write":4526,"num_write_kb":35760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6267","reported_seq":6671,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.962852+0000","last_change":"2024-03-25T06:04:22.962900+0000","last_active":"2024-03-25T06:04:22.962852+0000","last_peered":"2024-03-25T06:04:22.962852+0000","last_clean":"2024-03-25T06:04:22.962852+0000","last_became_active":"2024-03-25T05:37:35.926000+0000","last_became_peered":"2024-03-25T05:37:35.926000+0000","last_unstale":"2024-03-25T06:04:22.962852+0000","last_undegraded":"2024-03-25T06:04:22.962852+0000","last_fullsized":"2024-03-25T06:04:22.962852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6267","last_scrub_stamp":"2024-03-25T06:04:22.962737+0000","last_deep_scrub":"27'6267","last_deep_scrub_stamp":"2024-03-25T06:04:22.962737+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.962737+0000","objects_scrubbed":0,"log_size":6267,"log_dups_size":0,"ondisk_log_size":6267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:30:08.243359+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":92202,"num_write":4370,"num_write_kb":119524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5994","reported_seq":6101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.904708+0000","last_change":"2024-03-25T06:04:17.904752+0000","last_active":"2024-03-25T06:04:17.904708+0000","last_peered":"2024-03-25T06:04:17.904708+0000","last_clean":"2024-03-25T06:04:17.904708+0000","last_became_active":"2024-03-25T05:37:35.927285+0000","last_became_peered":"2024-03-25T05:37:35.927285+0000","last_unstale":"2024-03-25T06:04:17.904708+0000","last_undegraded":"2024-03-25T06:04:17.904708+0000","last_fullsized":"2024-03-25T06:04:17.904708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5994","last_scrub_stamp":"2024-03-25T06:04:17.904584+0000","last_deep_scrub":"27'5994","last_deep_scrub_stamp":"2024-03-25T06:04:17.904584+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.904584+0000","objects_scrubbed":0,"log_size":5994,"log_dups_size":0,"ondisk_log_size":5994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:25.559745+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":4233,"num_write_kb":107763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1683","reported_seq":1729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.268918+0000","last_change":"2024-03-25T06:04:15.268918+0000","last_active":"2024-03-25T06:04:15.268918+0000","last_peered":"2024-03-25T06:04:15.268918+0000","last_clean":"2024-03-25T06:04:15.268918+0000","last_became_active":"2024-03-25T05:37:31.168887+0000","last_became_peered":"2024-03-25T05:37:31.168887+0000","last_unstale":"2024-03-25T06:04:15.268918+0000","last_undegraded":"2024-03-25T06:04:15.268918+0000","last_fullsized":"2024-03-25T06:04:15.268918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1683","last_scrub_stamp":"2024-03-25T06:04:15.268774+0000","last_deep_scrub":"27'1683","last_deep_scrub_stamp":"2024-03-25T06:04:15.268774+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.268774+0000","objects_scrubbed":0,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:17.218107+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'8149","reported_seq":8197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.522530+0000","last_change":"2024-03-25T06:04:11.522563+0000","last_active":"2024-03-25T06:04:11.522530+0000","last_peered":"2024-03-25T06:04:11.522530+0000","last_clean":"2024-03-25T06:04:11.522530+0000","last_became_active":"2024-03-25T05:37:30.409047+0000","last_became_peered":"2024-03-25T05:37:30.409047+0000","last_unstale":"2024-03-25T06:04:11.522530+0000","last_undegraded":"2024-03-25T06:04:11.522530+0000","last_fullsized":"2024-03-25T06:04:11.522530+0000","mapping_epoch":17,"log_start":"27'600","ondisk_log_start":"27'600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8149","last_scrub_stamp":"2024-03-25T06:04:11.522467+0000","last_deep_scrub":"27'8149","last_deep_scrub_stamp":"2024-03-25T06:04:11.522467+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.522467+0000","objects_scrubbed":3,"log_size":7549,"log_dups_size":0,"ondisk_log_size":7549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:11:56.231264+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8142,"num_write_kb":58721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'6008","reported_seq":6340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.522957+0000","last_change":"2024-03-25T06:04:21.522957+0000","last_active":"2024-03-25T06:04:21.522957+0000","last_peered":"2024-03-25T06:04:21.522957+0000","last_clean":"2024-03-25T06:04:21.522957+0000","last_became_active":"2024-03-25T05:37:35.454512+0000","last_became_peered":"2024-03-25T05:37:35.454512+0000","last_unstale":"2024-03-25T06:04:21.522957+0000","last_undegraded":"2024-03-25T06:04:21.522957+0000","last_fullsized":"2024-03-25T06:04:21.522957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6008","last_scrub_stamp":"2024-03-25T06:04:21.522790+0000","last_deep_scrub":"27'6008","last_deep_scrub_stamp":"2024-03-25T06:04:21.522790+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.522790+0000","objects_scrubbed":0,"log_size":6008,"log_dups_size":0,"ondisk_log_size":6008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:23.472123+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":73406,"num_write":4233,"num_write_kb":113322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1753","reported_seq":1798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:07.812578+0000","last_change":"2024-03-25T06:04:07.812578+0000","last_active":"2024-03-25T06:04:07.812578+0000","last_peered":"2024-03-25T06:04:07.812578+0000","last_clean":"2024-03-25T06:04:07.812578+0000","last_became_active":"2024-03-25T05:37:31.171342+0000","last_became_peered":"2024-03-25T05:37:31.171342+0000","last_unstale":"2024-03-25T06:04:07.812578+0000","last_undegraded":"2024-03-25T06:04:07.812578+0000","last_fullsized":"2024-03-25T06:04:07.812578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1753","last_scrub_stamp":"2024-03-25T06:04:07.812444+0000","last_deep_scrub":"27'1753","last_deep_scrub_stamp":"2024-03-25T06:04:07.812444+0000","last_clean_scrub_stamp":"2024-03-25T06:04:07.812444+0000","objects_scrubbed":0,"log_size":1753,"log_dups_size":0,"ondisk_log_size":1753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:31:10.477058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4104","reported_seq":4151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.997154+0000","last_change":"2024-03-25T06:04:11.997154+0000","last_active":"2024-03-25T06:04:11.997154+0000","last_peered":"2024-03-25T06:04:11.997154+0000","last_clean":"2024-03-25T06:04:11.997154+0000","last_became_active":"2024-03-25T05:37:30.420481+0000","last_became_peered":"2024-03-25T05:37:30.420481+0000","last_unstale":"2024-03-25T06:04:11.997154+0000","last_undegraded":"2024-03-25T06:04:11.997154+0000","last_fullsized":"2024-03-25T06:04:11.997154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4104","last_scrub_stamp":"2024-03-25T06:04:11.997032+0000","last_deep_scrub":"27'4104","last_deep_scrub_stamp":"2024-03-25T06:04:11.997032+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.997032+0000","objects_scrubbed":5,"log_size":4104,"log_dups_size":0,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T17:50:56.184732+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4095,"num_write_kb":35371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7953","reported_seq":7999,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.542522+0000","last_change":"2024-03-25T06:04:10.542585+0000","last_active":"2024-03-25T06:04:10.542522+0000","last_peered":"2024-03-25T06:04:10.542522+0000","last_clean":"2024-03-25T06:04:10.542522+0000","last_became_active":"2024-03-25T05:37:30.403794+0000","last_became_peered":"2024-03-25T05:37:30.403794+0000","last_unstale":"2024-03-25T06:04:10.542522+0000","last_undegraded":"2024-03-25T06:04:10.542522+0000","last_fullsized":"2024-03-25T06:04:10.542522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7953","last_scrub_stamp":"2024-03-25T06:04:10.542426+0000","last_deep_scrub":"27'7953","last_deep_scrub_stamp":"2024-03-25T06:04:10.542426+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.542426+0000","objects_scrubbed":6,"log_size":7953,"log_dups_size":0,"ondisk_log_size":7953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:47:22.304570+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7943,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1690","reported_seq":1734,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.002927+0000","last_change":"2024-03-25T06:04:11.002965+0000","last_active":"2024-03-25T06:04:11.002927+0000","last_peered":"2024-03-25T06:04:11.002927+0000","last_clean":"2024-03-25T06:04:11.002927+0000","last_became_active":"2024-03-25T05:37:31.157955+0000","last_became_peered":"2024-03-25T05:37:31.157955+0000","last_unstale":"2024-03-25T06:04:11.002927+0000","last_undegraded":"2024-03-25T06:04:11.002927+0000","last_fullsized":"2024-03-25T06:04:11.002927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1690","last_scrub_stamp":"2024-03-25T06:04:11.002835+0000","last_deep_scrub":"27'1690","last_deep_scrub_stamp":"2024-03-25T06:04:11.002835+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.002835+0000","objects_scrubbed":0,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T07:43:51.433042+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'6118","reported_seq":6239,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.228209+0000","last_change":"2024-03-25T06:04:11.228251+0000","last_active":"2024-03-25T06:04:11.228209+0000","last_peered":"2024-03-25T06:04:11.228209+0000","last_clean":"2024-03-25T06:04:11.228209+0000","last_became_active":"2024-03-25T05:37:35.462745+0000","last_became_peered":"2024-03-25T05:37:35.462745+0000","last_unstale":"2024-03-25T06:04:11.228209+0000","last_undegraded":"2024-03-25T06:04:11.228209+0000","last_fullsized":"2024-03-25T06:04:11.228209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6118","last_scrub_stamp":"2024-03-25T06:04:11.228094+0000","last_deep_scrub":"27'6118","last_deep_scrub_stamp":"2024-03-25T06:04:11.228094+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.228094+0000","objects_scrubbed":0,"log_size":6118,"log_dups_size":0,"ondisk_log_size":6118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:18.700607+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":4277,"num_write_kb":113266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6315","reported_seq":6361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.006484+0000","last_change":"2024-03-25T06:04:13.006548+0000","last_active":"2024-03-25T06:04:13.006484+0000","last_peered":"2024-03-25T06:04:13.006484+0000","last_clean":"2024-03-25T06:04:13.006484+0000","last_became_active":"2024-03-25T05:37:30.428479+0000","last_became_peered":"2024-03-25T05:37:30.428479+0000","last_unstale":"2024-03-25T06:04:13.006484+0000","last_undegraded":"2024-03-25T06:04:13.006484+0000","last_fullsized":"2024-03-25T06:04:13.006484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6315","last_scrub_stamp":"2024-03-25T06:04:13.006373+0000","last_deep_scrub":"27'6315","last_deep_scrub_stamp":"2024-03-25T06:04:13.006373+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.006373+0000","objects_scrubbed":8,"log_size":6315,"log_dups_size":0,"ondisk_log_size":6315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:02.539836+0000","scrub_duration":112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166841,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6301,"num_write_kb":53214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1724","reported_seq":1769,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.979444+0000","last_change":"2024-03-25T06:04:08.979482+0000","last_active":"2024-03-25T06:04:08.979444+0000","last_peered":"2024-03-25T06:04:08.979444+0000","last_clean":"2024-03-25T06:04:08.979444+0000","last_became_active":"2024-03-25T05:37:31.160309+0000","last_became_peered":"2024-03-25T05:37:31.160309+0000","last_unstale":"2024-03-25T06:04:08.979444+0000","last_undegraded":"2024-03-25T06:04:08.979444+0000","last_fullsized":"2024-03-25T06:04:08.979444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1724","last_scrub_stamp":"2024-03-25T06:04:08.979331+0000","last_deep_scrub":"27'1724","last_deep_scrub_stamp":"2024-03-25T06:04:08.979331+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.979331+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:23:25.022662+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'6483","reported_seq":6985,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.921349+0000","last_change":"2024-03-25T06:04:21.921375+0000","last_active":"2024-03-25T06:04:21.921349+0000","last_peered":"2024-03-25T06:04:21.921349+0000","last_clean":"2024-03-25T06:04:21.921349+0000","last_became_active":"2024-03-25T05:37:35.464440+0000","last_became_peered":"2024-03-25T05:37:35.464440+0000","last_unstale":"2024-03-25T06:04:21.921349+0000","last_undegraded":"2024-03-25T06:04:21.921349+0000","last_fullsized":"2024-03-25T06:04:21.921349+0000","mapping_epoch":22,"log_start":"27'200","ondisk_log_start":"27'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6483","last_scrub_stamp":"2024-03-25T06:04:21.921247+0000","last_deep_scrub":"27'6483","last_deep_scrub_stamp":"2024-03-25T06:04:21.921247+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.921247+0000","objects_scrubbed":0,"log_size":6283,"log_dups_size":0,"ondisk_log_size":6283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:40:30.346616+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":117348,"num_write":4686,"num_write_kb":179694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1680","reported_seq":1727,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.518467+0000","last_change":"2024-03-25T06:04:18.518467+0000","last_active":"2024-03-25T06:04:18.518467+0000","last_peered":"2024-03-25T06:04:18.518467+0000","last_clean":"2024-03-25T06:04:18.518467+0000","last_became_active":"2024-03-25T05:37:31.191372+0000","last_became_peered":"2024-03-25T05:37:31.191372+0000","last_unstale":"2024-03-25T06:04:18.518467+0000","last_undegraded":"2024-03-25T06:04:18.518467+0000","last_fullsized":"2024-03-25T06:04:18.518467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1680","last_scrub_stamp":"2024-03-25T06:04:18.518382+0000","last_deep_scrub":"27'1680","last_deep_scrub_stamp":"2024-03-25T06:04:18.518382+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.518382+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:11:39.895434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1763","reported_seq":1816,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:12.217823+0000","last_change":"2024-03-25T06:04:12.217823+0000","last_active":"2024-03-25T06:04:12.217823+0000","last_peered":"2024-03-25T06:04:12.217823+0000","last_clean":"2024-03-25T06:04:12.217823+0000","last_became_active":"2024-03-25T05:38:20.652189+0000","last_became_peered":"2024-03-25T05:38:20.652189+0000","last_unstale":"2024-03-25T06:04:12.217823+0000","last_undegraded":"2024-03-25T06:04:12.217823+0000","last_fullsized":"2024-03-25T06:04:12.217823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1763","last_scrub_stamp":"2024-03-25T06:04:12.217686+0000","last_deep_scrub":"27'1763","last_deep_scrub_stamp":"2024-03-25T06:04:12.217686+0000","last_clean_scrub_stamp":"2024-03-25T06:04:12.217686+0000","objects_scrubbed":0,"log_size":1763,"log_dups_size":0,"ondisk_log_size":1763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:23:57.310278+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1678","reported_seq":1726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.594282+0000","last_change":"2024-03-25T06:04:20.594282+0000","last_active":"2024-03-25T06:04:20.594282+0000","last_peered":"2024-03-25T06:04:20.594282+0000","last_clean":"2024-03-25T06:04:20.594282+0000","last_became_active":"2024-03-25T05:37:31.163866+0000","last_became_peered":"2024-03-25T05:37:31.163866+0000","last_unstale":"2024-03-25T06:04:20.594282+0000","last_undegraded":"2024-03-25T06:04:20.594282+0000","last_fullsized":"2024-03-25T06:04:20.594282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1678","last_scrub_stamp":"2024-03-25T06:04:20.594148+0000","last_deep_scrub":"27'1678","last_deep_scrub_stamp":"2024-03-25T06:04:20.594148+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.594148+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:10.099079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1791","reported_seq":1838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:03.973454+0000","last_change":"2024-03-25T06:04:03.973454+0000","last_active":"2024-03-25T06:04:03.973454+0000","last_peered":"2024-03-25T06:04:03.973454+0000","last_clean":"2024-03-25T06:04:03.973454+0000","last_became_active":"2024-03-25T05:37:31.163703+0000","last_became_peered":"2024-03-25T05:37:31.163703+0000","last_unstale":"2024-03-25T06:04:03.973454+0000","last_undegraded":"2024-03-25T06:04:03.973454+0000","last_fullsized":"2024-03-25T06:04:03.973454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1791","last_scrub_stamp":"2024-03-25T06:04:03.973299+0000","last_deep_scrub":"27'1791","last_deep_scrub_stamp":"2024-03-25T06:04:03.973299+0000","last_clean_scrub_stamp":"2024-03-25T06:04:03.973299+0000","objects_scrubbed":0,"log_size":1791,"log_dups_size":0,"ondisk_log_size":1791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:45:41.687046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1719","reported_seq":1765,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.941375+0000","last_change":"2024-03-25T06:04:16.941413+0000","last_active":"2024-03-25T06:04:16.941375+0000","last_peered":"2024-03-25T06:04:16.941375+0000","last_clean":"2024-03-25T06:04:16.941375+0000","last_became_active":"2024-03-25T05:37:31.164878+0000","last_became_peered":"2024-03-25T05:37:31.164878+0000","last_unstale":"2024-03-25T06:04:16.941375+0000","last_undegraded":"2024-03-25T06:04:16.941375+0000","last_fullsized":"2024-03-25T06:04:16.941375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1719","last_scrub_stamp":"2024-03-25T06:04:16.941260+0000","last_deep_scrub":"27'1719","last_deep_scrub_stamp":"2024-03-25T06:04:16.941260+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.941260+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:27:06.446191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1678","reported_seq":1725,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:05.246842+0000","last_change":"2024-03-25T06:04:05.246883+0000","last_active":"2024-03-25T06:04:05.246842+0000","last_peered":"2024-03-25T06:04:05.246842+0000","last_clean":"2024-03-25T06:04:05.246842+0000","last_became_active":"2024-03-25T05:37:31.165900+0000","last_became_peered":"2024-03-25T05:37:31.165900+0000","last_unstale":"2024-03-25T06:04:05.246842+0000","last_undegraded":"2024-03-25T06:04:05.246842+0000","last_fullsized":"2024-03-25T06:04:05.246842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1678","last_scrub_stamp":"2024-03-25T06:04:05.246731+0000","last_deep_scrub":"27'1678","last_deep_scrub_stamp":"2024-03-25T06:04:05.246731+0000","last_clean_scrub_stamp":"2024-03-25T06:04:05.246731+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:27:50.340593+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1768","reported_seq":1814,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.561387+0000","last_change":"2024-03-25T06:04:19.561407+0000","last_active":"2024-03-25T06:04:19.561387+0000","last_peered":"2024-03-25T06:04:19.561387+0000","last_clean":"2024-03-25T06:04:19.561387+0000","last_became_active":"2024-03-25T05:37:31.192489+0000","last_became_peered":"2024-03-25T05:37:31.192489+0000","last_unstale":"2024-03-25T06:04:19.561387+0000","last_undegraded":"2024-03-25T06:04:19.561387+0000","last_fullsized":"2024-03-25T06:04:19.561387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1768","last_scrub_stamp":"2024-03-25T06:04:19.561323+0000","last_deep_scrub":"27'1768","last_deep_scrub_stamp":"2024-03-25T06:04:19.561323+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.561323+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T18:04:01.622273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1715","reported_seq":1761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:15.992301+0000","last_change":"2024-03-25T06:04:15.992351+0000","last_active":"2024-03-25T06:04:15.992301+0000","last_peered":"2024-03-25T06:04:15.992301+0000","last_clean":"2024-03-25T06:04:15.992301+0000","last_became_active":"2024-03-25T05:37:31.164688+0000","last_became_peered":"2024-03-25T05:37:31.164688+0000","last_unstale":"2024-03-25T06:04:15.992301+0000","last_undegraded":"2024-03-25T06:04:15.992301+0000","last_fullsized":"2024-03-25T06:04:15.992301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1715","last_scrub_stamp":"2024-03-25T06:04:15.992203+0000","last_deep_scrub":"27'1715","last_deep_scrub_stamp":"2024-03-25T06:04:15.992203+0000","last_clean_scrub_stamp":"2024-03-25T06:04:15.992203+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:01.532864+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1695","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:22.618815+0000","last_change":"2024-03-25T06:04:22.618853+0000","last_active":"2024-03-25T06:04:22.618815+0000","last_peered":"2024-03-25T06:04:22.618815+0000","last_clean":"2024-03-25T06:04:22.618815+0000","last_became_active":"2024-03-25T05:37:31.166789+0000","last_became_peered":"2024-03-25T05:37:31.166789+0000","last_unstale":"2024-03-25T06:04:22.618815+0000","last_undegraded":"2024-03-25T06:04:22.618815+0000","last_fullsized":"2024-03-25T06:04:22.618815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1695","last_scrub_stamp":"2024-03-25T06:04:22.618731+0000","last_deep_scrub":"27'1695","last_deep_scrub_stamp":"2024-03-25T06:04:22.618731+0000","last_clean_scrub_stamp":"2024-03-25T06:04:22.618731+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:23.501448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1732","reported_seq":1778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.964351+0000","last_change":"2024-03-25T06:04:14.964351+0000","last_active":"2024-03-25T06:04:14.964351+0000","last_peered":"2024-03-25T06:04:14.964351+0000","last_clean":"2024-03-25T06:04:14.964351+0000","last_became_active":"2024-03-25T05:37:31.162811+0000","last_became_peered":"2024-03-25T05:37:31.162811+0000","last_unstale":"2024-03-25T06:04:14.964351+0000","last_undegraded":"2024-03-25T06:04:14.964351+0000","last_fullsized":"2024-03-25T06:04:14.964351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1732","last_scrub_stamp":"2024-03-25T06:04:14.964214+0000","last_deep_scrub":"27'1732","last_deep_scrub_stamp":"2024-03-25T06:04:14.964214+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.964214+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:12.035453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1733","reported_seq":1780,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.431625+0000","last_change":"2024-03-25T06:04:09.431625+0000","last_active":"2024-03-25T06:04:09.431625+0000","last_peered":"2024-03-25T06:04:09.431625+0000","last_clean":"2024-03-25T06:04:09.431625+0000","last_became_active":"2024-03-25T05:37:31.144481+0000","last_became_peered":"2024-03-25T05:37:31.144481+0000","last_unstale":"2024-03-25T06:04:09.431625+0000","last_undegraded":"2024-03-25T06:04:09.431625+0000","last_fullsized":"2024-03-25T06:04:09.431625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1733","last_scrub_stamp":"2024-03-25T06:04:09.431499+0000","last_deep_scrub":"27'1733","last_deep_scrub_stamp":"2024-03-25T06:04:09.431499+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.431499+0000","objects_scrubbed":0,"log_size":1733,"log_dups_size":0,"ondisk_log_size":1733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:57:07.669526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1758","reported_seq":1804,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.991237+0000","last_change":"2024-03-25T06:04:09.991237+0000","last_active":"2024-03-25T06:04:09.991237+0000","last_peered":"2024-03-25T06:04:09.991237+0000","last_clean":"2024-03-25T06:04:09.991237+0000","last_became_active":"2024-03-25T05:37:31.152555+0000","last_became_peered":"2024-03-25T05:37:31.152555+0000","last_unstale":"2024-03-25T06:04:09.991237+0000","last_undegraded":"2024-03-25T06:04:09.991237+0000","last_fullsized":"2024-03-25T06:04:09.991237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1758","last_scrub_stamp":"2024-03-25T06:04:09.991098+0000","last_deep_scrub":"27'1758","last_deep_scrub_stamp":"2024-03-25T06:04:09.991098+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.991098+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:57:02.606098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1731","reported_seq":1777,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.491067+0000","last_change":"2024-03-25T06:04:17.491067+0000","last_active":"2024-03-25T06:04:17.491067+0000","last_peered":"2024-03-25T06:04:17.491067+0000","last_clean":"2024-03-25T06:04:17.491067+0000","last_became_active":"2024-03-25T05:37:31.191146+0000","last_became_peered":"2024-03-25T05:37:31.191146+0000","last_unstale":"2024-03-25T06:04:17.491067+0000","last_undegraded":"2024-03-25T06:04:17.491067+0000","last_fullsized":"2024-03-25T06:04:17.491067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1731","last_scrub_stamp":"2024-03-25T06:04:17.490932+0000","last_deep_scrub":"27'1731","last_deep_scrub_stamp":"2024-03-25T06:04:17.490932+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.490932+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:24.895671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1775","reported_seq":1822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:23.605543+0000","last_change":"2024-03-25T06:04:23.605543+0000","last_active":"2024-03-25T06:04:23.605543+0000","last_peered":"2024-03-25T06:04:23.605543+0000","last_clean":"2024-03-25T06:04:23.605543+0000","last_became_active":"2024-03-25T05:37:31.171604+0000","last_became_peered":"2024-03-25T05:37:31.171604+0000","last_unstale":"2024-03-25T06:04:23.605543+0000","last_undegraded":"2024-03-25T06:04:23.605543+0000","last_fullsized":"2024-03-25T06:04:23.605543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1775","last_scrub_stamp":"2024-03-25T06:04:23.605412+0000","last_deep_scrub":"27'1775","last_deep_scrub_stamp":"2024-03-25T06:04:23.605412+0000","last_clean_scrub_stamp":"2024-03-25T06:04:23.605412+0000","objects_scrubbed":0,"log_size":1775,"log_dups_size":0,"ondisk_log_size":1775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:31.260573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1682","reported_seq":1728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:10.217643+0000","last_change":"2024-03-25T06:04:10.217679+0000","last_active":"2024-03-25T06:04:10.217643+0000","last_peered":"2024-03-25T06:04:10.217643+0000","last_clean":"2024-03-25T06:04:10.217643+0000","last_became_active":"2024-03-25T05:37:31.196873+0000","last_became_peered":"2024-03-25T05:37:31.196873+0000","last_unstale":"2024-03-25T06:04:10.217643+0000","last_undegraded":"2024-03-25T06:04:10.217643+0000","last_fullsized":"2024-03-25T06:04:10.217643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1682","last_scrub_stamp":"2024-03-25T06:04:10.217551+0000","last_deep_scrub":"27'1682","last_deep_scrub_stamp":"2024-03-25T06:04:10.217551+0000","last_clean_scrub_stamp":"2024-03-25T06:04:10.217551+0000","objects_scrubbed":0,"log_size":1682,"log_dups_size":0,"ondisk_log_size":1682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T14:43:33.028198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1721","reported_seq":1767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:17.562004+0000","last_change":"2024-03-25T06:04:17.562044+0000","last_active":"2024-03-25T06:04:17.562004+0000","last_peered":"2024-03-25T06:04:17.562004+0000","last_clean":"2024-03-25T06:04:17.562004+0000","last_became_active":"2024-03-25T05:37:31.141955+0000","last_became_peered":"2024-03-25T05:37:31.141955+0000","last_unstale":"2024-03-25T06:04:17.562004+0000","last_undegraded":"2024-03-25T06:04:17.562004+0000","last_fullsized":"2024-03-25T06:04:17.562004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1721","last_scrub_stamp":"2024-03-25T06:04:17.561879+0000","last_deep_scrub":"27'1721","last_deep_scrub_stamp":"2024-03-25T06:04:17.561879+0000","last_clean_scrub_stamp":"2024-03-25T06:04:17.561879+0000","objects_scrubbed":0,"log_size":1721,"log_dups_size":0,"ondisk_log_size":1721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T11:28:19.511212+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'1641","reported_seq":1687,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:19.631854+0000","last_change":"2024-03-25T06:04:19.631876+0000","last_active":"2024-03-25T06:04:19.631854+0000","last_peered":"2024-03-25T06:04:19.631854+0000","last_clean":"2024-03-25T06:04:19.631854+0000","last_became_active":"2024-03-25T05:37:31.154800+0000","last_became_peered":"2024-03-25T05:37:31.154800+0000","last_unstale":"2024-03-25T06:04:19.631854+0000","last_undegraded":"2024-03-25T06:04:19.631854+0000","last_fullsized":"2024-03-25T06:04:19.631854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1641","last_scrub_stamp":"2024-03-25T06:04:19.631796+0000","last_deep_scrub":"27'1641","last_deep_scrub_stamp":"2024-03-25T06:04:19.631796+0000","last_clean_scrub_stamp":"2024-03-25T06:04:19.631796+0000","objects_scrubbed":0,"log_size":1641,"log_dups_size":0,"ondisk_log_size":1641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:05.172457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'1764","reported_seq":1815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.392157+0000","last_change":"2024-03-25T06:04:21.392195+0000","last_active":"2024-03-25T06:04:21.392157+0000","last_peered":"2024-03-25T06:04:21.392157+0000","last_clean":"2024-03-25T06:04:21.392157+0000","last_became_active":"2024-03-25T05:38:20.652582+0000","last_became_peered":"2024-03-25T05:38:20.652582+0000","last_unstale":"2024-03-25T06:04:21.392157+0000","last_undegraded":"2024-03-25T06:04:21.392157+0000","last_fullsized":"2024-03-25T06:04:21.392157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1764","last_scrub_stamp":"2024-03-25T06:04:21.392019+0000","last_deep_scrub":"27'1764","last_deep_scrub_stamp":"2024-03-25T06:04:21.392019+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.392019+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:39.479967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1705","reported_seq":1750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.986938+0000","last_change":"2024-03-25T06:04:11.986978+0000","last_active":"2024-03-25T06:04:11.986938+0000","last_peered":"2024-03-25T06:04:11.986938+0000","last_clean":"2024-03-25T06:04:11.986938+0000","last_became_active":"2024-03-25T05:37:31.163476+0000","last_became_peered":"2024-03-25T05:37:31.163476+0000","last_unstale":"2024-03-25T06:04:11.986938+0000","last_undegraded":"2024-03-25T06:04:11.986938+0000","last_fullsized":"2024-03-25T06:04:11.986938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1705","last_scrub_stamp":"2024-03-25T06:04:11.986837+0000","last_deep_scrub":"27'1705","last_deep_scrub_stamp":"2024-03-25T06:04:11.986837+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.986837+0000","objects_scrubbed":0,"log_size":1705,"log_dups_size":0,"ondisk_log_size":1705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T06:47:39.609709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1692","reported_seq":1737,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:09.869433+0000","last_change":"2024-03-25T06:04:09.869471+0000","last_active":"2024-03-25T06:04:09.869433+0000","last_peered":"2024-03-25T06:04:09.869433+0000","last_clean":"2024-03-25T06:04:09.869433+0000","last_became_active":"2024-03-25T05:37:31.196980+0000","last_became_peered":"2024-03-25T05:37:31.196980+0000","last_unstale":"2024-03-25T06:04:09.869433+0000","last_undegraded":"2024-03-25T06:04:09.869433+0000","last_fullsized":"2024-03-25T06:04:09.869433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1692","last_scrub_stamp":"2024-03-25T06:04:09.869314+0000","last_deep_scrub":"27'1692","last_deep_scrub_stamp":"2024-03-25T06:04:09.869314+0000","last_clean_scrub_stamp":"2024-03-25T06:04:09.869314+0000","objects_scrubbed":0,"log_size":1692,"log_dups_size":0,"ondisk_log_size":1692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:17.274053+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1623","reported_seq":1669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:11.984590+0000","last_change":"2024-03-25T06:04:11.984611+0000","last_active":"2024-03-25T06:04:11.984590+0000","last_peered":"2024-03-25T06:04:11.984590+0000","last_clean":"2024-03-25T06:04:11.984590+0000","last_became_active":"2024-03-25T05:37:31.191689+0000","last_became_peered":"2024-03-25T05:37:31.191689+0000","last_unstale":"2024-03-25T06:04:11.984590+0000","last_undegraded":"2024-03-25T06:04:11.984590+0000","last_fullsized":"2024-03-25T06:04:11.984590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1623","last_scrub_stamp":"2024-03-25T06:04:11.984523+0000","last_deep_scrub":"27'1623","last_deep_scrub_stamp":"2024-03-25T06:04:11.984523+0000","last_clean_scrub_stamp":"2024-03-25T06:04:11.984523+0000","objects_scrubbed":0,"log_size":1623,"log_dups_size":0,"ondisk_log_size":1623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:57:19.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1678","reported_seq":1723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:16.470079+0000","last_change":"2024-03-25T06:04:16.470120+0000","last_active":"2024-03-25T06:04:16.470079+0000","last_peered":"2024-03-25T06:04:16.470079+0000","last_clean":"2024-03-25T06:04:16.470079+0000","last_became_active":"2024-03-25T05:37:31.190960+0000","last_became_peered":"2024-03-25T05:37:31.190960+0000","last_unstale":"2024-03-25T06:04:16.470079+0000","last_undegraded":"2024-03-25T06:04:16.470079+0000","last_fullsized":"2024-03-25T06:04:16.470079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1678","last_scrub_stamp":"2024-03-25T06:04:16.469981+0000","last_deep_scrub":"27'1678","last_deep_scrub_stamp":"2024-03-25T06:04:16.469981+0000","last_clean_scrub_stamp":"2024-03-25T06:04:16.469981+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:47:00.115758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1750","reported_seq":1795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:20.538013+0000","last_change":"2024-03-25T06:04:20.538049+0000","last_active":"2024-03-25T06:04:20.538013+0000","last_peered":"2024-03-25T06:04:20.538013+0000","last_clean":"2024-03-25T06:04:20.538013+0000","last_became_active":"2024-03-25T05:37:31.192666+0000","last_became_peered":"2024-03-25T05:37:31.192666+0000","last_unstale":"2024-03-25T06:04:20.538013+0000","last_undegraded":"2024-03-25T06:04:20.538013+0000","last_fullsized":"2024-03-25T06:04:20.538013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1750","last_scrub_stamp":"2024-03-25T06:04:20.537908+0000","last_deep_scrub":"27'1750","last_deep_scrub_stamp":"2024-03-25T06:04:20.537908+0000","last_clean_scrub_stamp":"2024-03-25T06:04:20.537908+0000","objects_scrubbed":0,"log_size":1750,"log_dups_size":0,"ondisk_log_size":1750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:10.071371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1767","reported_seq":1813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.578618+0000","last_change":"2024-03-25T06:04:21.578640+0000","last_active":"2024-03-25T06:04:21.578618+0000","last_peered":"2024-03-25T06:04:21.578618+0000","last_clean":"2024-03-25T06:04:21.578618+0000","last_became_active":"2024-03-25T05:37:31.147345+0000","last_became_peered":"2024-03-25T05:37:31.147345+0000","last_unstale":"2024-03-25T06:04:21.578618+0000","last_undegraded":"2024-03-25T06:04:21.578618+0000","last_fullsized":"2024-03-25T06:04:21.578618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1767","last_scrub_stamp":"2024-03-25T06:04:21.578556+0000","last_deep_scrub":"27'1767","last_deep_scrub_stamp":"2024-03-25T06:04:21.578556+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.578556+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T10:17:07.119218+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1703","reported_seq":1747,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:08.837337+0000","last_change":"2024-03-25T06:04:08.837378+0000","last_active":"2024-03-25T06:04:08.837337+0000","last_peered":"2024-03-25T06:04:08.837337+0000","last_clean":"2024-03-25T06:04:08.837337+0000","last_became_active":"2024-03-25T05:37:31.165984+0000","last_became_peered":"2024-03-25T05:37:31.165984+0000","last_unstale":"2024-03-25T06:04:08.837337+0000","last_undegraded":"2024-03-25T06:04:08.837337+0000","last_fullsized":"2024-03-25T06:04:08.837337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1703","last_scrub_stamp":"2024-03-25T06:04:08.837220+0000","last_deep_scrub":"27'1703","last_deep_scrub_stamp":"2024-03-25T06:04:08.837220+0000","last_clean_scrub_stamp":"2024-03-25T06:04:08.837220+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:46:52.482997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1680","reported_seq":1709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.254430+0000","last_change":"2024-03-25T06:04:13.254468+0000","last_active":"2024-03-25T06:04:13.254430+0000","last_peered":"2024-03-25T06:04:13.254430+0000","last_clean":"2024-03-25T06:04:13.254430+0000","last_became_active":"2024-03-25T05:38:20.655743+0000","last_became_peered":"2024-03-25T05:38:20.655743+0000","last_unstale":"2024-03-25T06:04:13.254430+0000","last_undegraded":"2024-03-25T06:04:13.254430+0000","last_fullsized":"2024-03-25T06:04:13.254430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1680","last_scrub_stamp":"2024-03-25T06:04:13.254338+0000","last_deep_scrub":"27'1680","last_deep_scrub_stamp":"2024-03-25T06:04:13.254338+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.254338+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:44:19.995014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1655","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:18.587030+0000","last_change":"2024-03-25T06:04:18.587075+0000","last_active":"2024-03-25T06:04:18.587030+0000","last_peered":"2024-03-25T06:04:18.587030+0000","last_clean":"2024-03-25T06:04:18.587030+0000","last_became_active":"2024-03-25T05:37:31.154773+0000","last_became_peered":"2024-03-25T05:37:31.154773+0000","last_unstale":"2024-03-25T06:04:18.587030+0000","last_undegraded":"2024-03-25T06:04:18.587030+0000","last_fullsized":"2024-03-25T06:04:18.587030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1655","last_scrub_stamp":"2024-03-25T06:04:18.586936+0000","last_deep_scrub":"27'1655","last_deep_scrub_stamp":"2024-03-25T06:04:18.586936+0000","last_clean_scrub_stamp":"2024-03-25T06:04:18.586936+0000","objects_scrubbed":0,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T16:02:15.658175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1748","reported_seq":1793,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:24.613191+0000","last_change":"2024-03-25T06:04:24.613212+0000","last_active":"2024-03-25T06:04:24.613191+0000","last_peered":"2024-03-25T06:04:24.613191+0000","last_clean":"2024-03-25T06:04:24.613191+0000","last_became_active":"2024-03-25T05:37:31.171850+0000","last_became_peered":"2024-03-25T05:37:31.171850+0000","last_unstale":"2024-03-25T06:04:24.613191+0000","last_undegraded":"2024-03-25T06:04:24.613191+0000","last_fullsized":"2024-03-25T06:04:24.613191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1748","last_scrub_stamp":"2024-03-25T06:04:24.613125+0000","last_deep_scrub":"27'1748","last_deep_scrub_stamp":"2024-03-25T06:04:24.613125+0000","last_clean_scrub_stamp":"2024-03-25T06:04:24.613125+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T13:20:25.495842+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1743","reported_seq":1791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:21.641150+0000","last_change":"2024-03-25T06:04:21.641191+0000","last_active":"2024-03-25T06:04:21.641150+0000","last_peered":"2024-03-25T06:04:21.641150+0000","last_clean":"2024-03-25T06:04:21.641150+0000","last_became_active":"2024-03-25T05:37:31.166769+0000","last_became_peered":"2024-03-25T05:37:31.166769+0000","last_unstale":"2024-03-25T06:04:21.641150+0000","last_undegraded":"2024-03-25T06:04:21.641150+0000","last_fullsized":"2024-03-25T06:04:21.641150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1743","last_scrub_stamp":"2024-03-25T06:04:21.641057+0000","last_deep_scrub":"27'1743","last_deep_scrub_stamp":"2024-03-25T06:04:21.641057+0000","last_clean_scrub_stamp":"2024-03-25T06:04:21.641057+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:25:29.296218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1793","reported_seq":1840,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:13.897012+0000","last_change":"2024-03-25T06:04:13.897012+0000","last_active":"2024-03-25T06:04:13.897012+0000","last_peered":"2024-03-25T06:04:13.897012+0000","last_clean":"2024-03-25T06:04:13.897012+0000","last_became_active":"2024-03-25T05:37:31.173176+0000","last_became_peered":"2024-03-25T05:37:31.173176+0000","last_unstale":"2024-03-25T06:04:13.897012+0000","last_undegraded":"2024-03-25T06:04:13.897012+0000","last_fullsized":"2024-03-25T06:04:13.897012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1793","last_scrub_stamp":"2024-03-25T06:04:13.896866+0000","last_deep_scrub":"27'1793","last_deep_scrub_stamp":"2024-03-25T06:04:13.896866+0000","last_clean_scrub_stamp":"2024-03-25T06:04:13.896866+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T08:22:04.227428+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1658","reported_seq":1706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:14.288686+0000","last_change":"2024-03-25T06:04:14.288686+0000","last_active":"2024-03-25T06:04:14.288686+0000","last_peered":"2024-03-25T06:04:14.288686+0000","last_clean":"2024-03-25T06:04:14.288686+0000","last_became_active":"2024-03-25T05:37:31.168080+0000","last_became_peered":"2024-03-25T05:37:31.168080+0000","last_unstale":"2024-03-25T06:04:14.288686+0000","last_undegraded":"2024-03-25T06:04:14.288686+0000","last_fullsized":"2024-03-25T06:04:14.288686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1658","last_scrub_stamp":"2024-03-25T06:04:14.288555+0000","last_deep_scrub":"27'1658","last_deep_scrub_stamp":"2024-03-25T06:04:14.288555+0000","last_clean_scrub_stamp":"2024-03-25T06:04:14.288555+0000","objects_scrubbed":0,"log_size":1658,"log_dups_size":0,"ondisk_log_size":1658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T09:53:03.822017+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1640","reported_seq":1688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-25T06:04:25.606670+0000","last_change":"2024-03-25T06:04:25.606670+0000","last_active":"2024-03-25T06:04:25.606670+0000","last_peered":"2024-03-25T06:04:25.606670+0000","last_clean":"2024-03-25T06:04:25.606670+0000","last_became_active":"2024-03-25T05:37:31.193771+0000","last_became_peered":"2024-03-25T05:37:31.193771+0000","last_unstale":"2024-03-25T06:04:25.606670+0000","last_undegraded":"2024-03-25T06:04:25.606670+0000","last_fullsized":"2024-03-25T06:04:25.606670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1640","last_scrub_stamp":"2024-03-25T06:04:25.606512+0000","last_deep_scrub":"27'1640","last_deep_scrub_stamp":"2024-03-25T06:04:25.606512+0000","last_clean_scrub_stamp":"2024-03-25T06:04:25.606512+0000","objects_scrubbed":0,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-26T15:55:43.694460+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5893,"num_read_kb":1496822,"num_write":138342,"num_write_kb":3815118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195984,"ondisk_log_size":195984,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110026,"ondisk_log_size":110026,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":234056899,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":2370,"num_read_kb":13152,"num_write":159064,"num_write_kb":1157067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33779,"num_omap_keys":66,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":312410112,"data_stored":468113798,"data_compressed":49584516,"data_compressed_allocated":73408512,"data_compressed_original":229359616,"omap_allocated":0,"internal_metadata":0},"log_size":154613,"ondisk_log_size":154613,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64856,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":762648,"kb_used_data":37392,"kb_used_omap":1,"kb_used_meta":725246,"kb_avail":93609192,"statfs":{"total":96636764160,"available":95855812608,"internally_reserved":0,"allocated":38289408,"data_stored":59434799,"data_compressed":6535216,"data_compressed_allocated":9568256,"data_compressed_original":30920704,"omap_allocated":1590,"internal_metadata":742652362},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575179,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":832220,"kb_used_data":47380,"kb_used_omap":1,"kb_used_meta":784830,"kb_avail":93539620,"statfs":{"total":96636764160,"available":95784570880,"internally_reserved":0,"allocated":48517120,"data_stored":74788605,"data_compressed":8150968,"data_compressed_allocated":11956224,"data_compressed_original":38424576,"omap_allocated":1594,"internal_metadata":803666374},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575178,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":797816,"kb_used_data":40624,"kb_used_omap":1,"kb_used_meta":757182,"kb_avail":93574024,"statfs":{"total":96636764160,"available":95819800576,"internally_reserved":0,"allocated":41598976,"data_stored":58846263,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":1595,"internal_metadata":775354821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":721680,"kb_used_data":36680,"kb_used_omap":1,"kb_used_meta":684990,"kb_avail":93650160,"statfs":{"total":96636764160,"available":95897763840,"internally_reserved":0,"allocated":37560320,"data_stored":54649357,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":1595,"internal_metadata":701430213},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575176,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":850460,"kb_used_data":57364,"kb_used_omap":1,"kb_used_meta":793086,"kb_avail":93521380,"statfs":{"total":96636764160,"available":95765893120,"internally_reserved":0,"allocated":58740736,"data_stored":91565855,"data_compressed":9984239,"data_compressed_allocated":14540800,"data_compressed_original":47566848,"omap_allocated":1593,"internal_metadata":812120519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457036,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":428094,"kb_avail":93914804,"statfs":{"total":96636764160,"available":96168759296,"internally_reserved":0,"allocated":29626368,"data_stored":42066577,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":1595,"internal_metadata":438368709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575177,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":882164,"kb_used_data":30700,"kb_used_omap":1,"kb_used_meta":851454,"kb_avail":93489676,"statfs":{"total":96636764160,"available":95733428224,"internally_reserved":0,"allocated":31436800,"data_stored":46260556,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":1595,"internal_metadata":871889349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":573192,"kb_used_data":28416,"kb_used_omap":1,"kb_used_meta":544766,"kb_avail":93798648,"statfs":{"total":96636764160,"available":96049815552,"internally_reserved":0,"allocated":29097984,"data_stored":42655962,"data_compressed":4366242,"data_compressed_allocated":6533120,"data_compressed_original":20291584,"omap_allocated":1595,"internal_metadata":557840837},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32428,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28741632,"data_stored":41943914,"data_compressed":4333814,"data_compressed_allocated":6488064,"data_compressed_original":19718144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31145984,"data_stored":46138876,"data_compressed":4790655,"data_compressed_allocated":7110656,"data_compressed_original":22130688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29335552,"data_stored":41944897,"data_compressed":4218955,"data_compressed_allocated":6352896,"data_compressed_original":18993152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":58449920,"data_stored":91444175,"data_compressed":9984239,"data_compressed_allocated":14540800,"data_compressed_original":47566848,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":37269504,"data_stored":54527677,"data_compressed":5626722,"data_compressed_allocated":8368128,"data_compressed_original":25649152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41308160,"data_stored":58724583,"data_compressed":5976375,"data_compressed_allocated":9068544,"data_compressed_original":26529792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48226304,"data_stored":74666925,"data_compressed":8150968,"data_compressed_allocated":11956224,"data_compressed_original":38424576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37933056,"data_stored":58722751,"data_compressed":6502788,"data_compressed_allocated":9523200,"data_compressed_original":30347264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-25T06:04:50.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-25T06:04:51.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.040+0000 7f08b7e00640 1 Processor -- start 2024-03-25T06:04:51.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.040+0000 7f08b7e00640 1 -- start start 2024-03-25T06:04:51.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.041+0000 7f08b7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b8153e80 0x7f08b80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b7e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f08b8154260 0x7f08b80c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b7e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80c8220 con 0x7f08b80cb0e0 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b7e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80c8500 con 0x7f08b8154260 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b7e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80ca320 con 0x7f08b8153e80 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f08b8154260 0x7f08b80c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b8153e80 0x7f08b80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f08b8154260 0x7f08b80c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:57762/0 (socket says 172.21.15.102:57762) 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b8153e80 0x7f08b80c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38442/0 (socket says 172.21.15.102:38442) 2024-03-25T06:04:51.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6000640 1 -- 172.21.15.102:0/2010993522 learned_addr learned my addr 172.21.15.102:0/2010993522 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:51.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6000640 1 -- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b8153e80 msgr2=0x7f08b80c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:51.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6000640 1 --2- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b8153e80 0x7f08b80c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.042+0000 7f08b6000640 1 -- 172.21.15.102:0/2010993522 >> v1:172.21.15.102:6789/0 conn(0x7f08b80cb0e0 legacy=0x7f08b80cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.043+0000 7f08b6000640 1 -- 172.21.15.102:0/2010993522 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80ca600 con 0x7f08b8154260 2024-03-25T06:04:51.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.043+0000 7f08b6a00640 1 --2- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b8153e80 0x7f08b80c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:51.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.044+0000 7f08b6000640 1 --2- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8154260 0x7f08b80c6cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7fb42c8a1d0a0f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.044+0000 7f08b5600640 1 -- 172.21.15.102:0/2010993522 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a402f840 con 0x7f08b8154260 2024-03-25T06:04:51.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.044+0000 7f08b5600640 1 -- 172.21.15.102:0/2010993522 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a402f9a0 con 0x7f08b8154260 2024-03-25T06:04:51.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.044+0000 7f08b5600640 1 -- 172.21.15.102:0/2010993522 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a402fd30 con 0x7f08b8154260 2024-03-25T06:04:51.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.045+0000 7f08b7e00640 1 -- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8154260 msgr2=0x7f08b80c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.045+0000 7f08b7e00640 1 --2- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8154260 0x7f08b80c6cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009870 tx=0x7f08a402ba20 comp rx=0 tx=0).stop 2024-03-25T06:04:51.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.045+0000 7f08b7e00640 1 -- 172.21.15.102:0/2010993522 shutdown_connections 2024-03-25T06:04:51.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.045+0000 7f08b7e00640 1 --2- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8154260 0x7f08b80c6cb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.045+0000 7f08b7e00640 1 --2- 172.21.15.102:0/2010993522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b8153e80 0x7f08b80c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.045+0000 7f08b7e00640 1 -- 172.21.15.102:0/2010993522 >> 172.21.15.102:0/2010993522 conn(0x7f08b80cf370 msgr2=0x7f08b80cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:51.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.045+0000 7f08b7e00640 1 -- 172.21.15.102:0/2010993522 shutdown_connections 2024-03-25T06:04:51.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.046+0000 7f08b7e00640 1 -- 172.21.15.102:0/2010993522 wait complete. 2024-03-25T06:04:51.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.047+0000 7f08b7e00640 1 Processor -- start 2024-03-25T06:04:51.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.047+0000 7f08b7e00640 1 -- start start 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80cb0e0 0x7f08b815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8153e80 0x7f08b80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b7e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b80c5390 0x7f08b815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b7e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815b070 con 0x7f08b80c5390 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b7e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8157b50 con 0x7f08b8153e80 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b7e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8158080 con 0x7f08b80cb0e0 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b6000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8153e80 0x7f08b80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b6000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8153e80 0x7f08b80c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:57776/0 (socket says 172.21.15.102:57776) 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b6000640 1 -- 172.21.15.102:0/3937835163 learned_addr learned my addr 172.21.15.102:0/3937835163 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b6a00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80cb0e0 0x7f08b815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.049+0000 7f08b7400640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b80c5390 0x7f08b815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08b6000640 1 -- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80cb0e0 msgr2=0x7f08b815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08b6000640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80cb0e0 0x7f08b815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08b6000640 1 -- 172.21.15.102:0/3937835163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b80c5390 msgr2=0x7f08b815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08b6000640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b80c5390 0x7f08b815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08b6000640 1 -- 172.21.15.102:0/3937835163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8009400 con 0x7f08b8153e80 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08b7400640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b80c5390 0x7f08b815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08b6000640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8153e80 0x7f08b80c4920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08a402ba60 tx=0x7f08a4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4037c40 con 0x7f08b8153e80 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4037da0 con 0x7f08b8153e80 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.050+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40426c0 con 0x7f08b8153e80 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.051+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a40094d0 con 0x7f08b8153e80 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.051+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b81f03f0 con 0x7f08b8153e80 2024-03-25T06:04:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.052+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b815b1b0 con 0x7f08b8153e80 2024-03-25T06:04:51.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.053+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08a402d3d0 con 0x7f08b8153e80 2024-03-25T06:04:51.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.054+0000 7f08aea00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f089806b840 0x7f089806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.054+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f08a403c070 con 0x7f08b8153e80 2024-03-25T06:04:51.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.054+0000 7f08b6a00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f089806b840 0x7f089806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.055+0000 7f08b6a00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f089806b840 0x7f089806dd00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009cd0 tx=0x7f08a8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.058+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f08b815b1b0 con 0x7f08b8153e80 2024-03-25T06:04:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.249+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f08b815b1b0 con 0x7f08b8153e80 2024-03-25T06:04:51.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.254+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08a40770b0 con 0x7f08b8153e80 2024-03-25T06:04:51.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.254+0000 7f08aea00640 1 -- 172.21.15.102:0/3937835163 <== mon.1 v2:172.21.15.187:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f08b815b1b0 con 0x7f08b8153e80 2024-03-25T06:04:51.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.257+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f089806b840 msgr2=0x7f089806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.257+0000 7f08b7e00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f089806b840 0x7f089806dd00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009cd0 tx=0x7f08a8009190 comp rx=0 tx=0).stop 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.257+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8153e80 msgr2=0x7f08b80c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.257+0000 7f08b7e00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8153e80 0x7f08b80c4920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08a402ba60 tx=0x7f08a4004730 comp rx=0 tx=0).stop 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.257+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 shutdown_connections 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.257+0000 7f08b7e00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f089806b840 0x7f089806dd00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.258+0000 7f08b7e00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b80c5390 0x7f08b815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.258+0000 7f08b7e00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b8153e80 0x7f08b80c4920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.258+0000 7f08b7e00640 1 --2- 172.21.15.102:0/3937835163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80cb0e0 0x7f08b815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.258+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 >> 172.21.15.102:0/3937835163 conn(0x7f08b80cf370 msgr2=0x7f08b8151650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.258+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 shutdown_connections 2024-03-25T06:04:51.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.258+0000 7f08b7e00640 1 -- 172.21.15.102:0/3937835163 wait complete. 2024-03-25T06:04:51.268 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-25T06:04:51.268 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T06:04:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.482+0000 7fbb1de00640 1 Processor -- start 2024-03-25T06:04:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.483+0000 7fbb1de00640 1 -- start start 2024-03-25T06:04:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb18154120 0x7fbb180cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1de00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbb180c67e0 0x7fbb180cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1de00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180cbbe0 con 0x7fbb180c6c10 2024-03-25T06:04:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1de00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb18154500 con 0x7fbb180c67e0 2024-03-25T06:04:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1de00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1806b250 con 0x7fbb18154120 2024-03-25T06:04:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb17e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbb180c67e0 0x7fbb180cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1d400640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbb180c6c10 0x7fbb180c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40444/0 (socket says 172.21.15.102:40444) 2024-03-25T06:04:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1d400640 1 -- 172.21.15.102:0/3407642657 learned_addr learned my addr 172.21.15.102:0/3407642657 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb1ca00640 1 --2- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb18154120 0x7fbb180cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb17e00640 1 -- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb18154120 msgr2=0x7fbb180cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.484+0000 7fbb17e00640 1 --2- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb18154120 0x7fbb180cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.485+0000 7fbb17e00640 1 -- 172.21.15.102:0/3407642657 >> v1:172.21.15.102:6789/0 conn(0x7fbb180c6c10 legacy=0x7fbb180c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.485+0000 7fbb17e00640 1 -- 172.21.15.102:0/3407642657 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180ca280 con 0x7fbb180c67e0 2024-03-25T06:04:51.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb17e00640 1 --2- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180cb540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb040097a0 tx=0x7fbb0402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe7ed6c678a8fd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb17400640 1 -- 172.21.15.102:0/3407642657 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0402d040 con 0x7fbb180c67e0 2024-03-25T06:04:51.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb17400640 1 -- 172.21.15.102:0/3407642657 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbb04031810 con 0x7fbb180c67e0 2024-03-25T06:04:51.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb17400640 1 -- 172.21.15.102:0/3407642657 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04031bc0 con 0x7fbb180c67e0 2024-03-25T06:04:51.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb1de00640 1 -- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 msgr2=0x7fbb180cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb1de00640 1 --2- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180cb540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb040097a0 tx=0x7fbb0402b8b0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb1de00640 1 -- 172.21.15.102:0/3407642657 shutdown_connections 2024-03-25T06:04:51.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb1de00640 1 --2- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180cb540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb1de00640 1 --2- 172.21.15.102:0/3407642657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb18154120 0x7fbb180cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.486+0000 7fbb1de00640 1 -- 172.21.15.102:0/3407642657 >> 172.21.15.102:0/3407642657 conn(0x7fbb180cf3e0 msgr2=0x7fbb180cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:51.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.487+0000 7fbb1de00640 1 -- 172.21.15.102:0/3407642657 shutdown_connections 2024-03-25T06:04:51.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.487+0000 7fbb1de00640 1 -- 172.21.15.102:0/3407642657 wait complete. 2024-03-25T06:04:51.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.488+0000 7fbb1de00640 1 Processor -- start 2024-03-25T06:04:51.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.488+0000 7fbb1de00640 1 -- start start 2024-03-25T06:04:51.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb1de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb1de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180c6c10 0x7fbb180c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb1de00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb18154120 0x7fbb181f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb1de00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18150a40 con 0x7fbb18154120 2024-03-25T06:04:51.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb1de00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180c5880 con 0x7fbb180c67e0 2024-03-25T06:04:51.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb1de00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb181f3b50 con 0x7fbb180c6c10 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180c6c10 0x7fbb180c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.489+0000 7fbb1ca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180c6c10 0x7fbb180c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38476/0 (socket says 172.21.15.102:38476) 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 -- 172.21.15.102:0/2650837004 learned_addr learned my addr 172.21.15.102:0/2650837004 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb1ca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:57790/0 (socket says 172.21.15.102:57790) 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb1d400640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb18154120 0x7fbb181f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 -- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 msgr2=0x7fbb180c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 -- 172.21.15.102:0/2650837004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb18154120 msgr2=0x7fbb181f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb18154120 0x7fbb181f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 -- 172.21.15.102:0/2650837004 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04009400 con 0x7fbb180c6c10 2024-03-25T06:04:51.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.490+0000 7fbb17e00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180c6c10 0x7fbb180c43b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb040098c0 tx=0x7fbb040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.491+0000 7fbb14c00640 1 -- 172.21.15.102:0/2650837004 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0403ad60 con 0x7fbb180c6c10 2024-03-25T06:04:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.491+0000 7fbb14c00640 1 -- 172.21.15.102:0/2650837004 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbb040423f0 con 0x7fbb180c6c10 2024-03-25T06:04:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.491+0000 7fbb14c00640 1 -- 172.21.15.102:0/2650837004 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040427c0 con 0x7fbb180c6c10 2024-03-25T06:04:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.491+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb180c5350 con 0x7fbb180c6c10 2024-03-25T06:04:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.491+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb181f3870 con 0x7fbb180c6c10 2024-03-25T06:04:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.492+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1804f2f0 con 0x7fbb180c6c10 2024-03-25T06:04:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.494+0000 7fbb14c00640 1 -- 172.21.15.102:0/2650837004 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb0404b450 con 0x7fbb180c6c10 2024-03-25T06:04:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.495+0000 7fbb14c00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fbaf806b810 0x7fbaf806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.495+0000 7fbb14c00640 1 -- 172.21.15.102:0/2650837004 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fbb040ac620 con 0x7fbb180c6c10 2024-03-25T06:04:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.495+0000 7fbb1ca00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fbaf806b810 0x7fbaf806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.496+0000 7fbb1ca00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fbaf806b810 0x7fbaf806dcd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009aa0 tx=0x7fbb0c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.499+0000 7fbb14c00640 1 -- 172.21.15.102:0/2650837004 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbb04076b60 con 0x7fbb180c6c10 2024-03-25T06:04:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.734+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb180cb5a0 con 0x7fbb180c6c10 2024-03-25T06:04:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.734+0000 7fbb14c00640 1 -- 172.21.15.102:0/2650837004 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6654 (secure 0 0 0) 0x7fbb0407a220 con 0x7fbb180c6c10 2024-03-25T06:04:51.728 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:51.728 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:57.547664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4291,"mds_1":4273,"mds_2":4270,"mds_3":4250,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4270":{"gid":4270,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4244,4270,4250,4273,4291]},"id":1}]} 2024-03-25T06:04:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-03-25T06:04:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fbaf806b810 msgr2=0x7fbaf806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fbaf806b810 0x7fbaf806dcd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009aa0 tx=0x7fbb0c009190 comp rx=0 tx=0).stop 2024-03-25T06:04:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180c6c10 msgr2=0x7fbb180c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180c6c10 0x7fbb180c43b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb040098c0 tx=0x7fbb040046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 shutdown_connections 2024-03-25T06:04:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fbaf806b810 0x7fbaf806dcd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb18154120 0x7fbb181f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180c6c10 0x7fbb180c43b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 --2- 172.21.15.102:0/2650837004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180c67e0 0x7fbb180c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 >> 172.21.15.102:0/2650837004 conn(0x7fbb180cf3e0 msgr2=0x7fbb1806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.737+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 shutdown_connections 2024-03-25T06:04:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.738+0000 7fbb1de00640 1 -- 172.21.15.102:0/2650837004 wait complete. 2024-03-25T06:04:51.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-25T06:04:51.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.941+0000 7f633f200640 1 Processor -- start 2024-03-25T06:04:51.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.941+0000 7f633f200640 1 -- start start 2024-03-25T06:04:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.942+0000 7f633f200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6338154120 0x7f63380cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.942+0000 7f633f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63380c67e0 0x7f63380cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633f200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63380cbbe0 con 0x7f63380c6c10 2024-03-25T06:04:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633f200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6338154500 con 0x7f6338154120 2024-03-25T06:04:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633806b250 con 0x7f63380c67e0 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63380c67e0 0x7f63380cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633de00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6338154120 0x7f63380cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63380c67e0 0x7f63380cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:38488/0 (socket says 172.21.15.102:38488) 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633d400640 1 -- 172.21.15.102:0/3238607667 learned_addr learned my addr 172.21.15.102:0/3238607667 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633de00640 1 -- 172.21.15.102:0/3238607667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63380c67e0 msgr2=0x7f63380cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633de00640 1 --2- 172.21.15.102:0/3238607667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63380c67e0 0x7f63380cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633de00640 1 -- 172.21.15.102:0/3238607667 >> v1:172.21.15.187:6789/0 conn(0x7f63380c6c10 legacy=0x7f63380c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.943+0000 7f633de00640 1 -- 172.21.15.102:0/3238607667 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380ca280 con 0x7f6338154120 2024-03-25T06:04:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.944+0000 7f633de00640 1 --2- 172.21.15.102:0/3238607667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6338154120 0x7f63380cb000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f632c0097a0 tx=0x7f632c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e71949793debe729 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633ca00640 1 -- 172.21.15.102:0/3238607667 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c031830 con 0x7f6338154120 2024-03-25T06:04:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633ca00640 1 -- 172.21.15.102:0/3238607667 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f632c031990 con 0x7f6338154120 2024-03-25T06:04:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633ca00640 1 -- 172.21.15.102:0/3238607667 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c031d80 con 0x7f6338154120 2024-03-25T06:04:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 -- 172.21.15.102:0/3238607667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6338154120 msgr2=0x7f63380cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 --2- 172.21.15.102:0/3238607667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6338154120 0x7f63380cb000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f632c0097a0 tx=0x7f632c02b8d0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 -- 172.21.15.102:0/3238607667 shutdown_connections 2024-03-25T06:04:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 --2- 172.21.15.102:0/3238607667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63380c67e0 0x7f63380cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 --2- 172.21.15.102:0/3238607667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6338154120 0x7f63380cb000 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 -- 172.21.15.102:0/3238607667 >> 172.21.15.102:0/3238607667 conn(0x7f63380cf3e0 msgr2=0x7f63380cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 -- 172.21.15.102:0/3238607667 shutdown_connections 2024-03-25T06:04:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.945+0000 7f633f200640 1 -- 172.21.15.102:0/3238607667 wait complete. 2024-03-25T06:04:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.948+0000 7f633f200640 1 Processor -- start 2024-03-25T06:04:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.948+0000 7f633f200640 1 -- start start 2024-03-25T06:04:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.949+0000 7f633f200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63380c67e0 0x7f63380c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.949+0000 7f633f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63380c6c10 0x7f6338157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.949+0000 7f633f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6338154120 0x7f63381499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.949+0000 7f633f200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338155f70 con 0x7f63380c67e0 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.949+0000 7f633f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338154650 con 0x7f63380c6c10 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.949+0000 7f633f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6338159c00 con 0x7f6338154120 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63380c67e0 0x7f63380c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63380c67e0 0x7f63380c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59878/0 (socket says 172.21.15.102:59878) 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 -- 172.21.15.102:0/1378678717 learned_addr learned my addr 172.21.15.102:0/1378678717 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633d400640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63380c6c10 0x7f6338157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633e800640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6338154120 0x7f63381499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 -- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6338154120 msgr2=0x7f63381499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6338154120 0x7f63381499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 -- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63380c6c10 msgr2=0x7f6338157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63380c6c10 0x7f6338157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633de00640 1 -- 172.21.15.102:0/1378678717 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009400 con 0x7f63380c67e0 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.950+0000 7f633e800640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6338154120 0x7f63381499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.951+0000 7f633de00640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63380c67e0 0x7f63380c4d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f632c034040 tx=0x7f632c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.951+0000 7f6332000640 1 -- 172.21.15.102:0/1378678717 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0317b0 con 0x7f63380c67e0 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.951+0000 7f6332000640 1 -- 172.21.15.102:0/1378678717 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f632c03aa60 con 0x7f63380c67e0 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.951+0000 7f6332000640 1 -- 172.21.15.102:0/1378678717 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c03ae30 con 0x7f63380c67e0 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.951+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6338154860 con 0x7f63380c67e0 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.951+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6338154e20 con 0x7f63380c67e0 2024-03-25T06:04:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.953+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633804f2f0 con 0x7f63380c67e0 2024-03-25T06:04:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.954+0000 7f6332000640 1 -- 172.21.15.102:0/1378678717 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f632c04d440 con 0x7f63380c67e0 2024-03-25T06:04:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.955+0000 7f6332000640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f631c06b840 0x7f631c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.955+0000 7f6332000640 1 -- 172.21.15.102:0/1378678717 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f632c0ac740 con 0x7f63380c67e0 2024-03-25T06:04:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.956+0000 7f633d400640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f631c06b840 0x7f631c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.956+0000 7f633d400640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f631c06b840 0x7f631c06dd00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63381e4080 tx=0x7f6328009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:51.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:51.964+0000 7f6332000640 1 -- 172.21.15.102:0/1378678717 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f632c076ca0 con 0x7f63380c67e0 2024-03-25T06:04:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.192+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63380cade0 con 0x7f63380c67e0 2024-03-25T06:04:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.193+0000 7f6332000640 1 -- 172.21.15.102:0/1378678717 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6654 (secure 0 0 0) 0x7f632c07a360 con 0x7f63380c67e0 2024-03-25T06:04:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:52.187 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2058191389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2058191389},{"type":"v1","addr":"172.21.15.187:6836","nonce":2058191389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-25T05:37:30.879451+0000","modified":"2024-03-25T05:37:57.547664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4291,"mds_1":4273,"mds_2":4270,"mds_3":4250,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"a","rank":4,"incarnation":16,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6833/3221573983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3221573983},{"type":"v1","addr":"172.21.15.102:6833","nonce":3221573983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4250":{"gid":4250,"name":"c","rank":3,"incarnation":14,"state":"up:active","state_seq":9,"addr":"172.21.15.102:6837/1662064342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1662064342},{"type":"v1","addr":"172.21.15.102:6837","nonce":1662064342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4270":{"gid":4270,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":9,"addr":"172.21.15.187:6837/3691197003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3691197003},{"type":"v1","addr":"172.21.15.187:6837","nonce":3691197003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4273":{"gid":4273,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/3721745292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3721745292},{"type":"v1","addr":"172.21.15.187:6839","nonce":3721745292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4291":{"gid":4291,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/2568369315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2568369315},{"type":"v1","addr":"172.21.15.102:6835","nonce":2568369315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4291,"qdb_cluster":[4244,4270,4250,4273,4291]},"id":1}]} 2024-03-25T06:04:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-03-25T06:04:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f631c06b840 msgr2=0x7f631c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f631c06b840 0x7f631c06dd00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f63381e4080 tx=0x7f6328009240 comp rx=0 tx=0).stop 2024-03-25T06:04:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63380c67e0 msgr2=0x7f63380c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63380c67e0 0x7f63380c4d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f632c034040 tx=0x7f632c0046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 shutdown_connections 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f631c06b840 0x7f631c06dd00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6338154120 0x7f63381499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63380c6c10 0x7f6338157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 --2- 172.21.15.102:0/1378678717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63380c67e0 0x7f63380c4d50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 >> 172.21.15.102:0/1378678717 conn(0x7f63380cf3e0 msgr2=0x7f633815a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.195+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 shutdown_connections 2024-03-25T06:04:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.196+0000 7f633f200640 1 -- 172.21.15.102:0/1378678717 wait complete. 2024-03-25T06:04:52.212 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-25T06:04:52.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.396+0000 7f0e73000640 1 Processor -- start 2024-03-25T06:04:52.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.396+0000 7f0e73000640 1 -- start start 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e73000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0e6c154120 0x7f0e6c0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e73000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0c67e0 0x7f0e6c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e73000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6c0cbbe0 con 0x7f0e6c0c6c10 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e73000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6c154500 con 0x7f0e6c154120 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e73000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c06b250 con 0x7f0e6c0c67e0 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e72600640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0e6c0c6c10 0x7f0e6c0c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40450/0 (socket says 172.21.15.102:40450) 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e72600640 1 -- 172.21.15.102:0/2692449759 learned_addr learned my addr 172.21.15.102:0/2692449759 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e71c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0e6c154120 0x7f0e6c0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.397+0000 7f0e71200640 1 --2- 172.21.15.102:0/2692449759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0c67e0 0x7f0e6c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.398+0000 7f0e71c00640 1 -- 172.21.15.102:0/2692449759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0c67e0 msgr2=0x7f0e6c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.398+0000 7f0e71c00640 1 --2- 172.21.15.102:0/2692449759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0c67e0 0x7f0e6c0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.398+0000 7f0e71c00640 1 -- 172.21.15.102:0/2692449759 >> v1:172.21.15.102:6789/0 conn(0x7f0e6c0c6c10 legacy=0x7f0e6c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.398+0000 7f0e71c00640 1 -- 172.21.15.102:0/2692449759 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c0ca280 con 0x7f0e6c154120 2024-03-25T06:04:52.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.399+0000 7f0e71c00640 1 --2- 172.21.15.102:0/2692449759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c154120 0x7f0e6c0cb000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097a0 tx=0x7f0e6002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb35f67f5af2e86 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:52.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.399+0000 7f0e6be00640 1 -- 172.21.15.102:0/2692449759 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6002d040 con 0x7f0e6c154120 2024-03-25T06:04:52.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e6be00640 1 -- 172.21.15.102:0/2692449759 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e60031810 con 0x7f0e6c154120 2024-03-25T06:04:52.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e6be00640 1 -- 172.21.15.102:0/2692449759 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60031bc0 con 0x7f0e6c154120 2024-03-25T06:04:52.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e73000640 1 -- 172.21.15.102:0/2692449759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c154120 msgr2=0x7f0e6c0cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e73000640 1 --2- 172.21.15.102:0/2692449759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c154120 0x7f0e6c0cb000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097a0 tx=0x7f0e6002b8b0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e73000640 1 -- 172.21.15.102:0/2692449759 shutdown_connections 2024-03-25T06:04:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e73000640 1 --2- 172.21.15.102:0/2692449759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0c67e0 0x7f0e6c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e73000640 1 --2- 172.21.15.102:0/2692449759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c154120 0x7f0e6c0cb000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.400+0000 7f0e73000640 1 -- 172.21.15.102:0/2692449759 >> 172.21.15.102:0/2692449759 conn(0x7f0e6c0cf3e0 msgr2=0x7f0e6c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.401+0000 7f0e73000640 1 -- 172.21.15.102:0/2692449759 shutdown_connections 2024-03-25T06:04:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.401+0000 7f0e73000640 1 -- 172.21.15.102:0/2692449759 wait complete. 2024-03-25T06:04:52.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.403+0000 7f0e73000640 1 Processor -- start 2024-03-25T06:04:52.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.403+0000 7f0e73000640 1 -- start start 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.404+0000 7f0e73000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c0c67e0 0x7f0e6c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.404+0000 7f0e73000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0c6c10 0x7f0e6c14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.404+0000 7f0e73000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c154120 0x7f0e6c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.404+0000 7f0e73000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c1f3a70 con 0x7f0e6c0c67e0 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.404+0000 7f0e73000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c157510 con 0x7f0e6c0c6c10 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.404+0000 7f0e73000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c1f2e30 con 0x7f0e6c154120 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e71c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c0c67e0 0x7f0e6c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e71c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c0c67e0 0x7f0e6c1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59894/0 (socket says 172.21.15.102:59894) 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e71c00640 1 -- 172.21.15.102:0/808138043 learned_addr learned my addr 172.21.15.102:0/808138043 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e72600640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c154120 0x7f0e6c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e71200640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0c6c10 0x7f0e6c14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e72600640 1 -- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0c6c10 msgr2=0x7f0e6c14d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e72600640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0c6c10 0x7f0e6c14d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e72600640 1 -- 172.21.15.102:0/808138043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c0c67e0 msgr2=0x7f0e6c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e72600640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c0c67e0 0x7f0e6c1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.405+0000 7f0e72600640 1 -- 172.21.15.102:0/808138043 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009400 con 0x7f0e6c154120 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.406+0000 7f0e72600640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c154120 0x7f0e6c14dc10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400caa0 tx=0x7f0e6400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.406+0000 7f0e69600640 1 -- 172.21.15.102:0/808138043 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400aba0 con 0x7f0e6c154120 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.406+0000 7f0e69600640 1 -- 172.21.15.102:0/808138043 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e6400ad00 con 0x7f0e6c154120 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.406+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c1f30d0 con 0x7f0e6c154120 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.406+0000 7f0e69600640 1 -- 172.21.15.102:0/808138043 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64012640 con 0x7f0e6c154120 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.406+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c1f3690 con 0x7f0e6c154120 2024-03-25T06:04:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.408+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c1f3bb0 con 0x7f0e6c154120 2024-03-25T06:04:52.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.409+0000 7f0e69600640 1 -- 172.21.15.102:0/808138043 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e64007070 con 0x7f0e6c154120 2024-03-25T06:04:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.410+0000 7f0e69600640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0e4c06b810 0x7f0e4c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.411+0000 7f0e69600640 1 -- 172.21.15.102:0/808138043 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f0e6408a580 con 0x7f0e6c154120 2024-03-25T06:04:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.411+0000 7f0e71c00640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0e4c06b810 0x7f0e4c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.411+0000 7f0e71c00640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0e4c06b810 0x7f0e4c06dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097a0 tx=0x7f0e6003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.414+0000 7f0e69600640 1 -- 172.21.15.102:0/808138043 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0e6c1f3bb0 con 0x7f0e6c154120 2024-03-25T06:04:52.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.680+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e6c1f3bb0 con 0x7f0e6c154120 2024-03-25T06:04:52.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.682+0000 7f0e69600640 1 -- 172.21.15.102:0/808138043 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19031 (secure 0 0 0) 0x7f0e6c1f3bb0 con 0x7f0e6c154120 2024-03-25T06:04:52.676 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-25T06:04:52.676 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":27,"fsid":"ad358596-5ce1-459c-a1bc-1e91bde83a5b","created":"2024-03-25T05:37:14.796699+0000","modified":"2024-03-25T05:38:20.630095+0000","last_up_change":"2024-03-25T05:37:24.819804+0000","last_in_change":"2024-03-25T05:37:17.216204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-25T05:37:25.079908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-25T05:37:29.008596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-25T05:37:29.891587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-25T05:37:33.466049+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d812d4c-72b6-4d38-83b2-64a9ea9fde23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6801","nonce":1923769414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6803","nonce":1923769414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6807","nonce":1923769414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1923769414},{"type":"v1","addr":"172.21.15.102:6805","nonce":1923769414}]},"public_addr":"172.21.15.102:6801/1923769414","cluster_addr":"172.21.15.102:6803/1923769414","heartbeat_back_addr":"172.21.15.102:6807/1923769414","heartbeat_front_addr":"172.21.15.102:6805/1923769414","state":["exists","up"]},{"osd":1,"uuid":"7aa4e6f1-e102-45e2-929c-243fa8bd31c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6821","nonce":3411688389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6827","nonce":3411688389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6831","nonce":3411688389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":3411688389},{"type":"v1","addr":"172.21.15.102:6829","nonce":3411688389}]},"public_addr":"172.21.15.102:6821/3411688389","cluster_addr":"172.21.15.102:6827/3411688389","heartbeat_back_addr":"172.21.15.102:6831/3411688389","heartbeat_front_addr":"172.21.15.102:6829/3411688389","state":["exists","up"]},{"osd":2,"uuid":"fd1b2f24-36d9-41b4-b194-154cd280b76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6817","nonce":3156921662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6820","nonce":3156921662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6825","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6826","nonce":3156921662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3156921662},{"type":"v1","addr":"172.21.15.102:6823","nonce":3156921662}]},"public_addr":"172.21.15.102:6817/3156921662","cluster_addr":"172.21.15.102:6820/3156921662","heartbeat_back_addr":"172.21.15.102:6826/3156921662","heartbeat_front_addr":"172.21.15.102:6823/3156921662","state":["exists","up"]},{"osd":3,"uuid":"33b1cd6a-7fe6-4fd6-b015-ca6cd5491236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6809","nonce":3429470735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6811","nonce":3429470735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6815","nonce":3429470735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3429470735},{"type":"v1","addr":"172.21.15.102:6813","nonce":3429470735}]},"public_addr":"172.21.15.102:6809/3429470735","cluster_addr":"172.21.15.102:6811/3429470735","heartbeat_back_addr":"172.21.15.102:6815/3429470735","heartbeat_front_addr":"172.21.15.102:6813/3429470735","state":["exists","up"]},{"osd":4,"uuid":"d0980d5a-8623-4729-86c5-c0a944b35fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6817","nonce":2431545666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6819","nonce":2431545666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6827","nonce":2431545666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":2431545666},{"type":"v1","addr":"172.21.15.187:6823","nonce":2431545666}]},"public_addr":"172.21.15.187:6817/2431545666","cluster_addr":"172.21.15.187:6819/2431545666","heartbeat_back_addr":"172.21.15.187:6827/2431545666","heartbeat_front_addr":"172.21.15.187:6823/2431545666","state":["exists","up"]},{"osd":5,"uuid":"8c46e5a1-a5ed-4d53-803b-19f482b077b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6822","nonce":2672437380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6826","nonce":2672437380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6831","nonce":2672437380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2672437380},{"type":"v1","addr":"172.21.15.187:6829","nonce":2672437380}]},"public_addr":"172.21.15.187:6822/2672437380","cluster_addr":"172.21.15.187:6826/2672437380","heartbeat_back_addr":"172.21.15.187:6831/2672437380","heartbeat_front_addr":"172.21.15.187:6829/2672437380","state":["exists","up"]},{"osd":6,"uuid":"7eb2ad13-c3f7-4b79-9194-1538b2fcd6dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6809","nonce":1811146406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6811","nonce":1811146406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6815","nonce":1811146406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1811146406},{"type":"v1","addr":"172.21.15.187:6813","nonce":1811146406}]},"public_addr":"172.21.15.187:6809/1811146406","cluster_addr":"172.21.15.187:6811/1811146406","heartbeat_back_addr":"172.21.15.187:6815/1811146406","heartbeat_front_addr":"172.21.15.187:6813/1811146406","state":["exists","up"]},{"osd":7,"uuid":"ef9d78ca-8ce9-417b-a6a5-0d58281d48cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6801","nonce":69914825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6803","nonce":69914825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6807","nonce":69914825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":69914825},{"type":"v1","addr":"172.21.15.187:6805","nonce":69914825}]},"public_addr":"172.21.15.187:6801/69914825","cluster_addr":"172.21.15.187:6803/69914825","heartbeat_back_addr":"172.21.15.187:6807/69914825","heartbeat_front_addr":"172.21.15.187:6805/69914825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.798192+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.576799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.601942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.330609+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.410338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.369824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.370317+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-25T05:37:22.371172+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0e4c06b810 msgr2=0x7f0e4c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0e4c06b810 0x7f0e4c06dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097a0 tx=0x7f0e6003c040 comp rx=0 tx=0).stop 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c154120 msgr2=0x7f0e6c14dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c154120 0x7f0e6c14dc10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400caa0 tx=0x7f0e6400cf60 comp rx=0 tx=0).stop 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 shutdown_connections 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f0e4c06b810 0x7f0e4c06dcd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c154120 0x7f0e6c14dc10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0c6c10 0x7f0e6c14d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 --2- 172.21.15.102:0/808138043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e6c0c67e0 0x7f0e6c1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 >> 172.21.15.102:0/808138043 conn(0x7f0e6c0cf3e0 msgr2=0x7f0e6c1e60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:52.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 shutdown_connections 2024-03-25T06:04:52.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.684+0000 7f0e73000640 1 -- 172.21.15.102:0/808138043 wait complete. 2024-03-25T06:04:52.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-25T06:04:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.871+0000 7fdfebe00640 1 Processor -- start 2024-03-25T06:04:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.871+0000 7fdfebe00640 1 -- start start 2024-03-25T06:04:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.872+0000 7fdfebe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdfec154120 0x7fdfec0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.872+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.872+0000 7fdfebe00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec0cbbe0 con 0x7fdfec0c6c10 2024-03-25T06:04:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.872+0000 7fdfebe00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec154500 con 0x7fdfec154120 2024-03-25T06:04:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.872+0000 7fdfebe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec06b250 con 0x7fdfec0c67e0 2024-03-25T06:04:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfea000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfea000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec0cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:43200/0 (socket says 172.21.15.102:43200) 2024-03-25T06:04:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfea000640 1 -- 172.21.15.102:0/505918054 learned_addr learned my addr 172.21.15.102:0/505918054 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfeaa00640 1 --2- 172.21.15.102:0/505918054 >> v2:172.21.15.102:3300/0 conn(0x7fdfec154120 0x7fdfec0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfea000640 1 -- 172.21.15.102:0/505918054 >> v2:172.21.15.102:3300/0 conn(0x7fdfec154120 msgr2=0x7fdfec0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfea000640 1 --2- 172.21.15.102:0/505918054 >> v2:172.21.15.102:3300/0 conn(0x7fdfec154120 0x7fdfec0cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfea000640 1 -- 172.21.15.102:0/505918054 >> v1:172.21.15.102:6789/0 conn(0x7fdfec0c6c10 legacy=0x7fdfec0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.873+0000 7fdfea000640 1 -- 172.21.15.102:0/505918054 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec0ca280 con 0x7fdfec0c67e0 2024-03-25T06:04:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.874+0000 7fdfea000640 1 --2- 172.21.15.102:0/505918054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec0cb540 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009870 tx=0x7fdfd802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d938c93ed98bb8c server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.874+0000 7fdfe9600640 1 -- 172.21.15.102:0/505918054 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8031640 con 0x7fdfec0c67e0 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfe9600640 1 -- 172.21.15.102:0/505918054 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdfd80317a0 con 0x7fdfec0c67e0 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfe9600640 1 -- 172.21.15.102:0/505918054 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8031b50 con 0x7fdfec0c67e0 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 -- 172.21.15.102:0/505918054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 msgr2=0x7fdfec0cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 --2- 172.21.15.102:0/505918054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec0cb540 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009870 tx=0x7fdfd802b8f0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 -- 172.21.15.102:0/505918054 shutdown_connections 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 --2- 172.21.15.102:0/505918054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec0cb540 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 --2- 172.21.15.102:0/505918054 >> v2:172.21.15.102:3300/0 conn(0x7fdfec154120 0x7fdfec0cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 -- 172.21.15.102:0/505918054 >> 172.21.15.102:0/505918054 conn(0x7fdfec0cf3e0 msgr2=0x7fdfec0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 -- 172.21.15.102:0/505918054 shutdown_connections 2024-03-25T06:04:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.875+0000 7fdfebe00640 1 -- 172.21.15.102:0/505918054 wait complete. 2024-03-25T06:04:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.877+0000 7fdfebe00640 1 Processor -- start 2024-03-25T06:04:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.877+0000 7fdfebe00640 1 -- start start 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfec0c6c10 0x7fdfec144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfebe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfec154120 0x7fdfec144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfebe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0c47f0 con 0x7fdfec0c6c10 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfebe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0c5940 con 0x7fdfec154120 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfebe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0c6090 con 0x7fdfec0c67e0 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfeb400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfec154120 0x7fdfec144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfeaa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfea000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfec0c6c10 0x7fdfec144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfeaa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:43202/0 (socket says 172.21.15.102:43202) 2024-03-25T06:04:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfeb400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfec154120 0x7fdfec144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:52276/0 (socket says 172.21.15.102:52276) 2024-03-25T06:04:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.878+0000 7fdfeaa00640 1 -- 172.21.15.102:0/803341492 learned_addr learned my addr 172.21.15.102:0/803341492 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfeb400640 1 -- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 msgr2=0x7fdfec147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfeb400640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfeb400640 1 -- 172.21.15.102:0/803341492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfec0c6c10 msgr2=0x7fdfec144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfeb400640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfec0c6c10 0x7fdfec144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfeb400640 1 -- 172.21.15.102:0/803341492 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80094d0 con 0x7fdfec154120 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfeb400640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfec154120 0x7fdfec144b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c780 tx=0x7fdfe400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfe2a00640 1 -- 172.21.15.102:0/803341492 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400aa50 con 0x7fdfec154120 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfe2a00640 1 -- 172.21.15.102:0/803341492 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdfe400abb0 con 0x7fdfec154120 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfe2a00640 1 -- 172.21.15.102:0/803341492 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400ce30 con 0x7fdfec154120 2024-03-25T06:04:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec0c5c00 con 0x7fdfec154120 2024-03-25T06:04:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.879+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec159f10 con 0x7fdfec154120 2024-03-25T06:04:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.881+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec0c5d90 con 0x7fdfec154120 2024-03-25T06:04:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.882+0000 7fdfe2a00640 1 -- 172.21.15.102:0/803341492 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdfe4012420 con 0x7fdfec154120 2024-03-25T06:04:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.882+0000 7fdfe2a00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdfcc06b840 0x7fdfcc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.883+0000 7fdfe2a00640 1 -- 172.21.15.102:0/803341492 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fdfe408aa30 con 0x7fdfec154120 2024-03-25T06:04:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.883+0000 7fdfeaa00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdfcc06b840 0x7fdfcc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:52.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.883+0000 7fdfeaa00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdfcc06b840 0x7fdfcc06dd00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc007a60 tx=0x7fdfdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:52.887+0000 7fdfe2a00640 1 -- 172.21.15.102:0/803341492 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdfe4055020 con 0x7fdfec154120 2024-03-25T06:04:53.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.114+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdfec04f2f0 con 0x7fdfec154120 2024-03-25T06:04:53.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.126+0000 7fdfe2a00640 1 -- 172.21.15.102:0/803341492 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdfe40586e0 con 0x7fdfec154120 2024-03-25T06:04:53.128 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-25T06:04:53.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdfcc06b840 msgr2=0x7fdfcc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:53.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdfcc06b840 0x7fdfcc06dd00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc007a60 tx=0x7fdfdc008040 comp rx=0 tx=0).stop 2024-03-25T06:04:53.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfec154120 msgr2=0x7fdfec144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:53.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfec154120 0x7fdfec144b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c780 tx=0x7fdfe400cc40 comp rx=0 tx=0).stop 2024-03-25T06:04:53.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 shutdown_connections 2024-03-25T06:04:53.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fdfcc06b840 0x7fdfcc06dd00 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc007a60 tx=0x7fdfdc008040 comp rx=0 tx=0).stop 2024-03-25T06:04:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfec154120 0x7fdfec144b80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfec0c6c10 0x7fdfec144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 --2- 172.21.15.102:0/803341492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdfec0c67e0 0x7fdfec147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.137+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 >> 172.21.15.102:0/803341492 conn(0x7fdfec0cf3e0 msgr2=0x7fdfec0c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.138+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 shutdown_connections 2024-03-25T06:04:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.138+0000 7fdfebe00640 1 -- 172.21.15.102:0/803341492 wait complete. 2024-03-25T06:04:53.152 INFO:tasks.ceph.mds.f.smithi187.stdout:starting mds.f at 2024-03-25T06:04:53.161 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-03-25T06:04:53.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-25T06:04:53.249 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2024-03-25T06:04:53.261 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2024-03-25T06:04:53.267 INFO:tasks.ceph.mds.e.smithi102.stdout:starting mds.e at 2024-03-25T06:04:53.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.348+0000 7f4332200640 1 Processor -- start 2024-03-25T06:04:53.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.348+0000 7f4332200640 1 -- start start 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.349+0000 7f4332200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f432c0cb7f0 0x7f432c0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.349+0000 7f4332200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c0c8220 con 0x7f432c154260 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4332200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c0c8500 con 0x7f432c153e80 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4332200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0ca320 con 0x7f432c0cb7f0 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4331800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f432c0cb7f0 0x7f432c0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4330e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f432c153e80 0x7f432c0c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.102:60088/0 (socket says 172.21.15.102:60088) 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4330e00640 1 -- 172.21.15.102:0/1982217879 learned_addr learned my addr 172.21.15.102:0/1982217879 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4331800640 1 -- 172.21.15.102:0/1982217879 >> v1:172.21.15.187:6789/0 conn(0x7f432c153e80 legacy=0x7f432c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4331800640 1 -- 172.21.15.102:0/1982217879 >> v1:172.21.15.102:6789/0 conn(0x7f432c154260 legacy=0x7f432c0cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f432b400640 1 -- 172.21.15.102:0/1982217879 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835613887 0 0) 0x7f432c0c8220 con 0x7f432c154260 2024-03-25T06:04:53.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.350+0000 7f4331800640 1 -- 172.21.15.102:0/1982217879 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0ca600 con 0x7f432c0cb7f0 2024-03-25T06:04:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.351+0000 7f4331800640 1 --2- 172.21.15.102:0/1982217879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c0cb7f0 0x7f432c0c7460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4324009d90 tx=0x7f432402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcd6fb3098d3db0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f432b400640 1 -- 172.21.15.102:0/1982217879 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432402cd80 con 0x7f432c0cb7f0 2024-03-25T06:04:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f432b400640 1 -- 172.21.15.102:0/1982217879 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4324034440 con 0x7f432c0cb7f0 2024-03-25T06:04:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f432b400640 1 -- 172.21.15.102:0/1982217879 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240347f0 con 0x7f432c0cb7f0 2024-03-25T06:04:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f4332200640 1 -- 172.21.15.102:0/1982217879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c0cb7f0 msgr2=0x7f432c0c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f4332200640 1 --2- 172.21.15.102:0/1982217879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c0cb7f0 0x7f432c0c7460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4324009d90 tx=0x7f432402bfd0 comp rx=0 tx=0).stop 2024-03-25T06:04:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f4332200640 1 -- 172.21.15.102:0/1982217879 shutdown_connections 2024-03-25T06:04:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f4332200640 1 --2- 172.21.15.102:0/1982217879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c0cb7f0 0x7f432c0c7460 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f4332200640 1 -- 172.21.15.102:0/1982217879 >> 172.21.15.102:0/1982217879 conn(0x7f432c0cf370 msgr2=0x7f432c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.352+0000 7f4332200640 1 -- 172.21.15.102:0/1982217879 shutdown_connections 2024-03-25T06:04:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.353+0000 7f4332200640 1 -- 172.21.15.102:0/1982217879 wait complete. 2024-03-25T06:04:53.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.355+0000 7f4332200640 1 Processor -- start 2024-03-25T06:04:53.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.355+0000 7f4332200640 1 -- start start 2024-03-25T06:04:53.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.356+0000 7f4332200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c0cb7f0 0x7f432c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:53.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.356+0000 7f4332200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c153e80 0x7f432c146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.356+0000 7f4332200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f432c151fc0 0x7f432c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.356+0000 7f4332200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c156b60 con 0x7f432c153e80 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.356+0000 7f4332200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c156ea0 con 0x7f432c0cb7f0 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.356+0000 7f4332200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c157720 con 0x7f432c151fc0 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f432be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c153e80 0x7f432c146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4330e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c0cb7f0 0x7f432c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f432c151fc0 0x7f432c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4330e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c0cb7f0 0x7f432c154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:52314/0 (socket says 172.21.15.102:52314) 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f432c151fc0 0x7f432c0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:43236/0 (socket says 172.21.15.102:43236) 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4330e00640 1 -- 172.21.15.102:0/1168394064 learned_addr learned my addr 172.21.15.102:0/1168394064 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 -- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c0cb7f0 msgr2=0x7f432c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c0cb7f0 0x7f432c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 -- 172.21.15.102:0/1168394064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c153e80 msgr2=0x7f432c146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c153e80 0x7f432c146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 -- 172.21.15.102:0/1168394064 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324009a70 con 0x7f432c151fc0 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f432be00640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c153e80 0x7f432c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.357+0000 7f4331800640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f432c151fc0 0x7f432c0ce860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4324033000 tx=0x7f4324004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.358+0000 7f4328c00640 1 -- 172.21.15.102:0/1168394064 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324003b90 con 0x7f432c151fc0 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.358+0000 7f4328c00640 1 -- 172.21.15.102:0/1168394064 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4324034e90 con 0x7f432c151fc0 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.358+0000 7f4328c00640 1 -- 172.21.15.102:0/1168394064 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324040660 con 0x7f432c151fc0 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.358+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c148180 con 0x7f432c151fc0 2024-03-25T06:04:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.358+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c1f0b50 con 0x7f432c151fc0 2024-03-25T06:04:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.359+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c154fa0 con 0x7f432c151fc0 2024-03-25T06:04:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.360+0000 7f4328c00640 1 -- 172.21.15.102:0/1168394064 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43240407c0 con 0x7f432c151fc0 2024-03-25T06:04:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.361+0000 7f4328c00640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f430c06b840 0x7f430c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.361+0000 7f4328c00640 1 -- 172.21.15.102:0/1168394064 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7223+0+0 (secure 0 0 0) 0x7f43240ad0e0 con 0x7f432c151fc0 2024-03-25T06:04:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.361+0000 7f4330e00640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f430c06b840 0x7f430c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.362+0000 7f4330e00640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f430c06b840 0x7f430c06dd00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4320005880 tx=0x7f4320009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:53.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.365+0000 7f4328c00640 1 -- 172.21.15.102:0/1168394064 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4324077490 con 0x7f432c151fc0 2024-03-25T06:04:53.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:53.589+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f432c148180 con 0x7f432c151fc0 2024-03-25T06:04:54.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.131+0000 7f4328c00640 1 -- 172.21.15.102:0/1168394064 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f432c148180 con 0x7f432c151fc0 2024-03-25T06:04:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.134+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f430c06b840 msgr2=0x7f430c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.134+0000 7f4332200640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f430c06b840 0x7f430c06dd00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4320005880 tx=0x7f4320009040 comp rx=0 tx=0).stop 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.134+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f432c151fc0 msgr2=0x7f432c0ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.134+0000 7f4332200640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f432c151fc0 0x7f432c0ce860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4324033000 tx=0x7f4324004a40 comp rx=0 tx=0).stop 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 shutdown_connections 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f430c06b840 0x7f430c06dd00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f432c151fc0 0x7f432c0ce860 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f432c153e80 0x7f432c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 --2- 172.21.15.102:0/1168394064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c0cb7f0 0x7f432c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 >> 172.21.15.102:0/1168394064 conn(0x7f432c0cf370 msgr2=0x7f432c14e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 shutdown_connections 2024-03-25T06:04:54.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.135+0000 7f4332200640 1 -- 172.21.15.102:0/1168394064 wait complete. 2024-03-25T06:04:54.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-25T06:04:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.339+0000 7f53dbe00640 1 Processor -- start 2024-03-25T06:04:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.339+0000 7f53dbe00640 1 -- start start 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53dbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53dbe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53dc0c7240 0x7f53dc0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53dbe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f53dc0c20a0 0x7f53dc0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53dbe00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc06cad0 con 0x7f53dc0c7240 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53dbe00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc0c6db0 con 0x7f53dc0c20a0 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53dbe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc157180 con 0x7f53dc150460 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53daa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53da000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53dc0c7240 0x7f53dc0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53db400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f53dc0c20a0 0x7f53dc0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53daa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc06bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.102:43252/0 (socket says 172.21.15.102:43252) 2024-03-25T06:04:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.341+0000 7f53daa00640 1 -- 172.21.15.102:0/55034085 learned_addr learned my addr 172.21.15.102:0/55034085 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.342+0000 7f53daa00640 1 -- 172.21.15.102:0/55034085 >> v2:172.21.15.187:3300/0 conn(0x7f53dc0c20a0 msgr2=0x7f53dc0c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.342+0000 7f53daa00640 1 --2- 172.21.15.102:0/55034085 >> v2:172.21.15.187:3300/0 conn(0x7f53dc0c20a0 0x7f53dc0c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.342+0000 7f53daa00640 1 -- 172.21.15.102:0/55034085 >> v2:172.21.15.102:3300/0 conn(0x7f53dc0c7240 msgr2=0x7f53dc0c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.342+0000 7f53daa00640 1 --2- 172.21.15.102:0/55034085 >> v2:172.21.15.102:3300/0 conn(0x7f53dc0c7240 0x7f53dc0c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.342+0000 7f53daa00640 1 -- 172.21.15.102:0/55034085 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc06c300 con 0x7f53dc150460 2024-03-25T06:04:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.343+0000 7f53daa00640 1 --2- 172.21.15.102:0/55034085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc06bdc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f53dc153e30 tx=0x7f53cc02b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca22b3a830343af server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.343+0000 7f53d9600640 1 -- 172.21.15.102:0/55034085 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc031860 con 0x7f53dc150460 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.343+0000 7f53d9600640 1 -- 172.21.15.102:0/55034085 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f53cc0319c0 con 0x7f53dc150460 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.343+0000 7f53d9600640 1 -- 172.21.15.102:0/55034085 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc031d70 con 0x7f53dc150460 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 -- 172.21.15.102:0/55034085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 msgr2=0x7f53dc06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 --2- 172.21.15.102:0/55034085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc06bdc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f53dc153e30 tx=0x7f53cc02b900 comp rx=0 tx=0).stop 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 -- 172.21.15.102:0/55034085 shutdown_connections 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 --2- 172.21.15.102:0/55034085 >> v2:172.21.15.187:3300/0 conn(0x7f53dc0c20a0 0x7f53dc0c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 --2- 172.21.15.102:0/55034085 >> v2:172.21.15.102:3300/0 conn(0x7f53dc0c7240 0x7f53dc0c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 --2- 172.21.15.102:0/55034085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc06bdc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 -- 172.21.15.102:0/55034085 >> 172.21.15.102:0/55034085 conn(0x7f53dc0c8690 msgr2=0x7f53dc0c8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 -- 172.21.15.102:0/55034085 shutdown_connections 2024-03-25T06:04:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.344+0000 7f53dbe00640 1 -- 172.21.15.102:0/55034085 wait complete. 2024-03-25T06:04:54.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.346+0000 7f53dbe00640 1 Processor -- start 2024-03-25T06:04:54.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.346+0000 7f53dbe00640 1 -- start start 2024-03-25T06:04:54.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53dbe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53dc0c20a0 0x7f53dc1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:54.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53dbe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53dc0c7240 0x7f53dc1e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:54.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53dbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc1efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:54.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53dbe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc1ef570 con 0x7f53dc0c20a0 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53dbe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc155360 con 0x7f53dc0c7240 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53dbe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc155640 con 0x7f53dc150460 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53daa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53dc0c20a0 0x7f53dc1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53da000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53dc0c7240 0x7f53dc1e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53daa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53dc0c20a0 0x7f53dc1549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44866/0 (socket says 172.21.15.102:44866) 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53daa00640 1 -- 172.21.15.102:0/4231004885 learned_addr learned my addr 172.21.15.102:0/4231004885 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.348+0000 7f53db400640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc1efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53daa00640 1 -- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 msgr2=0x7f53dc1efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53daa00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc1efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53daa00640 1 -- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53dc0c7240 msgr2=0x7f53dc1e4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53daa00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53dc0c7240 0x7f53dc1e4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53daa00640 1 -- 172.21.15.102:0/4231004885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0094d0 con 0x7f53dc0c20a0 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53da000640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53dc0c7240 0x7f53dc1e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:54.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53daa00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53dc0c20a0 0x7f53dc1549e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53cc02b940 tx=0x7f53cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53d2a00640 1 -- 172.21.15.102:0/4231004885 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc03ac60 con 0x7f53dc0c20a0 2024-03-25T06:04:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53d2a00640 1 -- 172.21.15.102:0/4231004885 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f53cc03ade0 con 0x7f53dc0c20a0 2024-03-25T06:04:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53d2a00640 1 -- 172.21.15.102:0/4231004885 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc044650 con 0x7f53dc0c20a0 2024-03-25T06:04:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc155920 con 0x7f53dc0c20a0 2024-03-25T06:04:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.349+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc155ee0 con 0x7f53dc0c20a0 2024-03-25T06:04:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.350+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc04f2f0 con 0x7f53dc0c20a0 2024-03-25T06:04:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.351+0000 7f53d2a00640 1 -- 172.21.15.102:0/4231004885 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f53cc04d450 con 0x7f53dc0c20a0 2024-03-25T06:04:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.353+0000 7f53d2a00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f53bc06b840 0x7f53bc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.353+0000 7f53d2a00640 1 -- 172.21.15.102:0/4231004885 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 7223+0+0 (secure 0 0 0) 0x7f53cc0acc90 con 0x7f53dc0c20a0 2024-03-25T06:04:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.353+0000 7f53da000640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f53bc06b840 0x7f53bc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.353+0000 7f53da000640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f53bc06b840 0x7f53bc06dd00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0c8ec0 tx=0x7f53c8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:54.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.357+0000 7f53d2a00640 1 -- 172.21.15.102:0/4231004885 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f53cc0771a0 con 0x7f53dc0c20a0 2024-03-25T06:04:54.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:54.541+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53dc0c7f90 con 0x7f53dc0c20a0 2024-03-25T06:04:55.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.132+0000 7f53d2a00640 1 -- 172.21.15.102:0/4231004885 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f53cc035070 con 0x7f53dc0c20a0 2024-03-25T06:04:55.127 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2024-03-25T06:04:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.137+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f53bc06b840 msgr2=0x7f53bc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.137+0000 7f53dbe00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f53bc06b840 0x7f53bc06dd00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0c8ec0 tx=0x7f53c8009190 comp rx=0 tx=0).stop 2024-03-25T06:04:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.137+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53dc0c20a0 msgr2=0x7f53dc1549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.137+0000 7f53dbe00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53dc0c20a0 0x7f53dc1549e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53cc02b940 tx=0x7f53cc0046c0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.141+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 shutdown_connections 2024-03-25T06:04:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.141+0000 7f53dbe00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f53bc06b840 0x7f53bc06dd00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.141+0000 7f53dbe00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53dc150460 0x7f53dc1efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.141+0000 7f53dbe00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53dc0c7240 0x7f53dc1e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.141+0000 7f53dbe00640 1 --2- 172.21.15.102:0/4231004885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53dc0c20a0 0x7f53dc1549e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.141+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 >> 172.21.15.102:0/4231004885 conn(0x7f53dc0c8690 msgr2=0x7f53dc06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.141+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 shutdown_connections 2024-03-25T06:04:55.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.142+0000 7f53dbe00640 1 -- 172.21.15.102:0/4231004885 wait complete. 2024-03-25T06:04:55.173 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-25T06:04:55.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.402+0000 7f1a98e00640 1 Processor -- start 2024-03-25T06:04:55.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.402+0000 7f1a98e00640 1 -- start start 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.403+0000 7f1a98e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a9415d3c0 0x7f1a940c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.403+0000 7f1a98e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1a940c7f10 0x7f1a9415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.403+0000 7f1a98e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940ca200 con 0x7f1a940b5140 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.403+0000 7f1a98e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940cb090 con 0x7f1a9415d3c0 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.403+0000 7f1a98e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940cb4e0 con 0x7f1a940c7f10 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a93400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a9415d3c0 0x7f1a940c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a93400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a9415d3c0 0x7f1a940c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44872/0 (socket says 172.21.15.102:44872) 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a93400640 1 -- 172.21.15.102:0/51210278 learned_addr learned my addr 172.21.15.102:0/51210278 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a92a00640 1 --2- 172.21.15.102:0/51210278 >> v2:172.21.15.187:3300/0 conn(0x7f1a940c7f10 0x7f1a9415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:55.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a93400640 1 -- 172.21.15.102:0/51210278 >> v2:172.21.15.187:3300/0 conn(0x7f1a940c7f10 msgr2=0x7f1a9415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:55.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a93400640 1 --2- 172.21.15.102:0/51210278 >> v2:172.21.15.187:3300/0 conn(0x7f1a940c7f10 0x7f1a9415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a93400640 1 -- 172.21.15.102:0/51210278 >> v1:172.21.15.187:6789/0 conn(0x7f1a940b5140 legacy=0x7f1a94153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-25T06:04:55.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.404+0000 7f1a93400640 1 -- 172.21.15.102:0/51210278 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940cb820 con 0x7f1a9415d3c0 2024-03-25T06:04:55.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.405+0000 7f1a93400640 1 --2- 172.21.15.102:0/51210278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a940c79d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a940c82f0 tx=0x7f1a8402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c20e3c6f63740b server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:55.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.405+0000 7f1a92000640 1 -- 172.21.15.102:0/51210278 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84030860 con 0x7f1a9415d3c0 2024-03-25T06:04:55.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.405+0000 7f1a92000640 1 -- 172.21.15.102:0/51210278 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1a840309c0 con 0x7f1a9415d3c0 2024-03-25T06:04:55.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.405+0000 7f1a92000640 1 -- 172.21.15.102:0/51210278 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84030d70 con 0x7f1a9415d3c0 2024-03-25T06:04:55.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 -- 172.21.15.102:0/51210278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 msgr2=0x7f1a940c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:55.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 --2- 172.21.15.102:0/51210278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a940c79d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a940c82f0 tx=0x7f1a8402b9a0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 -- 172.21.15.102:0/51210278 shutdown_connections 2024-03-25T06:04:55.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 --2- 172.21.15.102:0/51210278 >> v2:172.21.15.187:3300/0 conn(0x7f1a940c7f10 0x7f1a9415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 --2- 172.21.15.102:0/51210278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a940c79d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 -- 172.21.15.102:0/51210278 >> 172.21.15.102:0/51210278 conn(0x7f1a940cf3e0 msgr2=0x7f1a940cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:55.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 -- 172.21.15.102:0/51210278 shutdown_connections 2024-03-25T06:04:55.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.406+0000 7f1a98e00640 1 -- 172.21.15.102:0/51210278 wait complete. 2024-03-25T06:04:55.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.408+0000 7f1a98e00640 1 Processor -- start 2024-03-25T06:04:55.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.408+0000 7f1a98e00640 1 -- start start 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a98e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a940b5140 0x7f1a941f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a98e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a940c7f10 0x7f1a940cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a98e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a941557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a98e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94154960 con 0x7f1a9415d3c0 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a98e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941f0160 con 0x7f1a940b5140 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a98e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94153300 con 0x7f1a940c7f10 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a941557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a92a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a940c7f10 0x7f1a940cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a940b5140 0x7f1a941f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a941557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44874/0 (socket says 172.21.15.102:44874) 2024-03-25T06:04:55.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a940b5140 0x7f1a941f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.102:52346/0 (socket says 172.21.15.102:52346) 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 -- 172.21.15.102:0/159462031 learned_addr learned my addr 172.21.15.102:0/159462031 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 -- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a940c7f10 msgr2=0x7f1a940cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a940c7f10 0x7f1a940cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 -- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a940b5140 msgr2=0x7f1a941f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a940b5140 0x7f1a941f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a93e00640 1 -- 172.21.15.102:0/159462031 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840094d0 con 0x7f1a9415d3c0 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.409+0000 7f1a92a00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a940c7f10 0x7f1a940cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.410+0000 7f1a93e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a941557e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c730 tx=0x7f1a8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.410+0000 7f1a8b400640 1 -- 172.21.15.102:0/159462031 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c003b70 con 0x7f1a9415d3c0 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.410+0000 7f1a8b400640 1 -- 172.21.15.102:0/159462031 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1a8c003cd0 con 0x7f1a9415d3c0 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.410+0000 7f1a8b400640 1 -- 172.21.15.102:0/159462031 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00aab0 con 0x7f1a9415d3c0 2024-03-25T06:04:55.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.410+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a941f3b00 con 0x7f1a9415d3c0 2024-03-25T06:04:55.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.410+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a94153020 con 0x7f1a9415d3c0 2024-03-25T06:04:55.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.411+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a941f0310 con 0x7f1a9415d3c0 2024-03-25T06:04:55.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.412+0000 7f1a8b400640 1 -- 172.21.15.102:0/159462031 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a8c00ac10 con 0x7f1a9415d3c0 2024-03-25T06:04:55.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.413+0000 7f1a8b400640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1a7406b810 0x7f1a7406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:55.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.413+0000 7f1a8b400640 1 -- 172.21.15.102:0/159462031 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f1a8c08a430 con 0x7f1a9415d3c0 2024-03-25T06:04:55.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.413+0000 7f1a93400640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1a7406b810 0x7f1a7406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:55.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.414+0000 7f1a93400640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1a7406b810 0x7f1a7406dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a84036000 tx=0x7f1a84008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:55.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.418+0000 7f1a8b400640 1 -- 172.21.15.102:0/159462031 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1a941f0310 con 0x7f1a9415d3c0 2024-03-25T06:04:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:55.606+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a941f02d0 con 0x7f1a9415d3c0 2024-03-25T06:04:56.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.141+0000 7f1a8b400640 1 -- 172.21.15.102:0/159462031 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1a8c054990 con 0x7f1a9415d3c0 2024-03-25T06:04:56.135 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2024-03-25T06:04:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1a7406b810 msgr2=0x7f1a7406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1a7406b810 0x7f1a7406dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a84036000 tx=0x7f1a84008030 comp rx=0 tx=0).stop 2024-03-25T06:04:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 msgr2=0x7f1a941557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a941557e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c730 tx=0x7f1a8c00cbf0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 shutdown_connections 2024-03-25T06:04:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7f1a7406b810 0x7f1a7406dcd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a9415d3c0 0x7f1a941557e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a940c7f10 0x7f1a940cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 --2- 172.21.15.102:0/159462031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a940b5140 0x7f1a941f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 >> 172.21.15.102:0/159462031 conn(0x7f1a940cf3e0 msgr2=0x7f1a941e5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.144+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 shutdown_connections 2024-03-25T06:04:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.145+0000 7f1a98e00640 1 -- 172.21.15.102:0/159462031 wait complete. 2024-03-25T06:04:56.166 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-25T06:04:56.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.390+0000 7fcb39400640 1 Processor -- start 2024-03-25T06:04:56.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.390+0000 7fcb39400640 1 -- start start 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb39400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb3415d3c0 0x7fcb340c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb39400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb340ca200 con 0x7fcb340c7f10 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb39400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb340cb4e0 con 0x7fcb340b5140 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb39400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb340cb090 con 0x7fcb3415d3c0 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb33e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb3415d3c0 0x7fcb340c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb33e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb3415d3c0 0x7fcb340c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44884/0 (socket says 172.21.15.102:44884) 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb33e00640 1 -- 172.21.15.102:0/1563218463 learned_addr learned my addr 172.21.15.102:0/1563218463 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.391+0000 7fcb33400640 1 --1- 172.21.15.102:0/1563218463 >> v1:172.21.15.102:6789/0 conn(0x7fcb340c7f10 0x7fcb3415d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49104/0 (socket says 172.21.15.102:49104) 2024-03-25T06:04:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.392+0000 7fcb33e00640 1 -- 172.21.15.102:0/1563218463 >> v1:172.21.15.187:6789/0 conn(0x7fcb340b5140 legacy=0x7fcb34153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.392+0000 7fcb33e00640 1 -- 172.21.15.102:0/1563218463 >> v1:172.21.15.102:6789/0 conn(0x7fcb340c7f10 legacy=0x7fcb3415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.392+0000 7fcb33e00640 1 -- 172.21.15.102:0/1563218463 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb340cb820 con 0x7fcb3415d3c0 2024-03-25T06:04:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.393+0000 7fcb33e00640 1 --2- 172.21.15.102:0/1563218463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb340c79d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009870 tx=0x7fcb2402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e1c748083e2b54 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.393+0000 7fcb32a00640 1 -- 172.21.15.102:0/1563218463 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2402f850 con 0x7fcb3415d3c0 2024-03-25T06:04:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.393+0000 7fcb32a00640 1 -- 172.21.15.102:0/1563218463 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcb2402f9b0 con 0x7fcb3415d3c0 2024-03-25T06:04:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.393+0000 7fcb32a00640 1 -- 172.21.15.102:0/1563218463 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2402fd60 con 0x7fcb3415d3c0 2024-03-25T06:04:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.393+0000 7fcb39400640 1 -- 172.21.15.102:0/1563218463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 msgr2=0x7fcb340c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.393+0000 7fcb39400640 1 --2- 172.21.15.102:0/1563218463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb340c79d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009870 tx=0x7fcb2402ba30 comp rx=0 tx=0).stop 2024-03-25T06:04:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.394+0000 7fcb39400640 1 -- 172.21.15.102:0/1563218463 shutdown_connections 2024-03-25T06:04:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.394+0000 7fcb39400640 1 --2- 172.21.15.102:0/1563218463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb340c79d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.394+0000 7fcb39400640 1 -- 172.21.15.102:0/1563218463 >> 172.21.15.102:0/1563218463 conn(0x7fcb340cf3e0 msgr2=0x7fcb340cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.394+0000 7fcb39400640 1 -- 172.21.15.102:0/1563218463 shutdown_connections 2024-03-25T06:04:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.394+0000 7fcb39400640 1 -- 172.21.15.102:0/1563218463 wait complete. 2024-03-25T06:04:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.395+0000 7fcb39400640 1 Processor -- start 2024-03-25T06:04:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.395+0000 7fcb39400640 1 -- start start 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.396+0000 7fcb39400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb340b5140 0x7fcb340c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.396+0000 7fcb39400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb340c7f10 0x7fcb341e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.396+0000 7fcb39400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb341e4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.396+0000 7fcb39400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb341e58e0 con 0x7fcb3415d3c0 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.396+0000 7fcb39400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3406c7c0 con 0x7fcb340b5140 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.396+0000 7fcb39400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3415cec0 con 0x7fcb340c7f10 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb341e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb33e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb340b5140 0x7fcb340c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb341e4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44886/0 (socket says 172.21.15.102:44886) 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 -- 172.21.15.102:0/1756351973 learned_addr learned my addr 172.21.15.102:0/1756351973 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb33400640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb340c7f10 0x7fcb341e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 -- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb340c7f10 msgr2=0x7fcb341e3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb340c7f10 0x7fcb341e3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 -- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb340b5140 msgr2=0x7fcb340c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb340b5140 0x7fcb340c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 -- 172.21.15.102:0/1756351973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240094d0 con 0x7fcb3415d3c0 2024-03-25T06:04:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb38a00640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb341e4450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00c760 tx=0x7fcb2c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb2be00640 1 -- 172.21.15.102:0/1756351973 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c003b70 con 0x7fcb3415d3c0 2024-03-25T06:04:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb2be00640 1 -- 172.21.15.102:0/1756351973 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcb2c003cd0 con 0x7fcb3415d3c0 2024-03-25T06:04:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.397+0000 7fcb2be00640 1 -- 172.21.15.102:0/1756351973 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c00aab0 con 0x7fcb3415d3c0 2024-03-25T06:04:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.398+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb34157610 con 0x7fcb3415d3c0 2024-03-25T06:04:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.398+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb340b4e80 con 0x7fcb3415d3c0 2024-03-25T06:04:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.399+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3404f2f0 con 0x7fcb3415d3c0 2024-03-25T06:04:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.400+0000 7fcb2be00640 1 -- 172.21.15.102:0/1756351973 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb2c00ac10 con 0x7fcb3415d3c0 2024-03-25T06:04:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.400+0000 7fcb2be00640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcb1406b840 0x7fcb1406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-25T06:04:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.401+0000 7fcb2be00640 1 -- 172.21.15.102:0/1756351973 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fcb2c08a390 con 0x7fcb3415d3c0 2024-03-25T06:04:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.401+0000 7fcb33e00640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcb1406b840 0x7fcb1406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-25T06:04:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.402+0000 7fcb33e00640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcb1406b840 0x7fcb1406dd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcb24036000 tx=0x7fcb24008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-25T06:04:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.405+0000 7fcb2be00640 1 -- 172.21.15.102:0/1756351973 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcb2c054a00 con 0x7fcb3415d3c0 2024-03-25T06:04:56.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:56.599+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb3414b6b0 con 0x7fcb3415d3c0 2024-03-25T06:04:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.150+0000 7fcb2be00640 1 -- 172.21.15.102:0/1756351973 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fcb2c056930 con 0x7fcb3415d3c0 2024-03-25T06:04:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data_ec' removed 2024-03-25T06:04:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.153+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcb1406b840 msgr2=0x7fcb1406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.153+0000 7fcb39400640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcb1406b840 0x7fcb1406dd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcb24036000 tx=0x7fcb24008030 comp rx=0 tx=0).stop 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.153+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 msgr2=0x7fcb341e4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.153+0000 7fcb39400640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb341e4450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00c760 tx=0x7fcb2c00cc20 comp rx=0 tx=0).stop 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 shutdown_connections 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:6832/864804910,v1:172.21.15.187:6833/864804910] conn(0x7fcb1406b840 0x7fcb1406dd00 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcb24036000 tx=0x7fcb24008030 comp rx=0 tx=0).stop 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3415d3c0 0x7fcb341e4450 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb340c7f10 0x7fcb341e3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 --2- 172.21.15.102:0/1756351973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb340b5140 0x7fcb340c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 >> 172.21.15.102:0/1756351973 conn(0x7fcb340cf3e0 msgr2=0x7fcb3406b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-25T06:04:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 shutdown_connections 2024-03-25T06:04:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-25T06:04:57.154+0000 7fcb39400640 1 -- 172.21.15.102:0/1756351973 wait complete. 2024-03-25T06:04:57.181 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-25T06:04:57.182 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-25T06:04:57.182 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:04:57.213 INFO:tasks.ceph.mds.a:Stopped 2024-03-25T06:04:57.213 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-25T06:04:57.213 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:04:57.283 INFO:tasks.ceph.mds.c:Stopped 2024-03-25T06:04:57.283 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-25T06:04:57.283 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:04:57.348 INFO:tasks.ceph.mds.e:Stopped 2024-03-25T06:04:57.348 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-25T06:04:57.348 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:04:57.359 INFO:tasks.ceph.mds.b:Stopped 2024-03-25T06:04:57.359 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-25T06:04:57.359 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:04:57.409 INFO:tasks.ceph.mds.d:Stopped 2024-03-25T06:04:57.409 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-03-25T06:04:57.409 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:04:57.462 INFO:tasks.ceph.mds.f:Stopped 2024-03-25T06:04:57.462 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-25T06:04:57.462 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-25T06:04:57.462 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:03.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-25T06:05:03.564 INFO:tasks.ceph.osd.0:Stopped 2024-03-25T06:05:03.565 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-25T06:05:03.565 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:09.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-25T06:05:09.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-25T06:05:09.667 INFO:tasks.ceph.osd.1:Stopped 2024-03-25T06:05:09.667 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-25T06:05:09.667 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:15.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-25T06:05:15.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-25T06:05:15.769 INFO:tasks.ceph.osd.2:Stopped 2024-03-25T06:05:15.769 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-25T06:05:15.769 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:21.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-25T06:05:21.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-25T06:05:21.871 INFO:tasks.ceph.osd.3:Stopped 2024-03-25T06:05:21.871 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-25T06:05:21.872 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:21.941 INFO:tasks.ceph.osd.4:Stopped 2024-03-25T06:05:21.941 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-25T06:05:21.942 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.023 INFO:tasks.ceph.osd.5:Stopped 2024-03-25T06:05:22.023 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-25T06:05:22.023 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.104 INFO:tasks.ceph.osd.6:Stopped 2024-03-25T06:05:22.105 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-25T06:05:22.105 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.173 INFO:tasks.ceph.osd.7:Stopped 2024-03-25T06:05:22.173 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-25T06:05:22.173 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-25T06:05:22.173 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.254 INFO:tasks.ceph.mgr.y:Stopped 2024-03-25T06:05:22.254 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-25T06:05:22.254 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.279 INFO:tasks.ceph.mgr.x:Stopped 2024-03-25T06:05:22.279 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-25T06:05:22.279 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-25T06:05:22.280 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.330 INFO:tasks.ceph.mon.a:Stopped 2024-03-25T06:05:22.331 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-25T06:05:22.331 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.341 INFO:tasks.ceph.mon.b:Stopped 2024-03-25T06:05:22.341 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-25T06:05:22.341 INFO:teuthology.orchestra.run:waiting for 300 2024-03-25T06:05:22.392 INFO:tasks.ceph.mon.c:Stopped 2024-03-25T06:05:22.393 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-25T06:05:22.393 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-25T06:05:22.548 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T06:05:22.548 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-25T06:05:22.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T06:05:22.982 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-25T06:05:23.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T06:05:23.211 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-25T06:05:23.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T06:05:23.411 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-25T06:05:23.607 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T06:05:23.607 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-25T06:05:23.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T06:05:23.912 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-25T06:05:24.006 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T06:05:24.006 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-25T06:05:24.123 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T06:05:24.124 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-25T06:05:24.222 INFO:tasks.ceph:Archiving mon data... 2024-03-25T06:05:24.223 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/data/mon.a.tgz 2024-03-25T06:05:24.224 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-03-25T06:05:24.279 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.pY0x3ITuht 2024-03-25T06:05:24.279 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pY0x3ITuht 2024-03-25T06:05:24.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.pY0x3ITuht 2024-03-25T06:05:24.616 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.pY0x3ITuht is 355KB 2024-03-25T06:05:24.724 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.pY0x3ITuht 2024-03-25T06:05:24.780 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/data/mon.b.tgz 2024-03-25T06:05:24.780 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-03-25T06:05:24.796 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.F9r7ik8SDg 2024-03-25T06:05:24.796 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.F9r7ik8SDg 2024-03-25T06:05:24.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.F9r7ik8SDg 2024-03-25T06:05:25.052 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.F9r7ik8SDg is 359KB 2024-03-25T06:05:25.148 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.F9r7ik8SDg 2024-03-25T06:05:25.162 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/data/mon.c.tgz 2024-03-25T06:05:25.162 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-03-25T06:05:25.215 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.wDt9UERrLG 2024-03-25T06:05:25.215 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wDt9UERrLG 2024-03-25T06:05:25.345 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.wDt9UERrLG 2024-03-25T06:05:25.429 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.wDt9UERrLG is 359KB 2024-03-25T06:05:25.523 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.wDt9UERrLG 2024-03-25T06:05:25.537 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-25T06:05:25.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-25T06:05:25.544 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-25T06:05:25.688 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-25T06:05:25.702 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-25T06:05:25.702 INFO:tasks.ceph:Archiving crash dumps... 2024-03-25T06:05:25.704 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/remote/smithi102/crash 2024-03-25T06:05:25.705 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-25T06:05:25.794 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/remote/smithi187/crash 2024-03-25T06:05:25.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-25T06:05:25.821 INFO:tasks.ceph:Shutting down logrotate 2024-03-25T06:05:25.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:05:25.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-25T06:05:25.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-25T06:05:26.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-25T06:05:26.080 INFO:tasks.ceph:Compressing logs... 2024-03-25T06:05:26.080 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-25T06:05:26.088 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-25T06:05:26.146 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37864.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.37864.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38024.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37864.log.gz 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37944.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38024.log.gz 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.37944.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38064.log 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr: 93.7% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37944.log.gz 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-25T06:05:26.152 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-03-25T06:05:26.153 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38064.log: -- /var/log/ceph/ceph-client.admin.37984.log 2024-03-25T06:05:26.153 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.f.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38064.log.gz 2024-03-25T06:05:26.153 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-25T06:05:26.153 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38144.log 2024-03-25T06:05:26.153 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.37984.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37984.log.gz 2024-03-25T06:05:26.153 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-25T06:05:26.153 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38144.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38144.log.gz 2024-03-25T06:05:26.154 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-25T06:05:26.154 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.log: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-25T06:05:26.154 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-25T06:05:26.158 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.b.log: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-25T06:05:26.159 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38104.log 2024-03-25T06:05:26.171 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37904.log 2024-03-25T06:05:26.172 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38104.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38104.log.gz 2024-03-25T06:05:26.178 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-25T06:05:26.186 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41046.log 2024-03-25T06:05:26.188 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-25T06:05:26.190 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42990.log 2024-03-25T06:05:26.191 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.37904.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37904.log.gz 2024-03-25T06:05:26.191 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45018.log 2024-03-25T06:05:26.192 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.42990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48311.log 2024-03-25T06:05:26.193 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45018.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41046.log.gz 2024-03-25T06:05:26.193 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42308.log 2024-03-25T06:05:26.193 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42990.log.gz 2024-03-25T06:05:26.194 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40950.log 2024-03-25T06:05:26.194 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48311.log.gz 2024-03-25T06:05:26.195 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43862.log 2024-03-25T06:05:26.196 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2024-03-25T06:05:26.197 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-03-25T06:05:26.198 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43862.log.gz 2024-03-25T06:05:26.198 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41621.log 2024-03-25T06:05:26.199 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2024-03-25T06:05:26.199 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43843.log 2024-03-25T06:05:26.200 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41090.log 2024-03-25T06:05:26.200 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45018.log.gz 2024-03-25T06:05:26.201 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-03-25T06:05:26.201 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42534.log 2024-03-25T06:05:26.202 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43843.log.gz 2024-03-25T06:05:26.202 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2024-03-25T06:05:26.203 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2024-03-25T06:05:26.204 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48395.log 2024-03-25T06:05:26.204 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2024-03-25T06:05:26.205 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44278.log 2024-03-25T06:05:26.206 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48395.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2024-03-25T06:05:26.206 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45060.log 2024-03-25T06:05:26.207 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-03-25T06:05:26.208 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44850.log 2024-03-25T06:05:26.208 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40994.log 2024-03-25T06:05:26.209 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-03-25T06:05:26.210 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40994.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41621.log.gz 2024-03-25T06:05:26.211 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44503.log 2024-03-25T06:05:26.211 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42308.log.gz 2024-03-25T06:05:26.211 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40894.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45060.log.gz 2024-03-25T06:05:26.211 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41429.log 2024-03-25T06:05:26.212 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44503.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44850.log.gz 2024-03-25T06:05:26.212 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43807.log 2024-03-25T06:05:26.213 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48437.log 2024-03-25T06:05:26.214 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44442.log 2024-03-25T06:05:26.215 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47472.log 2024-03-25T06:05:26.215 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2024-03-25T06:05:26.216 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47683.log 2024-03-25T06:05:26.216 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40994.log.gz 2024-03-25T06:05:26.217 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41429.log.gz 2024-03-25T06:05:26.217 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47472.log.gz 2024-03-25T06:05:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47557.log 2024-03-25T06:05:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43167.log 2024-03-25T06:05:26.219 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2024-03-25T06:05:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47557.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47683.log.gz 2024-03-25T06:05:26.220 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44503.log.gz 2024-03-25T06:05:26.220 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47557.log.gz 2024-03-25T06:05:26.220 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43807.log.gz 2024-03-25T06:05:26.220 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-25T06:05:26.220 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44442.log.gz 2024-03-25T06:05:26.221 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44142.log 2024-03-25T06:05:26.222 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48229.log 2024-03-25T06:05:26.223 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43529.log 2024-03-25T06:05:26.224 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48229.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48229.log.gz -5 2024-03-25T06:05:26.224 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44639.log 2024-03-25T06:05:26.225 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40535.log 2024-03-25T06:05:26.226 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42350.log 2024-03-25T06:05:26.226 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43167.log.gz 2024-03-25T06:05:26.227 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41471.log 2024-03-25T06:05:26.228 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 2024-03-25T06:05:26.229 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44892.log 2024-03-25T06:05:26.230 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41141.log 2024-03-25T06:05:26.230 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz 2024-03-25T06:05:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43032.log 2024-03-25T06:05:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46986.log 2024-03-25T06:05:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48061.log 2024-03-25T06:05:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2024-03-25T06:05:26.233 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2024-03-25T06:05:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-03-25T06:05:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47335.log 2024-03-25T06:05:26.234 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48061.log.gz 2024-03-25T06:05:26.234 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40950.log.gz 2024-03-25T06:05:26.235 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41090.log.gz 2024-03-25T06:05:26.235 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44142.log.gz 2024-03-25T06:05:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43529.log.gz 2024-03-25T06:05:26.236 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44639.log.gz 2024-03-25T06:05:26.236 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40535.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42822.log 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44892.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41141.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41471.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47335.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42350.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43032.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42534.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47335.log.gz 2024-03-25T06:05:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2024-03-25T06:05:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47070.log 2024-03-25T06:05:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2024-03-25T06:05:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2024-03-25T06:05:26.240 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47070.log.gz 2024-03-25T06:05:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43083.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-25T06:05:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-03-25T06:05:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47514.log 2024-03-25T06:05:26.243 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47291.log 2024-03-25T06:05:26.244 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47377.log 2024-03-25T06:05:26.245 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2024-03-25T06:05:26.245 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz 2024-03-25T06:05:26.245 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2024-03-25T06:05:26.245 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2024-03-25T06:05:26.245 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47514.log.gz 2024-03-25T06:05:26.245 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47599.log 2024-03-25T06:05:26.245 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47291.log.gz 2024-03-25T06:05:26.246 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47377.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47377.log.gz 2024-03-25T06:05:26.246 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45850.log 2024-03-25T06:05:26.247 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42864.log 2024-03-25T06:05:26.247 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47599.log.gz 2024-03-25T06:05:26.247 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.45850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45850.log.gz 2024-03-25T06:05:26.247 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2024-03-25T06:05:26.248 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48145.log 2024-03-25T06:05:26.249 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47112.log 2024-03-25T06:05:26.250 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2024-03-25T06:05:26.250 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48145.log.gz 2024-03-25T06:05:26.251 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2024-03-25T06:05:26.251 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47112.log.gz 2024-03-25T06:05:26.252 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2024-03-25T06:05:26.253 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2024-03-25T06:05:26.253 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2024-03-25T06:05:26.253 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42744.log 2024-03-25T06:05:26.253 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2024-03-25T06:05:26.254 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-03-25T06:05:26.255 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45210.log 2024-03-25T06:05:26.256 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47641.log 2024-03-25T06:05:26.257 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42392.log 2024-03-25T06:05:26.257 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz 2024-03-25T06:05:26.258 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2024-03-25T06:05:26.258 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2024-03-25T06:05:26.258 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-03-25T06:05:26.258 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47641.log.gz 2024-03-25T06:05:26.259 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42392.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45210.log.gz 2024-03-25T06:05:26.259 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48353.log 2024-03-25T06:05:26.260 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47154.log 2024-03-25T06:05:26.260 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42392.log.gz 2024-03-25T06:05:26.260 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48662.log 2024-03-25T06:05:26.261 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48353.log.gz 2024-03-25T06:05:26.261 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2024-03-25T06:05:26.262 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47154.log.gz 2024-03-25T06:05:26.262 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2024-03-25T06:05:26.262 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40650.log 2024-03-25T06:05:26.263 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2024-03-25T06:05:26.263 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2024-03-25T06:05:26.264 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2024-03-25T06:05:26.265 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42576.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-25T06:05:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43861.log 2024-03-25T06:05:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45144.log 2024-03-25T06:05:26.267 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2024-03-25T06:05:26.268 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40650.log.gz 2024-03-25T06:05:26.268 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41345.log 2024-03-25T06:05:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47851.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2024-03-25T06:05:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40791.log 2024-03-25T06:05:26.269 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2024-03-25T06:05:26.270 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43518.log 2024-03-25T06:05:26.271 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40791.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30660.log 2024-03-25T06:05:26.272 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44597.log 2024-03-25T06:05:26.272 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.tmp-client.admin.30660.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30660.log.gz 2024-03-25T06:05:26.273 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48103.log 2024-03-25T06:05:26.273 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44682.log 2024-03-25T06:05:26.274 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2024-03-25T06:05:26.274 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48103.log.gz 2024-03-25T06:05:26.275 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44682.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43861.log.gz 2024-03-25T06:05:26.275 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41513.log 2024-03-25T06:05:26.276 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43524.log 2024-03-25T06:05:26.276 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz 2024-03-25T06:05:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2024-03-25T06:05:26.278 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43524.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gz 2024-03-25T06:05:26.278 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44548.log 2024-03-25T06:05:26.279 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44724.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45144.log.gz 2024-03-25T06:05:26.279 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44976.log 2024-03-25T06:05:26.280 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44548.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-03-25T06:05:26.280 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41345.log.gz 2024-03-25T06:05:26.280 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40791.log.gz 2024-03-25T06:05:26.280 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43518.log.gz 2024-03-25T06:05:26.281 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43869.log 2024-03-25T06:05:26.281 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44976.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44597.log.gz 2024-03-25T06:05:26.282 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44682.log.gz/var/log/ceph/ceph-mds.e.log: 2024-03-25T06:05:26.282 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41302.log 2024-03-25T06:05:26.283 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43869.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-25T06:05:26.284 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42948.log 2024-03-25T06:05:26.285 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.y.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41513.log.gz 2024-03-25T06:05:26.285 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48019.log 2024-03-25T06:05:26.286 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48187.log 2024-03-25T06:05:26.287 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43524.log.gz 2024-03-25T06:05:26.287 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41183.log 2024-03-25T06:05:26.287 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48019.log.gz 2024-03-25T06:05:26.288 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2024-03-25T06:05:26.288 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2024-03-25T06:05:26.288 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48187.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2024-03-25T06:05:26.289 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41387.log 2024-03-25T06:05:26.289 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48187.log.gz 2024-03-25T06:05:26.289 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44976.log.gz 2024-03-25T06:05:26.290 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41183.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43869.log.gz 2024-03-25T06:05:26.290 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41250.log 2024-03-25T06:05:26.291 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-03-25T06:05:26.292 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44400.log 2024-03-25T06:05:26.293 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47420.log 2024-03-25T06:05:26.294 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44400.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41302.log.gz 2024-03-25T06:05:26.294 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2024-03-25T06:05:26.295 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-03-25T06:05:26.295 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42948.log.gz 2024-03-25T06:05:26.295 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47420.log.gz 2024-03-25T06:05:26.296 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41183.log.gz 2024-03-25T06:05:26.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42266.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-25T06:05:26.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2024-03-25T06:05:26.297 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48479.log 2024-03-25T06:05:26.298 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2024-03-25T06:05:26.299 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41387.log.gz 2024-03-25T06:05:26.299 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log 2024-03-25T06:05:26.300 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47893.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41250.log.gz 2024-03-25T06:05:26.300 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48479.log.gz 2024-03-25T06:05:26.301 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gzgzip 2024-03-25T06:05:26.301 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46944.log 2024-03-25T06:05:26.301 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40749.log 2024-03-25T06:05:26.302 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2024-03-25T06:05:26.302 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46944.log.gz 2024-03-25T06:05:26.303 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40749.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-03-25T06:05:26.304 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44400.log.gz 2024-03-25T06:05:26.304 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43528.log 2024-03-25T06:05:26.304 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2024-03-25T06:05:26.304 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42476.log 2024-03-25T06:05:26.305 INFO:teuthology.orchestra.run.smithi102.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-03-25T06:05:26.306 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43528.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-25T06:05:26.307 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42476.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-25T06:05:26.308 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2024-03-25T06:05:26.308 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-03-25T06:05:26.308 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40749.log.gz 2024-03-25T06:05:26.308 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2024-03-25T06:05:26.308 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42476.log.gz 2024-03-25T06:05:26.308 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43528.log.gz 2024-03-25T06:05:26.308 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2024-03-25T06:05:26.309 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43263.log 2024-03-25T06:05:26.310 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.42618.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-25T06:05:26.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47935.log 2024-03-25T06:05:26.312 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.c.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-03-25T06:05:26.312 INFO:teuthology.orchestra.run.smithi102.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-25T06:05:26.312 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43263.log.gz 2024-03-25T06:05:26.312 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2024-03-25T06:05:26.313 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42434.log 2024-03-25T06:05:26.313 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2024-03-25T06:05:26.314 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43532.log 2024-03-25T06:05:26.315 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44240.log 2024-03-25T06:05:26.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42434.log: /var/log/ceph/ceph-client.admin.43532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44078.log 2024-03-25T06:05:26.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44282.log 2024-03-25T06:05:26.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-03-25T06:05:26.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44282.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2024-03-25T06:05:26.319 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2024-03-25T06:05:26.320 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42744.log.gz 2024-03-25T06:05:26.320 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42822.log.gz 2024-03-25T06:05:26.320 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42864.log.gz 2024-03-25T06:05:26.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42906.log 2024-03-25T06:05:26.321 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42434.log.gz 2024-03-25T06:05:26.321 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45102.log 2024-03-25T06:05:26.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42660.log: /var/log/ceph/ceph-client.admin.42906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2024-03-25T06:05:26.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2024-03-25T06:05:26.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47028.log 2024-03-25T06:05:26.324 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43532.log.gz 2024-03-25T06:05:26.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42041.log 2024-03-25T06:05:26.325 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37032.log 2024-03-25T06:05:26.327 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47028.log.gz 2024-03-25T06:05:26.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47977.log 2024-03-25T06:05:26.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37032.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-25T06:05:26.328 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2024-03-25T06:05:26.328 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47977.log.gz 2024-03-25T06:05:26.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2024-03-25T06:05:26.330 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42702.log 2024-03-25T06:05:26.330 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2024-03-25T06:05:26.331 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47767.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz --verbose 2024-03-25T06:05:26.331 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.admin.43870.log 2024-03-25T06:05:26.334 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42702.log: /var/log/ceph/ceph-client.admin.43870.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44240.log.gz 2024-03-25T06:05:26.334 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44078.log.gz 2024-03-25T06:05:26.334 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44282.log.gz 2024-03-25T06:05:26.335 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2024-03-25T06:05:26.335 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2024-03-25T06:05:26.336 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45102.log.gz 2024-03-25T06:05:26.338 INFO:teuthology.orchestra.run.smithi102.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2024-03-25T06:05:26.339 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2024-03-25T06:05:26.339 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42702.log.gz 2024-03-25T06:05:26.340 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2024-03-25T06:05:26.340 INFO:teuthology.orchestra.run.smithi102.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-03-25T06:05:26.353 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.42041.log.gz 2024-03-25T06:05:26.406 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.c.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-25T06:05:26.423 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37032.log.gz 2024-03-25T06:05:26.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-25T06:05:26.766 INFO:teuthology.orchestra.run.smithi187.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-25T06:05:27.175 INFO:teuthology.orchestra.run.smithi102.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-25T06:05:27.465 INFO:teuthology.orchestra.run.smithi187.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-25T06:05:27.644 INFO:teuthology.orchestra.run.smithi187.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-03-25T06:05:28.181 INFO:teuthology.orchestra.run.smithi187.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-25T06:05:41.767 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-25T06:05:50.991 INFO:teuthology.orchestra.run.smithi102.stderr: 96.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-25T06:05:51.479 INFO:teuthology.orchestra.run.smithi102.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-25T06:05:51.528 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-03-25T06:06:15.243 INFO:teuthology.orchestra.run.smithi187.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-25T06:06:19.266 INFO:teuthology.orchestra.run.smithi187.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-25T06:06:24.576 INFO:teuthology.orchestra.run.smithi187.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-25T06:06:31.317 INFO:teuthology.orchestra.run.smithi187.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-25T06:06:31.319 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-03-25T06:06:31.319 INFO:teuthology.orchestra.run.smithi187.stderr:real 1m5.184s 2024-03-25T06:06:31.319 INFO:teuthology.orchestra.run.smithi187.stderr:user 3m43.471s 2024-03-25T06:06:31.319 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m7.078s 2024-03-25T06:09:41.907 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-25T06:10:59.943 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-25T06:11:32.791 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-25T06:11:36.397 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-25T06:11:36.402 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-03-25T06:11:36.402 INFO:teuthology.orchestra.run.smithi102.stderr:real 6m10.265s 2024-03-25T06:11:36.402 INFO:teuthology.orchestra.run.smithi102.stderr:user 7m54.282s 2024-03-25T06:11:36.402 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m55.090s 2024-03-25T06:11:36.404 INFO:tasks.ceph:Archiving logs... 2024-03-25T06:11:36.405 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/remote/smithi102/log 2024-03-25T06:11:36.406 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-25T06:13:20.439 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/remote/smithi187/log 2024-03-25T06:13:20.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-25T06:13:58.503 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-25T06:13:58.513 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-25T06:13:58.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-25T06:13:58.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-25T06:13:58.662 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-25T06:13:58.671 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-25T06:13:58.672 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T06:13:58.680 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-25T06:13:58.696 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-03-25T06:13:58.702 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T06:13:58.702 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-03-25T06:13:58.702 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 +230us[ +230us] +/- 72ms 2024-03-25T06:13:58.702 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -1181us[ -912us] +/- 54ms 2024-03-25T06:13:58.702 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +1327us[+1597us] +/- 60ms 2024-03-25T06:13:58.702 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T06:13:58.725 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-03-25T06:13:58.748 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-25T06:13:58.749 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-03-25T06:13:58.749 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 +189us[ +189us] +/- 72ms 2024-03-25T06:13:58.749 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -1203us[-1100us] +/- 54ms 2024-03-25T06:13:58.749 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +1305us[+1407us] +/- 60ms 2024-03-25T06:13:58.749 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-25T06:13:58.750 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-25T06:13:58.760 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-25T06:13:58.760 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-25T06:13:58.769 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-25T06:13:59.025 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-25T06:13:59.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T06:13:59.193 INFO:teuthology.orchestra.run.smithi102.stdout:type=AVC msg=audit(1711344520.043:199): avc: denied { checkpoint_restore } for pid=1202 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-03-25T06:13:59.194 DEBUG:teuthology.task.selinux:ubuntu@smithi102.front.sepia.ceph.com has 1 denials 2024-03-25T06:13:59.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-25T06:13:59.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T06:13:59.226 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi102.front.sepia.ceph.com: ['type=AVC msg=audit(1711344520.043:199): avc: denied { checkpoint_restore } for pid=1202 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-25T06:13:59.227 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-25T06:13:59.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-25T06:13:59.246 INFO:teuthology.task.internal:Duration was 2721.685022 seconds 2024-03-25T06:13:59.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-25T06:13:59.256 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-25T06:13:59.256 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-25T06:13:59.263 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-25T06:13:59.310 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T06:13:59.420 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-25T06:13:59.555 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-25T06:13:59.555 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-03-25T06:13:59.555 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-25T06:13:59.621 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-03-25T06:13:59.622 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-25T06:13:59.649 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-25T06:13:59.649 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-25T06:13:59.655 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-25T06:13:59.745 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-25T06:13:59.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-25T06:13:59.751 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-25T06:13:59.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-25T06:13:59.957 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-25T06:13:59.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-25T06:14:00.065 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-25T06:14:00.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-25T06:14:00.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-25T06:14:00.110 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-25T06:14:00.158 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-03-25T06:14:00.224 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-03-25T06:14:00.279 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-25T06:14:00.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T06:14:00.326 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-25T06:14:00.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-25T06:14:00.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-25T06:14:00.351 INFO:teuthology.task.internal:Transferring archived files... 2024-03-25T06:14:00.352 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/remote/smithi102 2024-03-25T06:14:00.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-25T06:14:00.467 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035/remote/smithi187 2024-03-25T06:14:00.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-25T06:14:00.502 INFO:teuthology.task.internal:Removing archive directory... 2024-03-25T06:14:00.502 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-25T06:14:00.510 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-25T06:14:00.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-25T06:14:00.571 INFO:teuthology.task.internal:Not uploading archives. 2024-03-25T06:14:00.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-25T06:14:00.584 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-25T06:14:00.585 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-25T06:14:00.593 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-25T06:14:00.607 INFO:teuthology.orchestra.run.smithi187.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 25 06:14 /home/ubuntu/cephtest 2024-03-25T06:14:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 25 06:14 /home/ubuntu/cephtest 2024-03-25T06:14:00.645 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-25T06:14:00.655 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-25T06:14:00.667 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi102.front.sepia.ceph.com: ['type=AVC msg=audit(1711344520.043:199): avc: denied { checkpoint_restore } for pid=1202 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-25T06:14:00.667 INFO:teuthology.nuke:Checking targets against current locks 2024-03-25T06:14:00.691 DEBUG:teuthology.nuke:shortname: smithi102 2024-03-25T06:14:00.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T06:14:00.715 DEBUG:teuthology.nuke:shortname: smithi187 2024-03-25T06:14:00.716 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T06:14:00.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 05:19:42.270845', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQ1SP74oF+c5wVj+bUO9SS/amN6iBbEmTlPkS95bKPZdnl8lZrkEkIe5FPPUG7iOtcekG5YkjodNJkYFfAbgu0='} 2024-03-25T06:14:00.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7620035', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 05:19:42.272417', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFi0pCnzlxdW/rToVAvwGkmc5+ykD7wFD94xMbqIbbyacCEx4x+y0WhN0+zrcCOlGW6kxkAu2QVTzuuCIvoBZo='} 2024-03-25T06:14:00.768 INFO:teuthology.orchestra.console.smithi102:Power off 2024-03-25T06:14:00.769 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T06:14:00.797 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-03-25T06:14:00.797 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T06:14:00.817 INFO:teuthology.orchestra.console.smithi187:Power off 2024-03-25T06:14:00.817 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T06:14:00.826 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-03-25T06:14:00.839 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-03-25T06:14:00.840 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T06:14:00.863 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-25T06:14:04.827 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T06:14:04.864 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T06:14:04.938 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-03-25T06:14:04.976 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-25T06:14:08.940 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T06:14:08.977 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T06:14:09.052 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-03-25T06:14:09.087 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-03-25T06:14:09.154 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-03-25T06:14:09.187 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-03-25T06:14:09.293 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/lockdep} duration: 2721.685022354126 failure_reason: 'SELinux denials found on ubuntu@smithi102.front.sepia.ceph.com: [''type=AVC msg=audit(1711344520.043:199): avc: denied { checkpoint_restore } for pid=1202 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'']' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-03-25T06:14:09.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T06:14:09.375 INFO:teuthology.run:FAIL